Software Development Manager, Machine Learning Acceleration, Neuron ML Apps

3 weeks ago

Woodinville, Washington, United States Annapurna Labs Full time
Software Development Manager, Machine Learning Acceleration, Neuron ML Apps

AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine
learning accelerators and the Trn1 and Inf1 servers that use them.


As the Software Development Manager for the ML Applications - Multi-modal team, you will be responsible for leading a strong team of engineers to help design and deploy ML applications/usecases on LLMs that leverage all modes of input/output-generation such as Text, Vision, Video, Audio etc.

You will be responsible for the full development life cycle of providing inference support for the multi-modal models such as MM-GPT, CLIP, BLIP2 etc.

Develop reliability/scalability features and performance optimizations in the Neuron ML Framework components to enable them make Trainium and Inferentia devices as the first-class citizens for ML Acceleration.

Lead the way to ensure support for key ML functionality in a combined chip / software platform. Ensure the right thing is being built and delivered to customers


A successful candidate will have an established background in optimizing Machine Learning framework components along-with a strong technical ability to work/deliver on a vertically integrated system stack that consists of a combinatorial matrix of hardware, frameworks, and workflows.

Deep expertise in optimizing performance for non-text language models using Python/C++ is a must along-with direct customer-facing experience and a strong motivation to achieve results.

Key job responsibilities
Our engineers collaborate across diverse teams, projects, and environments to have a firsthand impact on our global customer base. You'll bring a passion for innovation, data, search, analytics, and distributed systems.

You'll also:
Solve challenging technical problems, often ones not solved before, at every layer of the stack.
Design, implement, test, deploy and maintain innovative software solutions to transform service performance, durability, cost, and security.
Build high-quality, highly available, always-on products.
Research implementations that deliver the best possible experiences for customers.

A day in the life

You will work with the executive leadership and other senior management and technical leaders to define product directions and deliver them to customers.

We build massive-scale distributed training and inference solutions. This organization builds the full stack of software, servers and chips to accelerate at the highest scale.

About the team
Diverse Experiences
AWS values diverse experiences.

Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply.

If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying.

Why AWS?
Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform.

We pioneered cloud computing and never stopped innovating — that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.

Inclusive Team Culture
Here at AWS, it's in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences.

Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.

Mentorship & Career Growth
We're continuously raising our performance bar as we strive to become Earth's Best Employer.

That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.

Work/Life Balance
We value work-life harmony.

Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture.

When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud.

We are open to hiring candidates to work out of one of the following locations:

Seattle, WA, USA

BASIC QUALIFICATIONS

  • 3+ years of engineering team management experience
  • 7+ years of working directly within engineering teams experience
  • 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
  • Experience partnering with product or program management teams

PREFERRED QUALIFICATIONS

  • 2 years experience leading teams that in Machine Learning development including building and training large models, working with Pytroch and/or Tensorflow using large distributed fleets of GPU or other accelerated systems.
Amazon is committed to a diverse and inclusive workplace.

Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.

For individuals with disabilities who would like to request an accommodation, please visit

Our compensation reflects the cost of labor across several US geographic markets.

The base pay for this position ranges from $148,000/year in our lowest geographic market up to $287,700/year in our highest geographic market.

Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.

Amazon is a total compensation company.

Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits.

For more information, please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.

Posted:
May 2, 2024

(Updated 7 minutes ago)

Posted:
August 7, 2023

(Updated about 1 hour ago)

Posted:
May 9, 2024

(Updated about 3 hours ago)

Posted:
May 8, 2024

(Updated about 7 hours ago)

Posted:
May 6, 2024

(Updated about 7 hours ago)
Share this job

Important FAQs for current Government employees

Before proceeding, please review the following FAQs

Amazon is committed to a diverse and inclusive workplace.

Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.

#J-18808-Ljbffr

  • Restoration Business Development Manager

    3 weeks ago

    Woodinville, Washington, United States COIT Cleaning and Restoration Services Full time

    Restoration Business Development ManagerPOSITION SUMMARY:Under general supervision performs customer sales and service functions throughout the Target Market. Supports local, regional, national corporate efforts as needed. Consults with Supervisor regarding financial goals and performance objectives within the territory.ESSENTIAL FUNCTIONS:Be a good...

  • IT Manager

    3 weeks ago

    Woodinville, Washington, United States Modern Hydrogen Full time

    IT Manager at Modern Hydrogen Location: Woodinville, WA Employment Type: Full Time - Onsite Are you a tech-savvy individual looking for a challenging opportunity? Modern Hydrogen is currently seeking an IT Manager to join our dynamic team based in Seattle. As the IT Manager, you will play a crucial role in managing and optimizing our IT ecosystem to ensure...

  • Parts Repair Tech

    1 month ago

    Woodinville, Washington, United States RS&A, LLC Full time

    Who We Are:Summit Imaging is an ultrasound medical device service and support company, a subsidiary of RSA, a cancer equipment treatment service and support organization. At Summit Imaging, a subsidiary of RSA, our business is to ensure critical medical devices are available whenever needed to treat and diagnose patients. Summit Imaging joined RSA with the...

  • Parts Repair Tech

    3 weeks ago

    Woodinville, Washington, United States RS&A, LLC Full time

    Who We Are:Summit Imaging is an ultrasound medical device service and support company, a subsidiary of RSA, a cancer equipment treatment service and support organization.At Summit Imaging, a subsidiary of RSA, our business is to ensure critical medical devices are available whenever needed to treat and diagnose patients. Summit Imaging joined RSA with the...

  • Press Operator

    3 weeks ago

    Woodinville, Washington, United States Aerotek Full time

    Job Title: Press Operator (Swing)*Job DescriptionAs a Press Operator, you will be operating injection molding machines manually, performing finishing and trimming of parts, inspecting basic parts for quality issues, and assembling final products according to quality standards. You will be expected to comply with all safety procedures and policies.Hard...

  • Press Operator

    3 weeks ago

    Woodinville, Washington, United States Aerotek Full time

    **Job Title: Press Operator (Swing)** **Job Description** As a Press Operator, you will be operating injection molding machines manually, performing finishing and trimming of parts, inspecting basic parts for quality issues, and assembling final products according to quality standards. You will be expected to comply with all safety procedures and policies....

  • Production Technician, Early Morning Shift

    3 weeks ago

    Woodinville, Washington, United States Praxair Full time

    About Linde Advanced Material Technologies Linde Advanced Material Technologies, formerly Praxair Surface Technologies, is a company that revolutionizes industries through innovative materials and surface coatings. We are leaders in advanced materials and offer metal powders, sputtering targets, and surface coatings that enhance performance across various...

  • Press Brake Operator

    3 weeks ago

    Woodinville, Washington, United States Aerotek Full time

    Job Title: Press Brake Operator*Job DescriptionAs a Press Brake Operator, you'll get to work hands-on with cutting-edge equipment, operating a Trumpf press brake machine and a Trumpf laser cutter. You'll be actively involved in shaping our products, bending, forming, cutting, and shaping sheet metal to required dimensions, using diagrams, sequences, and...

  • Account Manager-Sports

    3 weeks ago

    Woodinville, Washington, United States BDA Full time

    Most companies claim to have the best people. We say to them, "Keep dreaming." Our people are second to none. They set us apart with their entrepreneurial spirit, ambition and an unhealthy obsession with Halloween. (Have you seen the pictures?) They come to us from the likes of Amazon, Microsoft, Nordstrom, Starbucks and the sports world, bringing energy,...

  • Mechanical Assembler Level 1

    3 weeks ago

    Woodinville, Washington, United States Aerotek Full time

    **Mechanical Assembler** **Overview** + $21.00-$23.00 per hour + First shift + Onsite in Everett, WA + Contract-to-hire **Job Description** Join our team as a Mechanical Assembler, where you will be responsible for building packaging sub-assemblies that will later be installed into machines by a technician. Your duties will include checking parts for proper...

  • Production Associate

    1 month ago

    Woodinville, Washington, United States PPG INDUSTRIES INC Full time

    Immediately HiringProduction Associate, Seattle, WASalary per Hour: $24.50Shift: Day 5:00am - 1:30pm As a Production Associate you will be a crucial part of our operations, ensuring that a quality product is available to our customers when they need them. Your work will directly affect people's livesText "PPG" to to quickly apply to this position and...

  • Production Associate

    3 weeks ago

    Woodinville, Washington, United States PPG - USA Full time

    Immediately HiringProduction Associate, Seattle, WASalary per Hour: $24.50Shift: Day 5:00am - 1:30pm As a Production Associate you will be a crucial part of our operations, ensuring that a quality product is available to our customers when they need them. Your work will directly affect people's livesText "PPG" to to quickly apply to this position and...

  • Senior Marketing Manager

    3 weeks ago

    Woodinville, Washington, United States BDA Full time

    Most companies claim to have the best people. We say to them, "Keep dreaming." Our people are second to none. They set us apart with their entrepreneurial spirit, ambition and an unhealthy obsession with Halloween. (Have you seen the pictures?) They come to us from the likes of Amazon, Microsoft, Nordstrom, Starbucks and the sports world, bringing energy,...

  • Order Management Coordinator

    3 weeks ago

    Woodinville, Washington, United States VALID8 Financial Full time

    The Order Management Coordinator is responsible for managing and overseeing the entire order cycle, ensuring efficiency and timely processing of orders. This role is a vital link between customers, sales teams, and operations departments, coordinating order details, shipment schedules, and delivery processes.A coordinator in Order Management plays a critical...

  • Press Brake Operator

    3 weeks ago

    Woodinville, Washington, United States Aerotek Full time

    A leader in packaging technology is looking to add a press brake operator to their team **JOB DESCRIPTION** Operate a Trumpf press brake machine. Operate a Trumpf laser cutter. Bent and form the product using the sequence indicated. Check heigh, depth and other tolerances using calipers, gauges, and a tape measure. **WHY YOULL LOVE THIS JOB** Weekly pay,...

  • Quality Control Specialist II

    3 weeks ago

    Woodinville, Washington, United States Bio-Rad Laboratories Full time

    BIO RAD LABORATORIES - 390 Quality Control Specialist II Woodinville , Washington Apply Now Bio-Rad is looking for a Quality Control Specialist II to support Bio-Rad's commitment to quality and safety by testing raw material and in-process commercial Quality Control testing. As a part of our Quality Control team, you'll apply your science knowledge in...

  • Senior Geotechnical Engineer

    3 weeks ago

    Woodinville, Washington, United States Professional Service Industries Full time

    Senior Geotechnical Engineer Professional Service Industries, Inc. (Intertek-PSI) is looking for a Senior Geotechnical Engineer to join our Building & Construction team in Woodinville, WA. Intertek-PSI is a leading US based provider of assurance, testing, inspection, and consulting solutions in civil and commercial construction. Our broad service offering...

  • Piping Designer

    3 weeks ago

    Woodinville, Washington, United States Modern Hydrogen Full time

    Pipe DesignerModern HydrogenWoodinville, WA - Full Time – OnsiteModern Hydrogen is looking for a Pipe Designer to lead the design and layout of a methane pyrolysis system, optimizing and iterating quickly with mechanical design, process engineering, and manufacturing teams to develop the best solution. This role involves working onsite in Woodinville, WA...

  • Senior Civil Estimator

    3 weeks ago

    Woodinville, Washington, United States Dynamic Office & Accounting Solutions Full time

    Job DescriptionJob DescriptionSenior Civil EstimatorLocation: Woodinville, WA Salary Range: $110-150kFull-Time, OnsiteDirect HireAre you a seasoned estimator looking for your next challenge? Look no further We are seeking a Senior Civil Estimator to join a premier Earthwork, Utilities, and Concrete contractor serving the Pacific Northwest This team isn't...

  • Senior Civil Estimator

    3 weeks ago

    Woodinville, Washington, United States Dynamic Office & Accounting Solutions Full time

    Job Description Job Description Senior Civil Estimator Location: Woodinville, WA Salary Range: $110-150k Full-Time, Onsite Direct Hire Are you a seasoned estimator looking for your next challenge? Look no further We are seeking a Senior Civil Estimator to join a premier Earthwork, Utilities, and Concrete contractor serving the Pacific Northwest This team...