Software Development Engineer, Distributed Systems, Annapurna Labs

1 day ago


Cupertino, California, United States Amazon Full time $129,300 - $223,600
Annapurna Labs builds custom Machine Learning accelerators that are at the forefront of AWS innovation and one of several AWS tools used for building Generative AI on AWS. The Neuron Compiler Engineering team is searching for a Software Development Engineer to support the development infrastructure of a compiler to enable the world's largest ML workloads to run efficiently in the cloud.

Amazon Annapurna Labs organization is responsible for silicon development at AWS. Organization covers multiple disciplines including silicon engineering, hardware design and verification, software and operations. The AWS Neuron team works to optimize the performance of complex neural net models on our custom-built AWS hardware. More specifically, the AWS Neuron team is developing a deep learning compiler stack that takes neural network descriptions created in frameworks such as TensorFlow, PyTorch, and Jax, and converts them into code suitable for execution.

As a Software Development Engineer on the team, you will be responsible for identifying and designing solutions that enable efficient and reliable build, test, and release mechanisms for the Neuron compiler. You will participate in design and implementation of a solution for distributed execution of the Neuron compiler that will help to run customer workloads more efficiently. You will leverage your technical communications skill as a hands-on partner to AWS ML services teams, bringing new products/features to market, and many other exciting projects.

Key job responsibilities
Our engineers collaborate across diverse teams, projects, and environments to have a firsthand impact on our global customer base. You'll bring a passion for innovation, data, search, analytics, and distributed systems. You'll also:

- Solve challenging technical problems, often ones not solved before, at every layer of the stack.
- Design, implement, test, deploy and maintain innovative software solutions to transform service performance, durability, cost, and security.
- Build high-quality, highly available, always-on products.
- Research implementations that deliver the best possible experiences for customers.

A day in the life
As you design and code solutions to help our team drive efficiencies in software architecture, you'll create metrics, implement automation and other improvements, and resolve the root cause of software defects. You'll also:

- Build high-impact solutions to deliver to our large customer base.
- Participate in design discussions, code review, and communicate with internal and external stakeholders.
- Work cross-functionally to help drive business decisions with your technical input. You will collaborate closely with a cross-functional team comprised of compiler, hardware, and ML engineers.
- Work in a startup-like development environment, where you're always working on the most important stuff.

Basic Qualifications:
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language

Preferred Qualifications:
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company's reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $129,300/year in our lowest geographic market up to $223,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.

  • Cupertino, California, United States Amazon Web Services (AWS) Full time $129,300 - $223,600 per year

    DescriptionAnnapurna Labs builds custom Machine Learning accelerators that are at the forefront of AWS innovation and one of several AWS tools used for building Generative AI on AWS. The Neuron Compiler Engineering team is searching for a Software Development Engineer to support the development infrastructure of a compiler to enable the world's largest ML...


  • Cupertino, California, United States Amazon Web Services Full time $133,200 - $220,200 per year

    DESCRIPTIONSenior Strategic Initiatives Go to Market (GTM) specialist, role on the Amazon Annapurna Labs ML team is responsible for driving growth on mid and long term strategic initiatives with AI research and open source communities. This position focuses on understanding influential AI researcher and open source community needs and how to best onboard...


  • Cupertino, California, United States Amazon Full time $129,300 - $223,600

    The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon's custom machine learning accelerators, Inferentia and Trainium.The AWS Neuron SDK, developed by the Annapurna Labs team at AWS, is the backbone for accelerating deep learning and GenAI workloads...


  • Cupertino, California, United States Amazon Full time $129,300 - $223,600

    The Product: AWS Machine Learning accelerators are at the forefront of AWS innovation. The Inferentia chip delivers best-in-class ML inference performance at the lowest cost in cloud. Trainium will deliver the best-in-class ML training performance with the most teraflops (TFLOPS) of compute power for ML in the cloud. This is all enabled by edge software...


  • Cupertino, California, United States Amazon Web Services (AWS) Full time $133,900 - $231,400 per year

    DescriptionWe're seeking a Senior Engineering Technical Program Manager for the Annapurna ML networking teams. In this role you will be responsible for scoping and delivering large projects end-to-end. Responsibilities include collection of business and systems requirements from engineering leaders, driving project schedules from design to release, and...


  • Cupertino, California, United States Amazon Full time $143,300 - $247,600 per year

    Utility Computing (UC)AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon's Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll...


  • Cupertino, California, United States Amazon Full time $151,300 - $261,500

    AWS Utility Computing (UC) provides product Annapurna Labs (our organization within AWS UC) designs silicon and software that accelerates innovation. Customers choose us to create cloud solutions that solve challenges that were unimaginable a short time ago—even yesterday. Our custom chips, accelerators, and software stacks enable us to take on technical...


  • Cupertino, California, United States Amazon Web Services (AWS) Full time $143,300 - $247,600 per year

    DescriptionAmazon Web Services provides a highly reliable, scalable, low-cost infrastructure platform in the cloud that powers hundreds of thousands of businesses in 190 countries around the world. We have data center locations in the U.S., Europe, Singapore, and Japan, and customers across all industries. We are seeking experienced Hardware Design Engineers...


  • Cupertino, California, United States Amazon Full time $166,400 - $287,700 per year

    Annapurna Labs builds high-performance hardware and software solutions used in AWS data centers globally. We're looking for an experienced software development manager to lead a team in the Trainium Collective Communication group. The group delivers the the fundamental operations that enable AI to scale across multiple accelerators & servers.Most of our...


  • Cupertino, California, United States Amazon Web Services (AWS) Full time $143,300 - $247,600 per year

    DescriptionAWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon's Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll support the...