Senior Software Development Engineer, AWS Neuron Frameworks

1 week ago

Cupertino CA, United States Annapurna Labs (U.S.) Inc. Full time
AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine
learning accelerators. As a part of the Neuron Frameworks team you'll develop and enhance support PyTorch and JAX for AWS Neuron, working with the open source ecosystem.

You will develop and extend support for the leading ML frameworks, delivering an outstanding user experience for PyTorch and JAX ML model development on the Trainium and Inferentia accelerators. You will work closely with teams across AWS Neuron including compiler, training and inference optimization to optimize frameworks for AWS's accelerator architectures, and engage closely with the PyTorch and JAX and other ML Framework communities to take advantage of their latest capabilities and improve performance and usability for ML model developers.

A successful candidate will have a experience developing Machine Learning infrastructure and/or ML Frameworks, a demonstrated ability to work with open source communities to influence future community direction, a robust technical ability and a motivation to achieve results. Experience with technologies and tools such as XLA, vLLM or Hugging Face transformers is highly valued.

Key job responsibilities
You will work with the team to develop, improve and release JAX and Pytorch framework support for AWS Neuron.
You will understand current and future directions of ML framework development, with a focus on enabling key features of modern frameworks such as Torch.compile().
You will work closely with the PyTorch and JAX community to actively drive the future directions to improve the experience of developing and optimizing ML models on accelerators

A day in the life
As you develop and code improvements in ML Frameworks you’ll build and optimize high-impact solutions with and for users at Amazon and across the ML industry. You will and work with the JAX and PyTorch open source communities to adopt and influence new technologies, and contribute innovations.

You'll collaborate with other engineers within Neuron and cross-functionally to help drive projects with successful business outcomes using your technical expertise.

You will work in a fast-paced development environment, where you’re always working on the most important challenges and customer needs.

About the team
Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge-sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects that help our team members develop your engineering expertise so you feel empowered to take on more complex tasks in the future.

BASIC QUALIFICATIONS - 5+ years of non-internship professional software development experience
- 5+ years of programming with at least one software programming language experience
- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Experience as a mentor, tech lead or leading an engineering team
PREFERRED QUALIFICATIONS - Bachelor's degree in computer science or equivalent

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $151,300/year in our lowest geographic market up to $261,500/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.

  • Senior Software Development Engineer, AWS Neuron Frameworks

    1 week ago

    cupertino, United States Annapurna Labs (U.S.) Inc. Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machinelearning accelerators. As a part of the Neuron Frameworks team you'll develop and enhance support PyTorch and JAX for AWS Neuron, working with the open source ecosystem.You will develop and extend support for the leading ML frameworks, delivering an outstanding...

  • Senior Software Development Engineer, AWS Neuron Frameworks

    4 weeks ago

    Cupertino, United States Annapurna Labs (U.S.) Inc. Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machinelearning accelerators. As a part of the Neuron Frameworks team you'll develop and enhance support PyTorch and JAX for AWS Neuron, working with the open source ecosystem.You will develop and extend support for the leading ML frameworks, delivering an outstanding...

  • Senior Software Development Engineer, AWS Neuron Frameworks

    3 weeks ago

    Cupertino, CA, United States Annapurna Labs (U.S.) Inc. Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machinelearning accelerators. As a part of the Neuron Frameworks team you'll develop and enhance support PyTorch and JAX for AWS Neuron, working with the open source ecosystem.You will develop and extend support for the leading ML frameworks, delivering an outstanding...

  • Sr. Machine Learning

    7 days ago

    Cupertino, United States Amazon Web Services (AWS) Full time

    DescriptionAWS Machine Learning accelerators are at the forefront of AWS innovation and one of several AWS tools used for building Generative AI on AWS. The Inferentia chip delivers best-in-class ML inference performance at the lowest cost in cloud. Trainium delivers the best-in-class ML training performance with the most teraflops (TFLOPS) of compute power...

  • Sr. Machine Learning

    7 days ago

    Cupertino, United States Amazon Web Services (AWS) Full time

    DescriptionAWS Machine Learning accelerators are at the forefront of AWS innovation and one of several AWS tools used for building Generative AI on AWS. The Inferentia chip delivers best-in-class ML inference performance at the lowest cost in cloud. Trainium delivers the best-in-class ML training performance with the most teraflops (TFLOPS) of compute power...

  • Lead Software Engineer, Neuron Runtime

    2 weeks ago

    Cupertino, California, United States Amazon Full time

    About AWS AIAt AWS AI, our mission is to empower developers by making deep learning accessible and integrating cutting-edge infrastructure into their workflows.Our InnovationsWe have developed pioneering software and hardware solutions to fulfill this mission. AWS Neuron is a software development kit (SDK) designed to enhance the performance of intricate...

  • Software Engineering Intern

    1 week ago

    Cupertino, CA, United States Annapurna Labs (U.S.) Inc. Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine As a part of the Neuron Frameworks team you'll develop and enhance support PyTorch and JAX for AWS Neuron, working with the open source ecosystem. You will develop and extend support for the leading ML frameworks, delivering an outstanding user experience...

  • Senior Software Development Manager, Neuron SDK, AWS Neuron SDK

    2 weeks ago

    Cupertino, California, United States Amazon Full time

    About the RoleAmazon is seeking a seasoned Software Development Manager to lead the development of the Neuron SDK. As a key member of our team, you will be responsible for overseeing the design, development, testing, and deployment of this critical software component.Key Responsibilities:Technical Leadership: Provide technical guidance and oversight to a...

  • Senior Compiler Developer for AWS Neuron

    1 week ago

    Cupertino, California, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Machine Learning Compiler Engineer II to join our AWS Neuron Compiler team at Amazon. As a key member of this team, you will play a critical role in the development and scaling of a compiler to handle the world's largest ML workloads.Key ResponsibilitiesArchitect and implement business-critical features for the...

  • Sr. Technical/Engineering Program Manager

    3 weeks ago

    Cupertino, CA, United States Annapurna Labs (U.S.) Inc. Full time

    AWS Neuron is the team that delivers the software that powers the Inferentia and Trainium-based Inf1, Inf2, Trn1 an Trn1n families of Machine Learning Accelerated EC2 instances. We build a Compiler , Drivers, Runtime and a fully integrated suite of Pytorch and Tensorflow stacks, providing the highest-scale, distributed Training and Inference servers...

  • Senior Machine Learning Engineer, Annapurna ML

    11 hours ago

    Cupertino, California, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Senior Machine Learning Engineer to join our Annapurna ML pathfinding team. As a key member of this team, you will play a critical role in helping our most strategic customers accelerate their adoption of Annapurna ML products, including AWS Trainium and AWS Inferentia.Key ResponsibilitiesCollaborate with...

  • Senior Technical Program Manager, Neuron Compiler

    2 weeks ago

    Cupertino, California, United States Amazon Full time

    About the RoleThe AWS Neuron Compiler team is on the lookout for a seasoned and driven Senior Technical Program Manager to enhance the efficiency and predictability of our LLM model enablement initiative. This is an exceptional opportunity for individuals who are enthusiastic about machine learning, compilers, chip architecture, and software engineering.Your...

  • Senior HTTP Frameworks Software Engineer

    5 days ago

    Cupertino, California, United States Apple Inc. Full time

    Job DescriptionJob SummaryWe are seeking a highly skilled Senior Software Engineer to join our team at Apple Inc. as a Senior HTTP Frameworks Software Engineer. This is a unique opportunity to work on next-generation technologies for Apple's mobile, desktop, wearable, and services platforms.Key ResponsibilitiesCraft and implement new features for Apple's...

  • Senior Technical Program Manager

    2 weeks ago

    Cupertino, California, United States Annapurna Labs Full time

    Join Our TeamAre you passionate about shaping the future of AWS AI Chips (AWS Inferentia/Trainium) Go to Market (GTM)? As a key member of the AWS AI Chips Business and GTM team, you will spearhead our most vital customer and industry partnership engagement initiatives.Your RoleIn this position, you will work closely with customers who deploy GenAI...

  • Senior Technical Program Manager

    2 weeks ago

    Cupertino, California, United States Amazon Full time

    Join the Future of AWS AI ChipsAre you ready to shape the landscape of AWS AI Chips (AWS Inferentia/Trainium) Go to Market (GTM)? As a pivotal member of the global AWS AI Chips Business and GTM team, you will spearhead our most significant customer and industry partnership initiatives. Our clientele is at the forefront of deploying GenAI applications...

  • Senior Compiler Engineer III

    2 weeks ago

    Cupertino, California, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Senior Machine Learning Compiler Engineer III to join our Neuron Compiler team at Amazon. As a key member of this team, you will play a critical role in developing and scaling a compiler to enable the world's largest ML workloads to run performantly on custom Annapurna systems.Key ResponsibilitiesSolve complex...

  • Senior Software Development Engineer, AWS Aurora MySQL Engine

    1 week ago

    East Palo Alto, CA, United States Amazon Development Center U.S., Inc. Full time

    Are you interested in building hyper-scale database services in the cloud? Do you want to revolutionize the way databases are built for the cloud ? Do you want to have direct and immediate impact on hundreds of thousands of users who use AWS database services? Amazon Aurora is a MySQL-compatible, relational database engine that combines the speed and...

  • Senior Engineering Program Manager

    2 weeks ago

    Cupertino, California, United States Amazon Inc Full time

    About the Role:As a key member of the AWS Neuron team, you will oversee the development of cutting-edge software that supports the Inferentia and Trainium-based EC2 instances, including the Inf 1, Inf 2, Trn 1, and Trn 1n families. Your Responsibilities:In this role, you will be responsible for: Leading the design and implementation of a comprehensive...

  • Senior Software Development Engineer

    9 hours ago

    Cupertino, California, United States Apple Full time

    Job SummaryWe are seeking a highly skilled Senior Full Stack Software Development Engineer to join our Eval Engineering team at Apple Maps. The ideal candidate will possess substantial professional experience in software development and the implementation of large-scale, scalable data solutions.Key ResponsibilitiesDesign and implement novel automated systems...

  • Senior Software Development Engineer

    5 days ago

    Cupertino, California, United States Apple Full time

    About the RoleWe are seeking a highly skilled Senior Software Development Engineer to join our Data Platform team at Apple. As a key member of our team, you will be responsible for developing and implementing cutting-edge data solutions that accelerate the adoption of our Apple Data Platform.Key ResponsibilitiesDefine and drive technical vision, roadmap, and...