Current jobs related to Lead Software Engineer, Neuron Runtime - Cupertino, California - Amazon


  • Cupertino, California, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Software Development Engineer to join our AWS Neuron Inference team. As a key member of this team, you will be responsible for developing, enabling, and optimizing a wide range of machine learning models, including large language models, vision transformers, and more.Key ResponsibilitiesDesign and develop...


  • Cupertino, California, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our AWS Neuron Applications team. As a key member of our team, you will be responsible for developing, enabling, and performance tuning of a wide variety of machine learning model families, including large language models, stable diffusion, and vision transformers.Our team works...


  • Cupertino, California, United States Amazon Full time

    About the RoleThis is a unique opportunity to join the Machine Learning Applications team at Amazon, where you will be responsible for developing, enabling, and performance tuning a wide variety of machine learning model families.As a software engineer in this team, you will work closely with compiler engineers and runtime engineers to create, build, and...


  • Cupertino, California, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Senior Runtime Software Development Engineer to join our team at Amazon. As a key member of our Utility Computing organization, you will be responsible for designing and developing high-performance software solutions for our customers.As a Senior Runtime Software Development Engineer, you will have the...


  • Cupertino, California, United States Amazon Full time

    About the RoleThis is a software engineer position in the Machine Learning Applications (ML Apps) team for AWS Neuron. The team works on development, enablement, and performance tuning of machine learning models, including large language models and vision transformers.The ideal candidate will have experience optimizing inference performance for latency and...


  • Cupertino, California, United States Annapurna Labs (U.S.) Inc. Full time

    About the RoleWe are seeking a highly skilled Senior Runtime Software Development Engineer to join our team at Annapurna Labs (U.S.) Inc. in the AWS AI organization. As a key member of our team, you will be responsible for designing and developing innovative software solutions for our machine learning accelerators, including the AWS Inferentia and Trainium...


  • Cupertino, California, United States Annapurna Labs (U.S.) Inc. Full time

    About the RoleWe are seeking a highly skilled Senior Runtime Software Development Engineer to join our team at Annapurna Labs (U.S.) Inc. in the AWS AI organization. As a key member of our team, you will be responsible for designing, developing, and delivering high-performance software solutions for our machine learning accelerators.Key...


  • Cupertino, California, United States Amazon Full time

    About the RoleWe are seeking a highly experienced Senior Software Development Manager to lead our team in developing and extending Neuron support for leading ML frameworks, including PyTorch and JAX. As a key member of our AWS Neuron team, you will be responsible for delivering framework plugins and libraries that enable a great user experience for...


  • Cupertino, California, United States Annapurna Labs Full time

    About the RoleAs a Senior Software Engineer in the Distributed Training team for AWS Neuron, you will be responsible for developing, enabling, and performance tuning of a wide variety of ML model families, including massive-scale Large Language Models (LLM) such as GPT and Llama, as well as Stable Diffusion, Vision Transformers (ViT) and many more.About the...


  • Cupertino, California, United States Annapurna Labs Full time

    About the RoleAnnapurna Labs, now fully integrated into AWS, is a leader in infrastructure innovation. Our Machine Learning Applications (ML Apps) team is seeking a skilled Software Engineer to join our AWS Neuron team. As a key member of this team, you will be responsible for developing, enabling, and performance-tuning a wide range of machine learning...


  • Cupertino, California, United States Annapurna Labs Full time

    About the RoleWe are seeking a highly experienced Senior Software Development Manager to lead our Neuron Inference Customer Enablement Team. As a key member of our organization, you will be responsible for optimizing customer or open-source models for inference performance on various frameworks such as PyTorch, JAX, and TensorFlow.Key ResponsibilitiesLead a...


  • Cupertino, California, United States Amazon Full time

    Job DescriptionAnnapurna Labs is a leading innovator in custom Machine Learning accelerators, and we're seeking a talented Software Development Engineer to join our team. As a key member of our Neuron Compiler Engineering team, you will play a critical role in developing the infrastructure of a compiler to enable efficient execution of large-scale ML...


  • Cupertino, California, United States Annapurna Labs Full time

    About the RoleWe are seeking a highly skilled Software Development Manager to lead our Machine Learning Acceleration team. As a key member of our organization, you will be responsible for designing and deploying ML applications and use cases on various frameworks such as PyTorch, JAX, and TensorFlow.As the Software Development Manager for the ML Applications...


  • Cupertino, California, United States Amazon Full time

    Job DescriptionThe AWS Neuron Compiler team is seeking a skilled compiler engineer to develop a state-of-the-art deep learning compiler stack.This stack optimizes application models across diverse domains, including Large Language and Vision, originating from leading frameworks like PyTorch, TensorFlow, and JAX.The successful candidate will work closely with...


  • Cupertino, California, United States Apple Full time

    Job DescriptionApple is seeking an exceptional software engineering manager to lead the Secure Enclave team for our operating systems.This team is responsible for the development, evolution, and security of our kernel and low-level user space libraries that contribute to the success of our product lines.As a software engineering manager, you will lead a team...


  • Cupertino, California, United States Amazon Full time

    About the Role:The AWS Neuron team is seeking a highly skilled Senior Machine Learning Compiler Engineer to join our team. As a key member of our team, you will be responsible for designing and developing a compiler to handle the world's largest ML workloads. You will work closely with our ML services teams to ensure that our compiler meets the needs of our...


  • Cupertino, California, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Senior Machine Learning Compiler Engineer III to join our Neuron Compiler team at Amazon. As a key member of this team, you will play a critical role in developing and scaling a compiler to enable the world's largest ML workloads to run performantly on custom Annapurna systems.Key ResponsibilitiesSolve complex...


  • Cupertino, California, United States Amazon Full time

    About the RoleAnnapurna Labs, a part of Amazon, is seeking a talented Software Development Engineer to join our Neuron Compiler team. As a key member of our team, you will be responsible for designing and implementing innovative software solutions to transform service performance, durability, cost, and security.Key ResponsibilitiesSolve challenging technical...


  • Cupertino, California, United States Annapurna Labs (U.S.) Inc. Full time

    About the RoleAs a Software Development Manager for Machine Learning Acceleration, you will be responsible for leading a team of engineers to design and deploy machine learning applications and use cases on various frameworks such as PyTorch, JAX, and TensorFlow. You will be responsible for the full development life cycle of our integrations and extensions...


  • Cupertino, California, United States Amazon Full time

    Job SummaryWe are seeking a highly skilled Senior Compiler Engineer to join our team at Amazon. As a key member of our Neuron Compiler team, you will be responsible for developing and maintaining cutting-edge compiler technology.Key ResponsibilitiesDevelop and maintain tooling for best-in-class technology for raising the bar of the Neuron Compiler's accuracy...

Lead Software Engineer, Neuron Runtime

2 months ago


Cupertino, California, United States Amazon Full time

About AWS AI
At AWS AI, our mission is to empower developers by making deep learning accessible and integrating cutting-edge infrastructure into their workflows.

Our Innovations
We have developed pioneering software and hardware solutions to fulfill this mission. AWS Neuron is a software development kit (SDK) designed to enhance the performance of intricate neural network models on AWS Inferentia, our custom-built chip aimed at accelerating deep learning tasks.

Neuron SDK Components
The Neuron SDK includes a compiler, runtime, and debugger, seamlessly integrated with popular frameworks such as TensorFlow, PyTorch, and MXNet. It is readily available in AWS Deep Learning AMIs and Deep Learning Containers, allowing customers to efficiently initiate high-performance and cost-effective inference.

Join Our Team
The Neuron team is seeking experienced Runtime Software Development Engineers with expertise in machine learning and AI accelerators to tackle our clients' most challenging issues.

Your Role
As a Runtime Software Development Engineer, you will possess experience with high-performance Linux drivers and high-performance computing (HPC) technologies, including libfabric and MPI. You will be responsible for delivering products with exceptional operational excellence.

This role is dynamic and intellectually stimulating, providing opportunities to collaborate with leaders across various technology domains. You will maintain high standards for yourself and your colleagues, continuously seeking ways to enhance product performance, quality, and cost-effectiveness.

Team Culture
We value an inclusive team culture at AWS. We are dedicated to promoting diversity and have numerous employee-led affinity groups that connect thousands of employees globally. Our innovative benefits and ongoing learning initiatives, such as our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, reinforce our commitment to inclusion.

Work-Life Balance
We prioritize work-life balance, emphasizing the importance of establishing a flow that energizes both personal and professional aspects of life. We offer flexible working hours and encourage you to find your own equilibrium.

Mentorship and Growth
Our team is committed to supporting new members through mentorship and knowledge sharing. We have a diverse mix of experience levels and are building an environment that fosters growth. Senior team members provide one-on-one mentoring, and we focus on aligning projects with individual career development goals.

Basic Qualifications
- 5+ years of professional software development experience
- 5+ years of programming experience in at least one programming language
- 5+ years of experience in leading design or architecture of systems
- 5+ years of experience throughout the full software development lifecycle
- Experience mentoring or leading an engineering team

Preferred Qualifications
- Bachelor's degree in computer science or a related field

Amazon is committed to fostering a diverse and inclusive workplace. We are an equal opportunity employer and do not discriminate based on race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.

For individuals with disabilities who would like to request an accommodation, please visit our website for more information.

Compensation
Our compensation reflects the labor market across various US regions. The base pay for this position varies based on geographic location and job-related knowledge, skills, and experience.

Amazon offers a comprehensive compensation package, which may include equity, sign-on bonuses, and a full range of medical, financial, and other benefits.