Sr. ML Compiler Engineer

3 weeks ago

Federal Way WA United States Amazon Development Center U.S., Inc. Full time
The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state-of-the-art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language and Vision, originating from leading frameworks such as PyTorch, TensorFlow, and JAX. Your role will involve working closely with our custom-built Machine Learning accelerators, including Inferentia/Trainium, which represent the forefront of AWS innovation for advanced ML capabilities, powering solutions like Generative AI.

Key job responsibilities

As a Sr. ML Compiler Engineer III on the Neuron Compiler Automated Reasoning Group, you will develop and maintain tooling for best-in-class technology for raising the bar of the Neuron Compiler's accuracy and reliability. You will help lead the efforts building fuzzers and specification synthesis tooling for our LLVM-based compiler. You will work in a team with a science focus, and strive to push what we do to the edge of what is known, to best deliver our customers.

Strong software development skills using C++/Python are critical to this role.

A science background in compiler development is strongly preferred. A background in Machine Learning and AI accelerators is preferred, but not required.

In order to be considered for this role, candidates must be currently located or willing to relocate to Seattle (Preferred), Cupertino, Austin, or Toronto.
BASIC QUALIFICATIONS - 6+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- 5+ years of experience in developing compiler features and optimizations
- Proficiency in C++ and Python programming, applied to compiler or verification projects
- Familiarity with LLVM, including knowledge of abstract interpretation and polyhedral domains
- Demonstrated scientific approach to software engineering problems
PREFERRED QUALIFICATIONS - Masters degree or PhD in computer science or equivalent
- Experience with deep learning frameworks like TensorFlow or PyTorch
- Understanding of large language model (LLM) training processes
- Knowledge of CUDA programming for GPU acceleration

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $151,300/year in our lowest geographic market up to $261,500/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.

  • ML Compiler Engineer II

    3 weeks ago

    Renton, WA, United States Amazon Development Center U.S., Inc. Full time

    The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state-of-the-art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language and Vision, originating from leading frameworks such as PyTorch, TensorFlow, and JAX. Your role...

  • Sr. TPM, Neuron Compiler

    4 weeks ago

    Snoqualmie, WA, United States Amazon Development Center U.S., Inc. Full time

    The AWS Neuron Compiler team is seeking an experienced and motivated Sr TPM to lead and increase efficiency and predictability of our LLM model enablement program. This is a unique opportunity for someone who is passionate about machine learning, compilers, chip design, and software development.Your mission is to enable software developers and leaders...

  • Sr. Software Engineer- AI/ML, AWS Neuron Apps

    3 weeks ago

    Woodinville, WA, United States Amazon.com Services LLC - A57 Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machinelearning accelerators and the Trn1 and Inf1 servers that use them. This role is for a senior software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. This role is responsible for development, enablement and performance tuning of a...

  • Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training

    3 weeks ago

    Kent, WA, United States Annapurna Labs (U.S.) Inc. Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machinelearning accelerators and the Trn1 and Inf1 servers that use them. This role is for a senior software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. This role is responsible for development, enablement and performance tuning of a...

  • Sr. TPM, Neuron Compiler

    3 weeks ago

    Bothell, WA, United States Amazon Development Center U.S., Inc. Full time

    The AWS Neuron Compiler team is seeking an experienced and motivated Sr TPM to lead and increase efficiency and predictability of our LLM model enablement program. This is a unique opportunity for someone who is passionate about machine learning, compilers, chip design, and software development. Your mission is to enable software developers and leaders...

  • Sr. ML Architect

    1 month ago

    Dearborn, MI, United States Ford Motor Company Full time

    Sr. ML Architect We are the movers of the world and the makers of the future. We get up every day, roll up our sleeves and build a better world together. At Ford, we're all a part of something bigger than ourselves. Are you ready to change the way the world moves? Ford Motor Credit Company is on its journey to modernize its legacy applications and platforms...

  • Sr. Software Engineer- AI/ML, AWS Neuron Apps

    3 weeks ago

    Tacoma, WA, United States Amazon.com Services LLC - A57 Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the Trn1 and Inf1 servers that use them. This role is for a senior software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. This role is responsible for development, enablement and performance tuning of a...

  • Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training

    3 weeks ago

    Tacoma, WA, United States Annapurna Labs (U.S.) Inc. Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the Trn1 and Inf1 servers that use them. This role is for a senior software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. This role is responsible for development, enablement and performance tuning of a...

  • Sr. TPM, Neuron Compiler

    3 weeks ago

    Bothell, WA, United States Amazon Development Center U.S., Inc. Full time

    This is a unique opportunity for someone who is passionate about machine learning, compilers, chip design, and software development. Your mission is to enable software developers and leaders developing machine learning models on Inferentia and Trainium chips to more efficiently plan, develop, and deploy advanced machine learning models. You will work...

  • Sr Software Development Engineer, Amazon Connect

    2 weeks ago

    Federal Way, WA, United States Amazon Development Center U.S., Inc. Full time

    Are you inspired to work with a team than launches products with direct and massive impact on Amazon’s customers? Are you excited to join one of the newest and most exciting AWS services? Amazon Connect is a highly disruptive cloud-based contact center that enables businesses to deliver engaging, dynamic, and personal customer service experiences. Amazon...

  • AI/ML Services

    2 weeks ago

    Seattle, WA, United States GSK Full time

    Site Name: Seattle Sixth Ave, San FranciscoPosted Date: Aug At GSK, we see a world in which advanced applications of Machine Learning and AI will allow us to develop transformational medicines using the power of genetics, functional genomics, and machine learning. AI will also play a role in diagnosing and using medicines to enable everyone to do more, feel...

  • Applied Scientist, Neuron ARG

    3 weeks ago

    Seattle, WA, United States Amazon Development Center U.S., Inc. Full time

    The Automated Reasoning Group in the AWS Neuron Compiler team is looking for an Applied Scientist to work on the intersection of Artificial Intelligence and program analysis to raise the code quality bar in our state-of-the-art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language...

  • Field Engineer, Heavy Civil Construction Specialist

    6 hours ago

    Federal Way, Washington, United States Kiewit Full time

    Job SummaryWe are seeking a highly skilled Field Engineer to join our team at Kiewit. As a Field Engineer, you will play a critical role in ensuring the successful execution of our heavy civil construction projects.Key ResponsibilitiesAssist in the interpretation of technical drawings and specifications for field crews and craft supervision.Perform quantity...

  • Field Engineer, Heavy Civil Construction Specialist

    3 days ago

    Federal Way, Washington, United States Kiewit Full time

    Job SummaryKiewit is seeking a highly skilled Field Engineer to join our team in a Heavy Civil Construction role. As a Field Engineer, you will play a critical role in ensuring the successful execution of construction projects.Key ResponsibilitiesAssist in the interpretation of drawings and specifications for field crews and craft supervision.Perform...

  • Sr. Performance Engineer

    2 days ago

    Saint Louis, MO, United States Cognizant Full time

    Cognizant Technology Solutions is looking for Sr. Performance Engineer to join in our team of IT professionals in a permanent role. If you meet our background requirements and skills and are looking for an opportunity with these skills and expertise, here is the ideal opportunity for you! About Cognizant’s QEA Practice: We are the largest Quality...

  • ADC Engineer II, AI/ML ADC

    3 weeks ago

    Westminster, CO, United States Amazon Development Center U.S., Inc. Full time

    The AI/ML Amazon Dedicated Cloud (ADC) team is at the forefront of delivering cutting-edge artificial intelligence and machine learning solutions to our customers in isolated, air-gapped cloud environments. We are dedicated to pushing the boundaries of what is possible in this rapidly evolving field, leveraging the power of cloud computing and the latest...

  • Senior AI/ML Engineer

    3 weeks ago

    Merrimack, NH, United States Fidelity Investments Full time

    Job Description:The RoleAs a Data Scientist in FFIO Advanced Analytics team you will be responsible to collaborate with business product leaders and teams to evaluate manual business processes which can be simplified or made efficient using AI and ML techniques and algorithms. You will identify use cases, explore various AI/ML modeling techniques, design and...

  • Lead Software Engineer/ML

    2 weeks ago

    Jersey City, NJ, United States JPMorgan Chase & Co Full time

    Job DescriptionJOB DESCRIPTIONBe an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.As a Lead Software Engineer- ML at JPMorgan Chase Corporate & Investment Bank,within the Trust & Safety , Payments Technology organization, you are an integral part of an agile team that works...

  • Sr Software Dev Engineer, AWS Billing

    2 weeks ago

    Federal Way, WA, United States Amazon Development Center U.S., Inc. Full time

    Amazon Web Services (AWS) is looking for talented software engineers who have a passion for Big Data and distributed systems at trillions of transactions scale to help build the next generation of AWS internal services. Our applications are responsible for processing 270 million events per second and 20 terabytes of data per hour. As a foundational system we...

  • Software Engineer

    2 days ago

    Federal Way, Washington, United States Amazon Development Center U.S., Inc. Full time

    About the RoleWe are seeking a highly skilled Software Engineer to join our team at Amazon Development Center U.S., Inc. as a Sr Software Dev Engineer, AWS Billing. As a key member of our team, you will be responsible for designing, developing, and deploying scalable and efficient software systems that meet the needs of our customers.Key...