ML Compiler Engineer II

3 weeks ago


Renton WA, United States Amazon Development Center U.S., Inc. Full time
The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state-of-the-art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language and Vision, originating from leading frameworks such as PyTorch, TensorFlow, and JAX. Your role will involve working closely with our custom-built Machine Learning accelerators, including Inferentia/Trainium, which represent the forefront of AWS innovation for advanced ML capabilities, powering solutions like Generative AI.

Key job responsibilities

As a Sr. ML Compiler Engineer III on the Neuron Compiler Automated Reasoning Group, you will develop and maintain tooling for best-in-class technology for raising the bar of the Neuron Compiler's accuracy and reliability. You will help lead the efforts building fuzzers and specification synthesis tooling for our LLVM-based compiler. You will work in a team with a science focus, and strive to push what we do to the edge of what is known, to best deliver our customers.

Strong software development skills using C++/Python are critical to this role.

A science background in compiler development is strongly preferred. A background in Machine Learning and AI accelerators is preferred, but not required.

In order to be considered for this role, candidates must be currently located or willing to relocate to Seattle (Preferred), Cupertino, Austin, or Toronto.
BASIC QUALIFICATIONS - 3+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- 2+ years of experience in developing compiler features and optimizations
- Proficiency in C++ and Python programming, applied to compiler or verification projects
- Familiarity with LLVM, including knowledge of abstract interpretation and polyhedral domains
- Demonstrated scientific approach to software engineering problems
PREFERRED QUALIFICATIONS - Masters degree or PhD in computer science or equivalent
- Experience with deep learning frameworks like TensorFlow or PyTorch
- Understanding of large language model (LLM) training processes
- Knowledge of CUDA programming for GPU acceleration

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $129,300/year in our lowest geographic market up to $223,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.

  • Federal Way, WA, United States Amazon Development Center U.S., Inc. Full time

    The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state-of-the-art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language and Vision, originating from leading frameworks such as PyTorch, TensorFlow, and JAX. Your role...


  • Tacoma, WA, United States Amazon.com Services LLC - A57 Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the Trn1 and Inf1 servers that use them. This role is for a senior software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. This role is responsible for development, enablement and performance tuning of a...


  • Tacoma, WA, United States Annapurna Labs (U.S.) Inc. Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the Trn1 and Inf1 servers that use them. This role is for a senior software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. This role is responsible for development, enablement and performance tuning of a...


  • Woodinville, WA, United States Amazon.com Services LLC - A57 Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machinelearning accelerators and the Trn1 and Inf1 servers that use them. This role is for a senior software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. This role is responsible for development, enablement and performance tuning of a...


  • Kent, WA, United States Annapurna Labs (U.S.) Inc. Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machinelearning accelerators and the Trn1 and Inf1 servers that use them. This role is for a senior software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. This role is responsible for development, enablement and performance tuning of a...

  • Engineer I

    3 weeks ago


    Renton, WA, United States Amazon Development Center U.S., Inc. Full time

    The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state-of-the-art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language and Vision, originating from leading frameworks such as PyTorch, TensorFlow, and JAX. You will...


  • Bothell, WA, United States Amazon Development Center U.S., Inc. Full time

    The AWS Neuron Compiler team is seeking an experienced and motivated Sr TPM to lead and increase efficiency and predictability of our LLM model enablement program. This is a unique opportunity for someone who is passionate about machine learning, compilers, chip design, and software development. Your mission is to enable software developers and leaders...


  • Bothell, WA, United States Amazon Development Center U.S., Inc. Full time

    This is a unique opportunity for someone who is passionate about machine learning, compilers, chip design, and software development. Your mission is to enable software developers and leaders developing machine learning models on Inferentia and Trainium chips to more efficiently plan, develop, and deploy advanced machine learning models. You will work...


  • Snoqualmie, WA, United States Amazon Development Center U.S., Inc. Full time

    The AWS Neuron Compiler team is seeking an experienced and motivated Sr TPM to lead and increase efficiency and predictability of our LLM model enablement program. This is a unique opportunity for someone who is passionate about machine learning, compilers, chip design, and software development.Your mission is to enable software developers and leaders...


  • Sammamish, WA, United States Amazon Development Center U.S., Inc. Full time

    The Automated Reasoning Group in the AWS Neuron Compiler team is looking for an Applied Scientist to work on the intersection of Artificial Intelligence and program analysis to raise the code quality bar in our state-of-the-art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language...

  • AI/ML Services

    2 weeks ago


    Seattle, WA, United States GSK Full time

    Site Name: Seattle Sixth Ave, San FranciscoPosted Date: Aug At GSK, we see a world in which advanced applications of Machine Learning and AI will allow us to develop transformational medicines using the power of genetics, functional genomics, and machine learning. AI will also play a role in diagnosing and using medicines to enable everyone to do more, feel...

  • Principal AI Engineer

    2 months ago


    Renton, Washington, United States Hasbro, Inc. Full time

    Principal AI EngineerHasbro - United States$155,680 a yearAt Wizards of the Coast, we connect people around the world through play and imagination. From our genre-defining games like Magic: The Gathering and Dungeons & Dragons to our growing multiverse, we continue to innovate and build new ways to foster friendship and connection. That's where you come inWe...


  • Tacoma, WA, United States Amazon.com Services LLC - A57 Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine This role is for a senior software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. This role is responsible for development, enablement and performance tuning of a wide variety of ML model families, including massive scale large...


  • Seattle, WA, United States Amazon Development Center U.S., Inc. Full time

    The Automated Reasoning Group in the AWS Neuron Compiler team is looking for an Applied Scientist to work on the intersection of Artificial Intelligence and program analysis to raise the code quality bar in our state-of-the-art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language...


  • Tacoma, WA, United States Annapurna Labs (U.S.) Inc. Full time

    AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine This role is for a senior software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. This role is responsible for development, enablement and performance tuning of a wide variety of ML model families, including massive scale large...

  • Research Scientist

    3 weeks ago


    Sammamish, WA, United States Amazon Development Center U.S., Inc. Full time

    The Automated Reasoning Group in the AWS Neuron Compiler team is looking for an Applied Scientist to work on the intersection of Artificial Intelligence and program analysis to raise the code quality bar in our state-of-the-art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language...


  • Renton, Washington, United States All Star Directories Full time

    All Star Directories is seeking a Business Intelligence Analyst II. The ideal candidate will be responsible for generating financial and market insights through comprehensive data analysis, developing methodologies to identify data patterns and trends, and delivering timely reports to leadership based on analytical findings.Key Responsibilities:Analyze data...

  • Software Engineer II

    2 weeks ago


    Seattle, WA, United States Virtuoso, Ltd. Full time

    Virtuoso is the leading global travel agency network specializing in luxury and experiential travel. This by-invitation-only organization comprises over 1,200 travel agency locations with more than 20,000 travel advisors in 54 countries throughout North America, Latin America, the Caribbean, Europe, Asia-Pacific, Africa and the Middle East. Drawing upon its...


  • Seattle, WA, United States Virtuoso, Ltd. Full time

    Virtuoso® is the leading global travel agency network specializing in luxury and experiential travel. This by-invitation-only organization comprises over 1,200 travel agency locations with more than 20,000 travel advisors in 54 countries throughout North America, Latin America, the Caribbean, Europe, Asia-Pacific, Africa and the Middle East. Drawing upon...

  • Mobile Technician II

    2 months ago


    Renton, United States Penske Logistics Full time

    Mobile Technician II 2410 Railway Ave., Everett, WA 98201Exciting New Road Tech Program!Position Summary: Penske Mobile Technician II will generally assist in the repair and diagnosis of major components or remove/replace major components at the direction of the PFM Asset Supervisor. Expectations include the ability to perform preventive maintenance (PM)...