Sr. Software Dev Engineer, Stores Foundational AI

4 weeks ago

Palo Alto, California, United States Amazon Full time

Amazon is the 4th most popular site in the US ( ). Our product search engine is one of the most heavily used services in the world, indexes billions of products, and serves hundreds of millions of customers world-wide. We are working on a new AI-first initiative to re-architect and reinvent the way we do LLM through the use of extremely large scale, next-generation deep learning techniques. Our goal is to make step function improvements in the use of advanced Machine Learning (ML) on an immense scale datasets; specifically through the use of aggressive systems engineering and hardware accelerators. This is a rare opportunity to develop cutting-edge ML solutions, and have the opportunity to apply them to a problem of this magnitude. Some exciting questions that we expect to answer over the next few years include:

  • Can we transfer the knowledge we learned from Amazon data to all Amazon business applications?
  • How to accelerate model training and inference at super large scale?
  • How to build the world-class large scale ML training capability specially for deep learning models?

This is a unique opportunity to get in on the ground floor, shape and build the next-generation of Stores Foundational AI. We are looking for dedicated and forward-thinking machine learning engineers who are passionate about innovation, impact, and want to work on a team with an exciting startup culture

Key job responsibilities

  • Understand different business problems at Amazon such as Search, Ads, Recommendation, etc. Build machine learning models to push the boundary of Amazon business.
  • Build the world class distributed training ML techniques.
  • Identify deep learning model training and inference bottleneck and use innovative solution to solve them.

We are open to hiring candidates to work out of one of the following locations:

Palo Alto, CA, USA

Basic Qualifications

  • 5+ years of non-internship professional software development experience
  • 5+ years of programming with at least one software programming language experience
  • 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • Experience as a mentor, tech lead or leading an engineering team
  • Experience in large scale deep learning training, such as distributed training frameworks, efficiency optimization.

Preferred Qualifications

  • Master's degree in computer science or equivalent
  • Expertise in distributed training and training optimization.
  • Deep knowledge in ML training libraries such as PyTorch, and SOTA ML libraries such as NeMo.

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $134,500/year in our lowest geographic market up to $261,500/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.


  • Software Dev Engineer II, Stores Foundational AI

    4 weeks ago

    Palo Alto, California, United States Amazon Full time

    Stores Foundational AI (SFAI) is the team powering the Amazon Rufus conversational shopping product. We're working to improve shopping on Amazon using the conversational capabilities of large language models, and are searching for pioneers who are passionate about technology, innovation, and customer experience, and are ready to make a lasting impact on the...

  • Software Dev Engineer II, Stores Foundational AI

    1 month ago

    Palo Alto, California, United States Amazon Full time

    Stores Foundational AI (SFAI) is the team powering the Amazon Rufus conversational shopping product. We're working to improve shopping on Amazon using the conversational capabilities of large language models, and are searching for pioneers who are passionate about technology, innovation, and customer experience, and are ready to make a lasting impact on the...

  • Software Dev Engineer III, Stores Foundational AI

    4 weeks ago

    Palo Alto, California, United States Amazon Full time

    We're building a foundational LLM for Amazon Stores that fuses general world knowledge with Amazon e-commerce domain knowledge to provide new and improved shopping experiences for our customers. We are searching for pioneers who are passionate about technology, innovation, and customer experience, and are ready to make a lasting impact on the industry....

  • Software Dev Engineer II, Stores Foundational AI

    4 weeks ago

    Palo Alto, California, United States Amazon Full time

    We're working to improve shopping on Amazon using the conversational capabilities of large language models (LLM), and are searching for pioneers who are passionate about technology, innovation, and customer experience, and are ready to make a lasting impact on the industry. You'll be working with talented scientists, engineers, and technical program managers...

  • Software Dev Engineer II, Stores Foundational AI

    4 weeks ago

    Palo Alto, California, United States Amazon Full time

    We're working to improve shopping on Amazon using the conversational capabilities of large language models (LLM), and are searching for pioneers who are passionate about technology, innovation, and customer experience, and are ready to make a lasting impact on the industry. You'll be working with talented scientists, engineers, and technical program managers...

  • Software Dev Engineer II, Stores Foundational AI

    1 month ago

    Palo Alto, California, United States Amazon Full time

    We're working to improve shopping on Amazon using the conversational capabilities of large language models (LLM), and are searching for pioneers who are passionate about technology, innovation, and customer experience, and are ready to make a lasting impact on the industry. You'll be working with talented scientists, engineers, and technical program managers...

  • Software Development Manager, Stores Foundational AI

    1 month ago

    Palo Alto, California, United States Amazon Full time

    Stores Foundational AI (SFAI) is the team powering the Amazon Rufus conversational shopping product. We're working to improve shopping on Amazon using the conversational capabilities of large language models, and are searching for pioneers who are passionate about technology, innovation, and customer experience, and are ready to make a lasting impact on the...

  • Software Development Manager, Stores Foundational AI

    4 weeks ago

    Palo Alto, California, United States Amazon Full time

    Stores Foundational AI (SFAI) is the team powering the Amazon Rufus conversational shopping product. We're working to improve shopping on Amazon using the conversational capabilities of large language models, and are searching for pioneers who are passionate about technology, innovation, and customer experience, and are ready to make a lasting impact on the...

  • Software Dev Engineer,

    4 weeks ago

    Palo Alto, California, United States Amazon Full time

    Amazon is the 4th most popular site in the US ( ). Our product search engine is one of the most heavily used services in the world, indexes billions of products, and serves hundreds of millions of customers world-wide. We are working on a new AI-first initiative to re-architect and reinvent the way we do LLM through the use of extremely large scale,...

  • Software Development Engineer, Stores Foundational AI

    4 weeks ago

    Palo Alto, California, United States Amazon Full time

    We're building the foundational LLM for Amazon Stores that fuses general world knowledge with Amazon e-commerce domain knowledge. We are searching for pioneers who are passionate about technology, innovation, and customer experience, and are ready to make a lasting impact on the industry. You'll be working with talented scientists, engineers, and technical...

  • Software Development Engineer, Stores Foundational AI

    1 month ago

    Palo Alto, California, United States Amazon Full time

    We're building the foundational LLM for Amazon Stores that fuses general world knowledge with Amazon e-commerce domain knowledge. We are searching for pioneers who are passionate about technology, innovation, and customer experience, and are ready to make a lasting impact on the industry. You'll be working with talented scientists, engineers, and technical...

  • Postdoctoral Scientist, Stores Foundational AI

    1 month ago

    Palo Alto, California, United States Amazon Full time

    Amazon is looking for talented Postdoctoral Scientists to join our Stores Foundational AI team for a one-year, full-time research position.The Stores Foundational AI team builds foundation models for multiple Amazon entities, such as ASIN, customer, seller and brand. These foundation models are used in downstream applications by various partner teams in...

  • Postdoctoral Scientist, Stores Foundational AI

    4 weeks ago

    Palo Alto, California, United States Amazon Full time

    Amazon is looking for talented Postdoctoral Scientists to join our Stores Foundational AI team for a one-year, full-time research position.The Stores Foundational AI team builds foundation models for multiple Amazon entities, such as ASIN, customer, seller and brand. These foundation models are used in downstream applications by various partner teams in...

  • Senior Backend engineer

    2 weeks ago

    Palo Alto, California, United States Luma AI Full time

    Lumas mission is to build multimodal AI to expand human imagination and capabilities. We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for...

  • Head of Software and AI Platform

    4 weeks ago

    Palo Alto, California, United States Gauss Labs Full time

    As a head of Software and AI Platform at Gauss Labs, you will lead a strong team of software engineers. You will be responsible for leading the software development of multiple AI software products. Our platform is mission-critical and requires deep system and software expertise. You need to have the ability to work with ambiguous and difficult challenges in...

  • AI Product Engineer

    2 weeks ago

    Palo Alto, California, United States Multion Full time

    At MultiOn, we are looking for a few more A+ players who want to join a rocket ship startup.About Us:We believe in the power of Artificial Intelligence to revolutionize the way we interact with computers and the digital world. We're not just building a state-of-the-art personal AI Agent that brings the concept of JARVIS from science fiction into reality;...

  • Expert AI/ML Scientist

    1 month ago

    Palo Alto, California, United States SAP Full time

    We help the world run betterOur company culture is focused on helping our employees enable innovation by building breakthroughs together. How? We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and future-focused work. We offer a highly...

  • Expert AI/ML Scientist

    4 weeks ago

    Palo Alto, California, United States SAP Full time

    We help the world run betterOur company culture is focused on helping our employees enable innovation by building breakthroughs together. How? We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and future-focused work. We offer a highly...

  • Development Architect for Gen AI projects

    6 days ago

    Palo Alto, California, United States SAP Full time

    We help the world run betterOur company culture is focused on helping our employees enable innovation by building breakthroughs together. How? We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and future-focused work. We offer a highly...

  • Senior AI/ML Applied Scientist

    4 weeks ago

    Palo Alto, California, United States SAP Full time

    We help the world run betterOur company culture is focused on helping our employees enable innovation by building breakthroughs together. How? We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and future-focused work. We offer a highly...