SDM, ML Acceleration, Neuron Frameworks

4 weeks ago


Cupertino, United States Annapurna Labs Full time

Utility Computing (UC)
AWS Utility Computing (UC) provides product innovations - from foundational services such as Amazon's Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll support the development and management of Compute, Database, Storage, Internet of Things (Iot), Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for customers who require specialized security solutions for their cloud services.

AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine
learning accelerators and the Trn1 and Inf1 servers that use them.

As the Software Development Manager for the ML Applications - Framework team, you will be responsible for leading a strong team of engineers to help design and deploy ML applications/usecases on various frameworks such as Pytorch, JAX, Tensorflow. You will be responsible for the full development life cycle of our integrations and extensions for inference and training support in Pytorch, XLA, Tensorflow and JAX. Develop reliability/scalability features and performance updates in the Neuron ML Frameworks as well as contribute to other popular open Frameworks to enable them make Trainium and Inferentia devices as the first-class citizens for ML Acceleration. Lead the way to ensure support for key ML functionality in a combined chip / software platform. Ensure the right thing is being built and delivered to customers

A successful candidate will have an established background in developing ML frameworks using Pytorch on XLA devices and corresponding framework technology components such as Torch-XLA, Open-XLA project integrations using PJRT or StableHLO, familarity of OpenXLA compilers. The ideal candidate should have a strong technical ability to work/deliver on a vertically integrated system stack that consists of a combinatorial matrix of hardware, frameworks, and workflows. Deep expertise in Framework integrations and development using C++ is a must along-with direct customer-facing experience and a strong motivation to achieve results.

A day in the life
You will work with the executive leadership and other senior management and technical leaders to define product directions and deliver them to customers. We build massive-scale distributed training and inference solutions. This organization builds the full stack of software, servers and chips to accelerate at the highest scale.

About the team
About AWS
Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating - that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.

Diverse Experiences
AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying.

Work/Life Balance
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud.

Inclusive Team Culture
Here at AWS, it's in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.

Mentorship & Career Growth
We're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.

BASIC QUALIFICATIONS- 3+ years of engineering team management experience
- 7+ years of working directly within engineering teams experience
- 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
- Experience partnering with product or program management teams
PREFERRED QUALIFICATIONS- 2 years experience leading teams that in Machine Learning development including building and training large models, working with Pytroch and/or Tensorflow using large distributed fleets of GPU or other accelerated systems.

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit .

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company's reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $166,400/year in our lowest geographic market up to $287,700/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit . This position will remain posted until filled. Applicants should apply via our internal or external career site.

  • cupertino, United States Annapurna Labs (U.S.) Inc. Full time

    Utility Computing (UC)AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon’s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS’s services and features apart in the industry. As a member of the UC organization,...


  • Cupertino, United States Annapurna Labs (U.S.) Inc. Full time

    Utility Computing (UC)AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon’s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS’s services and features apart in the industry. As a member of the UC organization,...


  • Cupertino, United States Amazon Full time

    Annapurna ML pathfinding team is a new function within the Annapurna ML go-to-market org that help customers accelerate their adoption of Annapurna ML products including AWS Trainium and AWS Inferentia. The team offers hands-on data science and coding services to our most strategic customer opportunities to launch their training and inference workloads on...

  • Machine Learning

    1 week ago


    Cupertino, United States Amazon Full time

    The Product: AWS Machine Learning accelerators are at the forefront of AWS innovation and one of several AWS tools used for building Generative AI on AWS. The Inferentia chip delivers best-in-class ML inference performance at the lowest cost in cloud. Trainium will deliver the best-in-class ML training performance with the most teraflops (TFLOPS) of compute...


  • Cupertino, United States Apple Full time

    AIML - Staff Machine Learning Engineer - ML Efficiency, ML Platform & Technology Cupertino, California, United States Machine Learning and AI Do you want to shape the platform that enables the next generation of intelligent experiences on Apple products & services? In Apple’s Machine Learning Platform Technology & Infra team we have built the platform that...


  • Cupertino, United States Apple Inc. Full time

    AIML - Staff Machine Learning Engineer - ML Efficiency, ML Platform & TechnologyDo you want to shape the platform that enables the next generation of intelligent experiences on Apple products & services? In Apple’s Machine Learning Platform Technology & Infra team we have built the platform that Apple uses for developing machine learning, artificial...

  • Software Engineer

    1 day ago


    Cupertino, United States Amazon Full time

    Job ID: 2803487 | Amazon Development Center U.S., Inc.AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon’s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS’s services and features apart in the industry. As a...


  • Cupertino, United States Apple Inc. Full time

    AIML - Machine Learning Engineer, Machine Learning Platform & Infrastructure The AIML - On-Device Machine Learning group is responsible for the creation of amazing on-device ML experiences. The team builds foundational machine learning frameworks and tools to optimize large language/vision/multi-modal models that power on-device ML features across Apple...


  • Cupertino, California, United States Gridmatic Full time

    Company OverviewGridmatic Inc. is a high-growth startup with offices in the Bay Area and Houston that accelerates the clean energy transition by applying expertise in data, machine learning, and energy to power markets.We are a rare startup that has multiple years of profitability without raising venture capital. Our culture values teamwork, continuous...


  • Cupertino, United States Apple Inc. Full time

    AIML - Sr Machine Learning Engineer, Data and ML Innovation As part of Apple's AI and Machine Learning org, we encourage and create groundbreaking technology for large-scale ML systems, computer vision, natural language processing, and multi-modal understanding. The Data and Machine Learning Innovation (DMLI) team is looking for a passionate Machine...


  • Cupertino, California, United States Amazon Development Center U.S., Inc. Full time

    About the RoleWe are seeking a skilled Software Engineer II - ML Tools to join our team at Amazon Development Center U.S., Inc. This individual will lead the design and implementation of a new toolset for machine learning workloads and work closely with developers, system architects, hardware engineers, and users within and external to Amazon.Key...


  • Cupertino, United States Apple Inc. Full time

    AIML - Software Development Automation Engineering Lead, ML Systems Evaluation EngineeringDoes the opportunity to play a part in building groundbreaking technology for large-scale systems, natural language and artificial intelligence excite you? Do you want to expand the experience of Siri and other AIML products to new products that will help millions get...


  • Cupertino, California, United States Amazon Development Center U.S., Inc. Full time

    About the RoleWe are seeking a highly skilled Software Engineer II to lead the development of machine learning tools for our ML Accelerators. As a key member of our team, you will design and implement new toolsets, collaborate with developers, system architects, and hardware engineers to ensure compatibility with existing and next-generation AI...


  • Cupertino, United States Apple Inc. Full time

    AIML - ML Engineer, Machine Learning Platform & Infra Machine Learning and AI To view your favorites, sign in with your Apple ID. Do you feel you think differently, you are eager to break status quo, are bold and ambitious, aren’t afraid to take risks and are passionate to build the best of class technology. If yes, what better place to be at and do...


  • Cupertino, United States Apple Full time

    AIML - Sr Machine Learning Engineer, Data and ML Innovation Cupertino, California, United States Machine Learning and AI Do you want to play a part in the next revolution in large language models, contribute to products that are redefining mobile and desktop computing, and work with the people who built the intelligent assistant and search products that help...


  • Cupertino, California, United States Gridmatic Full time

    About GridmaticGridmatic Inc. is a high-growth startup with offices in the Bay Area and Houston that is accelerating the clean energy transition by applying our expertise in data, machine learning, and energy to power markets. We are the rare startup that has multiple years of profitability without raising venture capital. Our culture values teamwork,...


  • Cupertino, United States Apple Inc. Full time

    Apple Maps is one of the world's largest mapping platforms, serving billions of requests each week. The platform supports not only the Maps app on the iPhone, iPad, Apple Watch, CarPlay, and Mac, but also many third-party apps used by millions of customers around the world. We are looking for a dynamic, highly motivated individual to join the Maps...


  • Cupertino, United States Apple Full time

    SummaryWe are seeking a highly skilled and experienced software engineer to join our team at Apple AIML in building an on-device machine learning and observability platform. As a key member of the team, you will help design and develop the infrastructure and work on various machine learning solutions and models. You will also have the chance to collaborate...


  • Cupertino, United States Apple Inc. Full time

    Applied Machine Learning Engineer - Localization The Software Localization team powers the tooling, features and processes used to create an exceptional localized experience for Apple’s international customers. We are responsible for the Localization workflows in Xcode, framework-level Localization support, localized OS features, and internal Localization...


  • Cupertino, United States Apple Inc. Full time

    Applied Machine Learning Engineer - Localization The Software Localization team powers the tooling, features and processes used to create an exceptional localized experience for Apple’s international customers. We are responsible for the Localization workflows in Xcode, framework-level Localization support, localized OS features, and internal Localization...