Sr. Technical Program Manager, ML Networking Team, Annapurna Labs

1 week ago


Cupertino, California, United States Amazon Full time $133,900 - $231,400
We're seeking a Senior Engineering Technical Program Manager for the Annapurna ML networking teams. In this role you will be responsible for scoping and delivering large projects end-to-end. Responsibilities include collection of business and systems requirements from engineering leaders, driving project schedules from design to release, and managing the production launch. You will coordinate design/implementation efforts between ML networking teams operating in different countries to develop optimal solutions for new features, verticals, and markets. You will be expected to make appropriate tradeoffs to optimize time-to-market, clearly communicate goals, roles, responsibilities, and desired outcomes to, internal cross-functional and remote project teams. You will also periodically report status of projects under your responsibility to the company leadership.

The right candidate will possess a strong technical and program management background, will have demonstrated experience leading medium to large projects, and will have a well-rounded technical background in current machine learning technologies as well as products spanning multiple technical domains with focus on high performance networking. You must be able to thrive and succeed in an entrepreneurial environment and not be hindered by ambiguity or competing priorities.

Key job responsibilities
As a Senior TPM, you will anticipate bottlenecks, provide escalation management, anticipate and make trade-offs, and balance the business needs versus technical constraints. An ability to take large, complex projects and break them down into manageable pieces, develop functional specifications, then deliver them in a timely manner.

In this role you will:
· Coordinate execution of projects across multiple teams
· Provide technical direction with limited assistance
· Lead cross functional project meetings
· Lead milestone reviews
· Present project status to the executive team
· Manage project builds globally

You will work with Engineering leadership, Product Management, and Business Development to help define requirements and roadmaps, work with Engineering leadership to drive efficiencies in engineering development and ensure the right things are delivered to Customers at the right time. We work like a startup - moving fast and building new things.

About the team
Annapurna ML networking team is the team that delivers the software and firmware comprising EFA (Elastic Fabric Adapter) ML stack, and provides efficient, high performance interconnect for EC2 ML platforms powered by Trainium, Nvidia, and AMD accelerators.

Utility Computing (UC)
AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon's Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll support the development and management of Compute, Database, Storage, Internet of Things (Iot), Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for customers who require specialized security solutions for their cloud services.

Annapurna Labs (our organization within AWS UC) designs silicon and software that accelerates innovation. Customers choose us to create cloud solutions that solve challenges that were unimaginable a short time ago—even yesterday. Our custom chips, accelerators, and software stacks enable us to take on technical challenges that have never been seen before, and deliver results that help our customers change the world.

About AWS
Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.

Diverse Experiences
AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying.

Work/Life Balance
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud.

Inclusive Team Culture
Here at AWS, it's in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon conferences, inspire us to never stop embracing our uniqueness.

Mentorship & Career Growth
We're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.

Basic Qualifications:
- 5+ years of technical product or program management experience
- 3+ years of software development experience
- 5+ years of technical program management working directly with software engineering teams experience
- Experience managing programs across cross functional teams, building processes and coordinating release schedules

Preferred Qualifications:
- 5+ years of project management disciplines including scope, schedule, budget, quality, along with risk and critical path management experience
- Experience managing projects across cross functional teams, building sustainable processes and coordinating release schedules
- Experience defining KPI's/SLA's used to drive multi-million dollar businesses and reporting to senior leadership
- 5+ years of project management disciplines including scope, schedule, budget, quality, along with risk and critical path management experience
- 3+ years in Machine learning or network development

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company's reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $133,900/year in our lowest geographic market up to $231,400/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.
  • Sr. Product Manager

    1 week ago


    Cupertino, California, United States Annapurna Labs (U.S.) Inc. Full time

    DESCRIPTIONAWS Neuron is looking for an experienced Technical Product Manager to define and drive product strategy for the Neuron Kernel Interface (NKI), a compiler library enabling custom kernel development and optimization. You will be part of the AWS Neuron Product Management team, driving innovation in machine learning acceleration software. AWS Neuron...

  • C/C++ Hardware

    21 hours ago


    Cupertino, California, United States Annapurna Labs (U.S.) Inc. Full time

    DESCRIPTIONAnnapurna Labs stands at the forefront of hardware/software co-design, leading innovation not just within Amazon Web Services (AWS) but across the entire industry. We design and build every component of our hardware and software to create best-in-class machine learning products that accelerate customer workloads through industry leading hardware...


  • Cupertino, California, United States Amazon Web Services (AWS) Full time

    DescriptionWe are seeking an experienced engineer to work on distributed AI/ML systems. This role involves working on collective operations - the fundamental operations that enable AI to scale across multiple accelerators & servers. Most of our stack is C/C++ and relatively low level, so solid knowledge of Linux, kernels, and performant code is important....


  • Cupertino, California, United States Amazon Full time $129,300 - $223,600

    Annapurna Labs builds custom Machine Learning accelerators that are at the forefront of AWS innovation and one of several AWS tools used for building Generative AI on AWS. The Neuron Compiler Engineering team is searching for a Software Development Engineer to support the development infrastructure of a compiler to enable the world's largest ML workloads to...


  • Cupertino, California, United States Amazon Full time $129,300 - $223,600

    We are seeking an experienced engineer to work on distributed AI/ML systems. This role involves working on collective operations - the fundamental operations that enable AI to scale across multiple accelerators & servers. Most of our stack is C/C++ and relatively low level, so solid knowledge of Linux, kernels, and performant code is important. Experience...


  • Cupertino, California, United States Amazon Web Services Full time

    DESCRIPTIONWe are seeking an experienced engineer to work on distributed AI/ML systems. This role involves working on collective operations - the fundamental operations that enable AI to scale across multiple accelerators & servers. Most of our stack is C/C++ and relatively low level, so solid knowledge of Linux, kernels, and performant code is important....


  • Cupertino, California, United States Amazon Web Services (AWS) Full time

    DescriptionAWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon's Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll support the...


  • Cupertino, California, United States Amazon Full time $166,400 - $287,700

    AWS Trainium servers are complex supercomputers, with both hardware and software built entirely in-house from the ground-up. We're looking for someone to lead our SoC (System on a Chip) Hardware Abstraction Layer (HAL) team. You'll be responsible for directing the team both technically and managerially, getting into the details of both. You'll dig in to...

  • Senior GTM Specialist

    2 weeks ago


    Cupertino, California, United States Amazon Full time $133,200 - $220,200

    Senior Strategic Go to Market (GTM) Specialist, role on the Amazon Annapurna Labs ML team is responsible for driving growth with Trainium and Neuron partners, ISVs and customers, . This position focuses on understanding influential partners and solutions that will expand the scope and abilities of Trianium and develop strategies to on board them to AWS AI...


  • Cupertino, California, United States Haystack Full time

    Software Development Manager, LLM Inference Model Enablement, Neuron SDK | Cupertino, California | Remote-Friendly | $166,400 - $287,700We're working with Annapurna Labs (U.S.) Inc. on this exciting opportunity.This role offers a unique opportunity to lead a team of expert AI/ML engineers in optimizing and enabling state-of-the-art open-source and customer...