Sr. System Development Engineer, High-Performance Accelerator Servers for AI/ML

24 hours ago


Seattle, Washington, United States Amazon Full time
Do you want to shape the future of Generative AI at AWS? Join the team building the foundation of the world's most advanced cloud for AI training and inference — where multi-billion-parameter models come to life at scale. Here, you'll design, deliver, and operate next-generation infrastructure that powers breakthrough innovation in AI/ML and HPC workloads. If you're passionate about pushing the limits of performance, efficiency, and scalability in the cloud, this is your opportunity to build the systems that define what's next for AWS — and for the entire AI industry.

You'll join a diverse AWS Hardware Engineering team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.

The ideal candidate for this role will be an innovative self-starter. You are knowledgeable of the full technical stack - vertically from baremetal server hardware up to the software in userland, and everything in the middle. You have tremendous interest in cloud scale and curious how systems and software decisions impact the user. You insist on highest-standards and are able to develop tactical solutions/tools to diagnose and fix issues. You are an excellent systems debugger - finding interaction issues between components on server systems. You are a leader with strong organizational, planning, and communication skills. You are a builder

Key job responsibilities
You will be a technical leader solving complex problems. You will decompose big difficult server system testability, reliability and diagnosis problems into straightforward tasks, components or features that you will lead to deliver yourself and through others in parallel. You will use combination of hardware, software, system designs, x86 architecture, processes, diagnosis and operations knowledge.

A day in the life
Working with a variety of job roles (SDEs, SDETs, Hardware Engineers, TPMs, Managers, Principals) and groups (AWS Hardware Engineering, EC2, other AWS services) through server conception, design, test, launch, and operations. Driving high quality and reliability into future/new designs for AWS Accelerated server solutions for AWS Cloud.

About the team
*Why AWS*
Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.

*Diverse Experiences*
Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying.

*Work/Life Balance*
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud.

*Inclusive Team Culture*
Here at AWS, it's in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.

*Mentorship and Career Growth*
We're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.

- 4+ years of non-internship professional software development experience
- 4+ years of deploying and operating in a Linux/Unix environment experience
- 4+ years of systems development in an IT or data center environment experience
- 3+ years of programming with at least one modern language such as C++, C#, Java, Python, Golang, PowerShell, Ruby experience
- 2+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
- 2+ years of systems design, software development, operations, automation, and process improvement experience
- Experience leading the design, build and deployment of complex and performant (reliable and scalable) software solutions in production

- 3+ years of development/programming/scripting language (Python/Java/Bash/Perl) experience
- Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
- Experience taking a leading role in building complex software or computing infrastructure that has been successfully delivered to customers
- Experience debugging, integrating, and validating complex AI/ML and Cloud Computing servers.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company's reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $136,100/year in our lowest geographic market up to $235,200/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.


  • Seattle, Washington, United States Scale AI Full time

    Scale's ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering MLEs, researchers, data scientists and operators for fast and automatic training and evaluation of LLM's, as well as evaluation of data quality.Scale is uniquely positioned at the heart of the field of AI...


  • Seattle, Washington, United States Amazon Full time

    Shape the Future of AI Accelerators at AWS NeuronJoin the elite team behind AWS Neuron—the software stack powering AWS's next-generation AI accelerators Inferentia and Trainium. As a Senior Software Engineer in our Machine Learning Applications team, you'll be at the forefront of deploying and optimizing some of the world's most sophisticated AI models at...


  • Seattle, Washington, United States Amazon Full time $151,300 - $261,500

    Shape the Future of AI Accelerators at AWS NeuronJoin the elite team behind AWS Neuron—the software stack powering AWS's next-generation AI accelerators Inferentia and Trainium. As a Senior Software Engineer in our Machine Learning Applications team, you'll be at the forefront of deploying and optimizing some of the world's most sophisticated AI models at...


  • Seattle, Washington, United States Amazon Full time $151,300 - $261,500

    AWS Utility Computing (UC) provides product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll support the development and management of Compute, Database, Storage, Platform, and Productivity Apps services in AWS, including support for customers who require specialized security...


  • Seattle, Washington, United States Apple Full time

    Do you want to help shape the future of AI at Apple? Our team, part of Apple Services Engineering's (ASE) Human Centered AI Research organization, pioneers new methods and tools for AI evaluation. We are seeking a Senior or Staff Platform Engineer to develop systems that will transform evaluation research and methods into compounding advantages for teams...


  • Seattle, Washington, United States Scale AI Full time $179,400 - $310,500

    As a Software Engineer on the ML Infrastructure team, you will design and build the next generation of foundational systems that power all ML Infrastructure compute at Scale - from model training and evaluation to large-scale inference and experimentation.Our platform is responsible for orchestrating workloads across heterogeneous compute environments (GPU,...

  • AI/ML Engineer

    1 day ago


    Seattle, Washington, United States Libero Capital Full time

    Libero Capital is a new, research-driven investment firm applying cutting-edge machine learning and AI to develop systematic trading strategies across global markets.We combine deep technical rigor with real-world impact—designing systems that learn from vast, complex market data and adapt in real time. Our team thrives on experimentation and innovation,...


  • Seattle, Washington, United States Amazon Full time

    AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on....


  • Seattle, Washington, United States Google Full time $197,000 - $291,000 per year

    Minimum qualifications:Bachelor's degree or equivalent practical experience.8 years of experience in software development.5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture.5 years of experience building and developing large-scale infrastructure, distributed systems or networks, or...


  • Seattle, Washington, United States ByteDance Full time

    ResponsibilitiesLeveraging substantial data and computing resources and through continued investment in these domains, we have developed a proprietary general-purpose model with multimodal capabilities. In the Chinese market, Doubao models power over 50 ByteDance apps and business lines, including Doubao, Coze, and Dreamina, and is available to external...