SoC Device Driver Engineer, Machine Learning Accelerators

1 week ago

Cupertino, California, United States Annapurna Labs (U.S.) Inc. Full time
Job Description

Custom silicon chips live at the heart of AWS Machine Learning servers, and our team builds the backend software to run these servers.

We're looking for someone to lead our system-on-chip (SoC) driver software team and help us deliver at scale, as we build the next generation of driver software.

As the lead for the SoC driver team, you will:

  • Build and manage a small, strong team of developers
  • Work with hardware designers to write drivers for newly developed hardware modules
  • Refactor and maintain existing codebases throughout the device lifecycle
  • Continuously test and deploy your software stack to multiple internal customers
  • Innovate on the tooling you provide to customers, making it easier for them to use and debug our SoCs


Annapurna Labs, our organization within AWS, designs and deploys some of the largest custom silicon in the world, with many subsystems that must all be managed, tested, and monitored.

The SoC drivers are a critical piece of the AWS management software stack that ensure the chip is functional, performant, and secure.


You will thrive in this role if you:

  • Enjoy building and managing small teams
  • Are familiar with modular driver architectures (such as the Linux or Windows driver stacks)
  • Are proficient in C++ and familiar with Python
  • Know how to build effective abstractions over lowlevel SoC details
  • Have strong opinions about software architecture, and are able to apply them effectively
  • Enjoy learning new technologies, building software at scale, moving fast, and working closely with colleagues as part of a small team within a large organization
Although we build and deploy machine learning chips, no machine learning background is needed for this role. Your team (and your software) won't be doing machine learning. Our driver stack lives at the lowest level of the backend AWS infrastructure responsible for managing our ML servers.

You and your team will develop drivers for components used by machine learning (example:
PCIe, HBM, etc.), but won't need to deeply understand ML yourselves.

This role can be based in either Cupertino, CA or Austin, TX. The team is split between the two sites, with no preference for one over the other.

This is a fast-paced role where you'll work with thought-leaders in multiple technology areas.

You'll have high standards for yourself and everyone you work with, and you'll be constantly looking for ways to improve your software, as well as our products' overall performance, quality, and cost.

We're changing an industry. We're searching for individuals who are ready for this challenge, who want to reach beyond what is possible today. Come join us and build the future of machine learning

We are open to hiring candidates to work out of one of the following locations:

Austin, TX, USA | Cupertino, CA, USA

BASIC QUALIFICATIONS- 6+ years of programming with at least one modern language such as C++, C#, Java, Python, Golang, PowerShell, Ruby experience

  • 6+ years of noninternship professional software development experience
  • 4+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
  • Experience leading the design, build and deployment of complex and performant (reliable and scalable) software solutions in production
  • C++ development experience
  • Experience developing lowlevel software for hardware (SoC, ASIC, GPU, CPU, etc.)
PREFERRED QUALIFICATIONS- Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations

  • Experience taking a leading role in building complex software or computing infrastructure that has been successfully delivered to customers
  • Experience managing a small team of developers, including, but not limited to: scheduling, prioritizing, recruiting, coaching
Amazon is committed to a diverse and inclusive workplace.

Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.

For individuals with disabilities who would like to request an accommodation, please visit

Our compensation reflects the cost of labor across several US geographic markets.

The base pay for this position ranges from $134,500/year in our lowest geographic market up to $261,500/year in our highest geographic market.

Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.

Amazon is a total compensation company.

Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits.

For more information, please visit This position will remain posted until filled. Applicants should apply via our internal or external career site.

  • SoC Integration Engineer

    1 week ago

    Cupertino, California, United States Apple Full time

    Apple Seeks SoC Integration Engineer in Santa Clara Valley, CaliforniaAre you passionate about solving complex challenges? Join Apple's Silicon Technologies group to contribute to the design and production of high-performance, energy-efficient processors and system-on-chip (SoC) solutions. Your role will be instrumental in ensuring Apple's products deliver...

  • SoC Integration Engineer

    1 week ago

    Cupertino, California, United States Apple Full time

    SummaryPosted: Apr 26, 2023Role Number:Do you love crafting sophisticated solutions to highly complex challenges? As part of our Silicon Technologies group, we would like you to help design and manufacture our next-generation, high-performance, power-efficient processor, system-on-chip (SoC). You'll ensure Apple products and services can seamlessly and...

  • SoC Memory Performance Engineer, Platform Architecture

    7 days ago

    Cupertino, California, United States Apple Full time

    SoC Memory Performance Engineer, Platform Architecture Cupertino,California,United States Hardware Imagine what you could do here At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish In this role, you will...

  • AIML - Machine Learning SW/HW Co-Design Engineer, Machine Learning Platform & Infrastructure

    7 days ago

    Cupertino, California, United States Apple Full time

    AIML - Machine Learning SW/HW Co-Design Engineer, Machine Learning Platform & InfrastructureSanta Clara Valley (Cupertino),California,United StatesMachine Learning and AIMachine Learning and Platforms (MLPT) team is in Apple's AIML Org. MLPT's On-device machine learning (ML) team builds the inference stack that runs all ML networks on Apple Silicon. In this...

  • SoC Silicon Reliability Engineer

    7 days ago

    Cupertino, California, United States Apple Full time

    Exciting Opportunity to Shape the Future of Technology at AppleRole Overview:Contribute to crafting and building advanced processor and system-on-chip (SoC) technology at AppleWork alongside a team dedicated to enabling customers to fully enjoy their Apple devicesEmbrace a culture of innovation and technological advancementResponsibilities:Lead SoC product,...

  • Senior Machine Learning Engineer

    7 days ago

    Cupertino, California, United States Apple Full time

    SummaryPosted: May 30, 2024Weekly Hours: 40Role Number: We're looking for industry-leading machine learning technologists to help shape the future of AI-driven system experiences across the Apple ecosystem. You'll be joining a small, dynamic team that will develop novel ML techniques and applications, build tools and infrastructure, rapidly iterate on...

  • Senior Machine Learning Engineer

    3 weeks ago

    Cupertino, California, United States Apple Full time

    SummaryPosted: May 30, 2024Weekly Hours: 40Role Number: We're looking for industry-leading machine learning technologists to help shape the future of AI-driven system experiences across the Apple ecosystem. You'll be joining a small, dynamic team that will develop novel ML techniques and applications, build tools and infrastructure, rapidly iterate on...

  • SoC DFT Engineer

    7 days ago

    Cupertino, California, United States Apple Full time

    Summary Posted: May 10, 2023 Role Number: Do you love crafting sophisticated solutions to highly sophisticated challenges? Do you intrinsically see the importance in every detail? As part of our Silicon Technologies group, you'll help design and manufacture our next-generation, high-performance, power-efficient processor, system-on-chip (SoC). You'll ensure...

  • Computer Vision and Machine Learning Engineer

    7 days ago

    Cupertino, California, United States Apple Inc. Full time

    Computer Vision and Machine Learning Engineer Imagine what you could do here. At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job and there is no telling what you can accomplish.The same passion for innovation that goes into our products also applies to...

  • AIML - Engineering Manager (Core ML), Machine Learning Platform & Infrastructure

    1 week ago

    Cupertino, California, United States Apple Full time

    Summary Posted: Jan 17, 2024 Weekly Hours: 40 Role Number: The on-device machine learning platform team in the machine learning platforms and technologies group is looking for an outstanding manager to join our group You will be leading engineers who develop frameworks and tools, passionate about the shipping great APIs to our developers. Our group plays a...

  • Camera Platform Engineer

    7 days ago

    Cupertino, California, United States Apple Inc. Full time

    Apple's ISP team is looking for an extraordinary embedded software engineer to drive groundbreaking technologies for Apple products As part of the team you would work on core camera and ISP technologies, including Apple crafted Image signal processing pipeline and HW components where you will have the chance to define the way that Apple develops, tests and...

  • Formal Verification Engineer

    7 days ago

    Cupertino, California, United States Apple Full time

    Formal Verification EngineerCupertino,California,United StatesHardwareDo you love creating elegant solutions to highly complex challenges? Do you intrinsically see the importance in every detail? As part of our Silicon Technologies group, you'll help design and manufacture our next-generation, high-performance, power-efficient processor, system-on-chip...

  • SOC Thermal Engineer

    3 weeks ago

    Cupertino, California, United States Apple Full time

    SummaryPosted: Oct 14, 2023Role Number: Do you love working on challenges that no one has yet solved? Do you like changing the game? Envision what you could do here. At Apple, we believe new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling...

  • Software Engineer

    7 days ago

    Cupertino, California, United States GN Group Full time

    The professional position of Software Engineer - AI Systems requires the beneficiary to have an in-depth knowledge of AI, video processing and computer vision machine learning algorithms.The ideal candidate has demonstrable knowledge in AI/Machine Learning workflow including model design, dataset creation, training and inferencing for real-time video...

  • AIML - Director of Engineering, Siri Device Ecosystem

    7 days ago

    Cupertino, California, United States Apple Full time

    Summary Posted: Jun 12, 2024 Role Number: As a trusted technical leader, you'll help guide the trajectory for the future, supporting management in crafting strategic roadmaps across all our Siri devices, prioritizing tasks aligned with objectives, and collaborating with leadership on decisions regarding scalable and sustainable architecture for pivotal...

  • Research Engineer, Natural Language Generation, Input Experience

    1 week ago

    Cupertino, California, United States Apple Full time

    Summary Posted: May 14, 2024 Weekly Hours: 40 Role Number: Text generation is a key enabler for accelerated text input and intelligent interaction on Apple platforms. Our team is working on redefining user interaction with generative models for text generation. If you want to be part of an ambitious, organized and collaborative team that ships user...

  • Systems Engineer

    7 days ago

    Cupertino, California, United States eTeam Full time

    Job Title: Software Engineer Key Qualifications:0-2 years as data scientist, data engineer or analyst. Battery Engineering experience desired. Working knowledge and experience with big data. Strong working knowledge of Python, Unix tools, Perl, Github and Tableau. Basic knowledge of SQL databases, TCP/IP commands, Minitab, JMP and in bash/Perl environment....

  • AIML - Sr Cross Device Engineer, Siri and Information Intelligence

    7 days ago

    Cupertino, California, United States Apple Inc. Full time

    AIML - Sr Cross Device Engineer, Siri and Information Intelligence Software and Services To view your favorites, sign in with your Apple ID. Create ground-breaking technology for next generation of voice assistant technology that will enable next revolution of human-computer interaction. Join the team that is redefining the possibilities of cross device...

  • ML Compute Infrastructure Engineer

    7 days ago

    Cupertino, California, United States WalkWater Technologies Full time

    REQ ID – ROLE – ML Compute Infrastructure EngineerLOCATION – Cupertino or Seattle (Hybrid)MAIN SKILLS – ML frameworks experience (pyTorch, JAX), Performance analysis and optimization experience in Cloud accelerators, Data analysis using SQLWe are seeking a highly motivated and experienced software engineers to join our team. The ideal candidate will...

  • Software Engineer- AI/ML, AWS Neuron Distributed Training

    7 days ago

    Cupertino, California, United States Amazon Full time

    Machine Learning Engineer - AWS NeuronAWS Neuron presents a rich software stack tailored for the AWS Inferentia and Trainium, innovative Machine Learning accelerators. As part of the Distribute Training team for AWS Neuron, you will be engaged in the development, empowerment, and enhancement of various ML model families, including extensive Large Language...