Senior GPU Performance Engineer

3 weeks ago


San Mateo, United States Zoox Full time

Zoox is building the world's most advanced self-driving hardware and software solution. The efficiency demands of such a system require an expert fine-tuning of both the compute hardware architecture as well as the algorithms and middleware that runs on it to achieve maximum throughput at the most optimal power levels.

The Software Core Performance team's mission is to analyze, optimize, and provide guidance to the software and hardware teams to meet the required specifications.

As a GPU performance software engineer within the Software Core Performance team, you will instrument, monitor, analyze, and optimize GPU-based algorithms that are performance-critical for our solution. The scope for GPU usage ranges from traditional computer vision and deep learning architectures to complex geometric reasoning and multi-agent decision-making.

Responsibilities

    • Build real-time instrumentation for performance monitoring (CPU, GPU, latency, memory) of the system at hand and offline benchmarking frameworks to support performance evaluation.
    • Build tools and scripts to evaluate & analyze performance at scale in CI as well as in the vehicle.
    • Establish budgets for existing architectures, and provide data to define next-gen architectures.
    • Analyze performance metrics to identify GPU hotspots and root causes, and propose and co-implement actionable solutions with component teams.
    • Support teams in bringing serial algorithms to the GPU to maximize compute utilization and improve overall latency.
    • Work as part of the Core team to build a middleware framework that promotes by default efficient and performant code development by maximizing CPU and GPU.
Qualifications
    • BS in computer science or related field
    • Strong knowledge of C++ and experience in large code bases
    • Strong knowledge of CUDA as applied to recent GPU microarchitectures (e.g., Turing, Ampere)
    • Experiencing debugging and optimizing GPU kernels using tools like Nsight Systems and Compute
    • Proficiency in statistical analysis and forecast modeling
    • Experience with SQL, DataBricks, Looker, or other business intelligence tools
    • Comfortable in Linux development environments
Bonus Qualifications
    • GPU kernel development experience in a firm/hard real-time environment
    • Experience in the development, debugging, and profiling of complex multiprocess systems (e.g. game engines, robotic systems)
    • Experience with PTX-level programming
    • Experience with CPU SIMD instructions (e.g., AVX intrinsics)
    • Experience with TensortRT and custom CUDA layers


Compensation

There are three major components to compensation for this position: salary, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights. The salary range for this position is $211,000 to $300,000. A sign-on bonus may be offered as part of the compensation package. Compensation will vary based on geographic location and level. Leveling, as well as positioning within a level, is determined by a range of factors, including, but not limited to, a candidate's relevant years of experience, domain knowledge, and interview performance. The salary range listed in this posting is representative of the range of levels Zoox is considering for this position.

Zoox also offers a comprehensive package of benefits including paid time off (e.g. sick leave, vacation, bereavement), unpaid time off, Zoox Stock Appreciation Rights, Amazon RSUs, health insurance, long-term care insurance, long-term and short-term disability insurance, and life insurance.

About Zoox

Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We're looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.

Follow us on LinkedIn

Accommodations

If you need an accommodation to participate in the application or interview process please reach out to accommodations@zoox.com or your assigned recruiter.

A Final Note:

You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.
  • Junior GPU Engineer

    19 hours ago


    San Jose, United States Ampstek Full time

    Junior GPU EngineerLocation: San Jose, CA (Onsite)Min exp : 7+ YearsJob Description.We are seeking a highly motivated and skilled GPU Resource Specialist to join our team. The ideal candidate will have a strong understanding of graphics processing units (GPUs), their architecture, and their applications across various industries. The Junior GPU Resource...

  • Junior GPU Engineer

    3 days ago


    San Jose, United States Ampstek Full time

    Junior GPU EngineerLocation: San Jose, CA (Onsite)Min exp : 7+ YearsJob Description.We are seeking a highly motivated and skilled GPU Resource Specialist to join our team. The ideal candidate will have a strong understanding of graphics processing units (GPUs), their architecture, and their applications across various industries. The Junior GPU Resource...

  • Junior GPU Engineer

    2 days ago


    San Jose, United States Ampstek Full time

    Junior GPU Engineer Location: San Jose, CA (Onsite) Min exp : 7+ Years Job Description. We are seeking a highly motivated and skilled GPU Resource Specialist to join our team. The ideal candidate will have a strong understanding of graphics processing units (GPUs), their architecture, and their applications across various industries. The Junior GPU Resource...

  • Junior GPU Engineer

    4 days ago


    San Jose, United States Ampstek Full time

    Junior GPU EngineerLocation: San Jose, CA (Onsite)Min exp : 7+ YearsJob Description.We are seeking a highly motivated and skilled GPU Resource Specialist to join our team. The ideal candidate will have a strong understanding of graphics processing units (GPUs), their architecture, and their applications across various industries. The Junior GPU Resource...


  • San Francisco, United States CHJ Recruiting Full time

    Job Overview Our client is seeking an enthusiastic senior hands-on Performance Profiling Engineer in the Bay Area. In this role, you will: Work with system architect and algorithm team to bring up the rapid prototyping and demo features of the next generation product. Build up profiling methodologies and deliver the performance/power dashboard with data...


  • San Jose, United States Bayone Full time

    - Local to market in San Jose - Hybrid onsite 3 days per week (No Remote candidate) - Knowledge of Block-level (unit level) - Degubbing and development - UVM, SystemVerilog exp - 8 to 10 years of hands-on related exp Vertical Technical Description As a GPU Design Verification Engineer, your talents will ensure the quality at the heart of our GPU...

  • GPU Kernel Engineer

    4 weeks ago


    San Francisco, United States CareerBuilder Full time

    Join us to build and safely deploy aligned, superhuman AI. We are building an AI pair programmer that feels like a full colleague inside your computer - capable, conversational, and reliable across domains. As a GPU Kernel Engineer, you will design efficient implementations of novel model architectures and optimize kernels to ensure high throughput and low...


  • San Francisco, United States CHJ Recruiting Full time

    Job Overview Our client is seeking an enthusiastic senior hands-on Performance Profiling Engineer in the Bay Area. In this role, you will: Work with system architect and algorithm team to bring up the rapid prototyping and demo features of the next generation product. Build up profiling methodologies and deliver the performance/power dashboard with data...

  • Performance Engineer

    3 weeks ago


    San Francisco, United States Anthropic Limited Full time

    Running machine learning (ML) algorithms at our scale often requires solving novel systems problems. As a Performance Engineer, you'll be responsible for identifying these problems, and then developing systems that optimize the throughput and robustness of our largest distributed systems. Strong candidates here will have a track record of solving large-scale...


  • San Jose, United States Mirafra Technologies Full time

    As a GPU Design Verification Engineer you will contribute to the functional verification of GPU Subsystems such as Shader, Texture, and Memory Systems. Responsibilities Triage regression failures and make testbench updates Debug functional errors in RTL model using simulation and debug tools. Maintain efficient and clean regression status Develop...


  • San Francisco, United States Mistral Full time

    Mistral AI is hiring an expert in the role of serving and training large language models at high speed on GPUs. The role is based in San Francisco. The role will involve -Writing low-level code to take all advantage of high-end GPUs (H100) and max out their capacity -Rethinking various part of the generative model architecture to make them more suitable for...


  • San Francisco, United States Mistral AI Full time

    Mistral AI is hiring an expert in the role of serving and training large language models at high speed on GPUs. The role is based in San Francisco. The role will involve -Writing low-level code to take all advantage of high-end GPUs (H100) and max out their capacity -Rethinking various part of the generative model architecture to make them more suitable for...


  • San Mateo, CA, United States Snowflake Computing Full time

    Build the future of data. Join the Snowflake team.We are the Global Services team. We own and operate the Cloud Services layer of our infrastructure. We are responsible for the health and performance of our VMs. This role is responsible for making improvements to the performance of our Java applications. The work will involve debugging real production...


  • San Jose, United States IC Resources Full time

    Join one of the world's foremost RISC-V companies as a Senior Verification Engineer, contributing to the development of cutting-edge CPU products for applications such as 5G, AI, and machine learning. As a top company they offer competitive compensation, benefits, and full remote working options (they also have offices in San Jose & Portland if you'd like...


  • San Jose, California, United States IC Resources Full time

    Join one of the world's foremost RISC-V companies as a Senior Verification Engineer, contributing to the development of cutting-edge CPU products for applications such as 5G, AI, and machine learning. As a top company they offer competitive compensation, benefits, and full remote working options (they also have offices in San Jose & Portland if you'd like to...


  • San Mateo, United States A Society Group Full time

    Join a truly innovative company! As a Drive Performance Engineer, your main goal will be to provide customers with a premium ride experience when using our fully autonomous vehicles. You will work with a team of world-class engineers with diverse backgrounds such as robotics, control, and vehicle engineering. While leading the powertrain controls...


  • San Jose, United States IC Resources Full time

    Join one of the world's foremost RISC-V companies as a Senior Verification Engineer, contributing to the development of cutting-edge CPU products for applications such as 5G, AI, and machine learning. As a top company they offer competitive compensation, benefits, and full remote working options (they also have offices in San Jose & Portland if you'd like...


  • San Francisco, United States IC Resources Full time

    ASIC Design Verification Engineer GREECE! This is an interesting opportunity for either a current Engineer working in Greece or a European Engineer who wants to move to Greece to join a company focusingon AI integration from cloud to edge and GPU solutions. As a Senior Verification Engineer, you will undertake the planning and verification activities for...


  • San Jose, United States QuEST Global Full time

    Company Quest Global Job Area Hardware Engineering Job Description Summary General Summary: Senior Design Verification Engineer Join the Quest Global as a Senior Design Verification Engineer for the most cutting-edge work. Quest Global assists its customers in developing their next generation flagship product lines (mobile devices, complex routers/switches,...


  • San Diego, United States QuEST Global Full time

    CompanyQuest Global Apply fast, check the full description by scrolling below to find out the full requirements for this role. Job AreaHardware Engineering Job Description Summary General Summary: Senior Design Verification Engineer Join the Quest Global as a Senior Design Verification Engineer for the most cutting-edge work. Quest Global assists its...