Senior GPU Supercomputer Scheduler Engineer

4 weeks ago


Santa Clara CA United States NVIDIA Full time
NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing. NVIDIA is a “learning machine” that constantly evolves by adapting to new opportunities that are hard to solve, that only we can take on, and that matter to the world. This is our life’s work, to amplify human imagination and intelligence. Join us today

As a member of the GPU/HPC Infrastructure team, you will provide leadership in the design and implementation of groundbreaking GPU compute clusters that run demanding deep learning, high performance computing, and computationally intensive workloads. We seek a technology leader to identify architectural changes and/or completely new approaches for improving HPC schedulers for serving many simultaneous and large multi-node GPU workloads with many complex dependencies. This role offers you an excellent opportunity to deliver production grade solutions, get hands on with ground-breaking technology, and work closely with technical leaders solving some of the biggest challenges in machine learning, cloud computing, and system co-design.

What you'll be doing:

Design and develop enhancements to the HPC batch scheduler(s).

Work extensively with HPC scheduler vendor on bug fixes and feature releases

Provide support to staff and end users to resolve batch scheduler issues

Build and improve our ecosystem around GPU-accelerated computing

Performance analysis and optimizations of deep learning workflows

Develop large scale automation solutions

Root cause analysis and suggest corrective action for problems large and small scales

Finding and fixing problems before they occur

What we need to see:

Bachelor’s degree in Computer Science, Electrical Engineering or related field or equivalent experience with 5+ years of work experience

Strong understanding of HPC batch schedulers, such as Slurm, RTDA or LSF and HPC workflows that use MPI

Significant experience in Programming in C/C++ and advanced scripting in languages such as Python, Go, bash scripting

Established experience in Linux operating system, environment and tools

Accomplished in computer architecture and operating systems

Deep knowledge of Networking Protocols like InfiniBand, Ethernet

Experience analyzing and tuning performance for a variety of HPC workloads

In-depth understating of container technologies like Docker, Singularity, Podman

Flexibility/adaptability for working in a dynamic environment with different frameworks and requirements

Excellent communication, interpersonal and customer collaboration skills

Ways to stand out from the crowd:

Knowledge in MPI and High-performance computing

Background in RDMA technology

Experience in kernel programming

Open Source Software Contributor

Experience with deep learning frameworks like PyTorch and TensorFlow

Passionate about SW development processes

Want to make what was impossible possible

The base salary range is 148,000 USD - 276,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

  • Santa Clara, United States NVIDIA Full time

    NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing. NVIDIA is a “learning machine” that constantly evolves by...


  • Santa Clara, United States NVIDIA Full time

    NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing. NVIDIA is a “learning machine” that constantly evolves by...


  • Santa Clara, United States NVIDIA Full time

    NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing. NVIDIA is a “learning machine” that constantly evolves by...


  • Santa Clara, United States NVIDIA Full time

    NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI - the next era of computing. NVIDIA is a "learning machine" that constantly evolves by adapting...


  • Santa Clara, United States NVIDIA Full time

    Senior Platform Software Engineer, AI Server - GPU page is loaded Senior Platform Software Engineer, AI Server - GPU Apply locations US, CA, Santa Clara US, Remote time type Full time posted on Posted 4 Days Ago job requisition id JR1980965 NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics,...


  • Santa Clara, United States NVIDIA Full time

    High Performance Computing (HPC) and Artificial Intelligence (AI) are key markets for NVIDIA. Researchers and scientists actively embrace GPU programming to accelerate their workloads and research. To help them onboard to GPUs, NVIDIA is leading a series of GPU hackathons and bootcamps in partnership with national laboratories, universities and enterprises....


  • Santa Clara, United States NVIDIA Full time

    High Performance Computing (HPC) and Artificial Intelligence (AI) are key markets for NVIDIA. Researchers and scientists actively embrace GPU programming to accelerate their workloads and research. To help them onboard to GPUs, NVIDIA is leading a series of GPU hackathons and bootcamps in partnership with national laboratories, universities and enterprises....


  • Santa Clara, CA, United States NVIDIA Corporation Full time

    Senior Software Engineer, GPU Communications and Networking page is loaded Senior Software Engineer, GPU Communications and Networking Apply locations US, CA, Santa Clara time type Full time posted on Posted 2 Days Ago job requisition id JR1972306 NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance...


  • Santa Clara, United States NVIDIA Full time

    Senior GPU Performance and Power Profiling Engineer page is loaded Senior GPU Performance and Power Profiling Engineer Apply locations US, TX, Austin US, CA, Santa Clara time type Full time posted on Posted 10 Days Ago job requisition id JR1981143 At NVIDIA, we build groundbreaking products for the following sectors: Automotive, VR, Gaming, Deep Learning,...


  • Santa Clara, CA, United States Nvidia Full time

    We are now looking for a Senior System Architect for our GPU team!A key part of NVIDIA's strength is to innovate in the graphics and parallel computing fields, delivering the highest performance in the world for graphics processing. We are constantly looking for ways to improve our GPU architecture and maintain our leadership. NVIDIA is seeking a motivated...


  • San Francisco, CA, United States OpenAI Full time

    About The Team The Supercomputing Scheduling Pillar at OpenAI is dedicated to ensuring the reliability, scalability, and user-friendliness of job lifecycle management, with an emphasis on efficient and flexible job scheduling, quota management, and job execution workflows. We maximize researcher productivity by ensuring high goodput, efficient packing, and...


  • Santa Clara, CA, United States NVIDIA Full time

    NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were...


  • Santa Clara, CA, United States NVIDIA Corporation Full time

    Senior Software Engineer - CUDA Python page is loaded Senior Software Engineer - CUDA Python Apply locations US, CA, Santa Clara US, Remote time type Full time posted on Posted Yesterday job requisition id JR1980520 NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized...


  • Santa Clara, CA, United States NVIDIA Full time

    NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern deep learning — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and...


  • Santa Clara, CA, United States NVIDIA Full time

    We are now looking for a Senior Architect for GPUs and SoCs:The NVIDIA Architecture Modelling group is looking for architects and software developers to join our various architecture efforts. A key part of NVIDIA's strength is to innovate in the graphics and parallel computing fields, delivering the highest performance in the world for high-performance...


  • Santa Clara, CA, United States NVIDIA Full time

    We are now looking for a Senior Architect for GPUs and SoCs:The NVIDIA Architecture Modelling group is looking for architects and software developers to join our various architecture efforts. A key part of NVIDIA's strength is to innovate in the graphics and parallel computing fields, delivering the highest performance in the world for high-performance...


  • Santa Clara, CA, United States NVIDIA Corporation Full time

    Senior Software Engineer – Datacenter Telemetry page is loaded Senior Software Engineer – Datacenter Telemetry Apply locations US, CA, Santa Clara US, Remote time type Full time posted on Posted 2 Days Ago job requisition id JR1981279 NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer...


  • Santa Clara, California, United States tapwage Full time

    We are now looking for a Senior Hardware Security Architect - GPU Security Verification:NVIDIA is seeking a Senior Hardware Security engineer to architect, design, validate, and guide implementation of HW security for its GPU products with a focus on security verification. You are expected to take a strong, hands-on approach to ensuring secure development...


  • Santa Clara, California, United States tapwage Full time

    We are now looking for a Senior Hardware Security Architect - GPU Security Verification:NVIDIA is seeking a Senior Hardware Security engineer to architect, design, validate, and guide implementation of HW security for its GPU products with a focus on security verification. You are expected to take a strong, hands-on approach to ensuring secure development...


  • Santa Clara, CA, United States NVIDIA Full time

    NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern deep learning — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and...