GPU Computing Capacity Optimization Engineer

3 weeks ago


Durham, United States NVIDIA Full time

NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing. NVIDIA is a “learning machine” that constantly evolves by adapting to new opportunities that are hard to solve, that only we can address, and that matter to the world. This is our life’s work, to amplify human creativity and intelligence. Make the choice to join us today 

As a member of the GPU AI/HPC Infrastructure team, you will provide leadership in the design and implementation of ground breaking GPU compute clusters that run demanding deep learning, high performance computing, and computationally intensive workloads. In this role we seek an expert to optimize the Capacity management and allocation in GPU Compute Clusters. You will help us with the strategic challenges we encounter in maximizing and optimizing our usage of all datacenter resources including compute, storage, network and power. You will help build methodologies, tools and metrics to enable effective resource utilization in a heterogeneous compute environment, and assist with growth planning across our global computing environment. 

What you'll be doing: 

  • Building and improving our ecosystem around GPU-accelerated computing including developing large scale automation solutions 

  • Supporting our researchers to run their flows on our clusters including performance analysis and optimizations of deep learning workflows 

  • Diagnosing customer utilization deficiencies and job scheduling issues 

  • Building automation, tools and metrics to help us increase productive utilization of resources 

  • Collaborating with the scheduler team to improve scheduling algorithms 

  • Root cause analysis and suggest corrective action for problems large and small scales 

  • Finding and fixing problems before they occur 

What we need to see: 

  • Bachelor’s degree in Computer Science, Electrical Engineering or related field or equivalent experience. 

  • Minimum 5+ years of experience designing and operating large scale compute infrastructure. 

  • Experience analyzing and tuning performance for a variety of AI/HPC workloads. 

  • Working knowledge of cluster configuration managements tools such as Ansible, Puppet, Salt. 

  • Experience with AI/HPC advanced job schedulers, and ideally familiarity with schedulers such as Slurm, K8s, RTDA or LSF 

  • Familiarity with container technologies like Docker, Singularity, Shifter, Charliecloud 

  • Proficient in Python programming and bash scripting 

  • Experience with AI/HPC workflows that use MPI 

Ways to stand out from the crowd: 

  • Experience with NVIDIA GPUs, Cuda Programming, NCCL and MLPerf benchmarking 

  • Experience with Machine Learning and Deep Learning concepts, algorithms and models 

  • Proficient in Centos/RHEL and/or Ubuntu Linux distros 

  • Familiarity with InfiniBand with IBOP and RDMA as well as understanding of fast, distributed storage systems like Lustre and GPFS for AI/HPC workloads 

  • Familiarity with deep learning frameworks like PyTorch and TensorFlow 

NVIDIA offers highly competitive salaries and a comprehensive benefits package. We have some of the most brilliant and talented people in the world working for us and, due to unprecedented growth, our world-class engineering teams are growing fast. If you're a creative and autonomous engineer with real passion for technology, we want to hear from you. 

The base salary range is 148,000 USD - 276,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and . NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.



  • Durham, United States NVIDIA Full time

    Senior ASIC Verification Engineer - GPU page is loaded Senior ASIC Verification Engineer - GPU Apply locations US, CA, Santa Clara US, TX, Austin US, NC, Durham time type Full time posted on Posted 30+ Days Ago job requisition id JR1960956 NVIDIA is seeking elite ASIC Verification Engineers to verify the design and implementation of the world’s leading...


  • Durham, United States Unreal Gigs Full time

    What You'll Do Design, implement, and optimize computer vision (CV) models. Set up MLOps pipeline for continuous improvement of CV models. Meet with contractors to understand their needs and requirements. Develop optimizations tailored to key aspects of the construction industry. RequirementsYour QualificationsWe are seeking a dedicated and innovative...


  • Durham, United States Unreal Gigs Full time

    What You'll Do Read on to fully understand what this job requires in terms of skills and experience If you are a good match, make an application.Design, implement, and optimize computer vision (RESUME) models.Set up MLOps pipeline for continuous improvement of RESUME models.Meet with contractors to understand their needs and requirements.Develop...


  • Durham, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionWhat You'll DoDesign, implement, and optimize computer vision (CV) models.Set up MLOps pipeline for continuous improvement of CV models.Meet with contractors to understand their needs and requirements.Develop optimizations tailored to key aspects of the construction industry.RequirementsYour QualificationsWe are seeking a...


  • Durham, North Carolina, United States Unreal Gigs Full time

    What You'll Do Design, implement, and optimize computer vision (RESUME) models. Set up MLOps pipeline for continuous improvement of RESUME models. Meet with contractors to understand their needs and requirements. Develop optimizations tailored to key aspects of the construction industry. Requirements Your Qualifications We are seeking a dedicated...


  • Durham, United States NVIDIA Full time

    Senior ASIC Design Engineer page is loaded Senior ASIC Design Engineer Apply locations US, NC, Durham US, CA, Santa Clara time type Full time posted on Posted Yesterday job requisition id JR1981452 We are now looking for a Senior ASIC Design Engineer! NVIDIA is seeking outstanding Senior ASIC Designer to design and implement the power efficient and...


  • Durham, United States NVIDIA Full time

    NVIDIA is seeking an ASIC Engineer to support the design and verification of the GPU memory subsystem in the world’s leading SoC's and GPU's – an opportunity to have real impact in a dynamic, technology-focused company impacting product lines ranging from consumer graphics to self-driving cars and the growing field of artificial intelligence. We have...


  • Durham, United States NVIDIA Full time

    NVIDIA is looking for a passionate, world-class computer scientist to work in its Compute Developer Technology (Devtech) team as an AI Developer Technology Engineer. Artificial intelligence, the dream of computer scientists for over half a century, is no longer science fiction. And in the next few years, it will transform every industry. Soon, self-driving...


  • Durham, United States NVIDIA Full time

    NVIDIA is seeking an ASIC Engineer to support the design and verification of the GPU memory subsystem in the world’s leading SoC's and GPU's – an opportunity to have real impact in a dynamic, technology-focused company impacting product lines ranging from consumer graphics to self-driving cars and the growing field of artificial intelligence. We have...


  • Durham, United States NVIDIA Full time

    Senior Software Engineer - Chip Design Tools page is loaded Senior Software Engineer - Chip Design Tools Apply locations US, CA, Santa Clara US, MA, Westford US, TX, Austin US, NC, Durham time type Full time posted on Posted 4 Days Ago job requisition id JR1977911 NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999...


  • Durham, United States NVIDIA Full time

    EDA System Software Engineer page is loaded EDA System Software Engineer Apply locations US, NC, Durham US, MA, Westford US, TX, Austin US, CA, Santa Clara time type Full time posted on Posted 2 Days Ago job requisition id JR1980536 NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999 sparked the growth of the PC...


  • Durham, United States NVIDIA Full time

    ASIC Design Efficiency Engineer page is loaded ASIC Design Efficiency Engineer Apply locations US, CA, Santa Clara US, TX, Austin US, NC, Durham time type Full time posted on Posted 30+ Days Ago job requisition id JR1965588 We are now looking for an ASIC Design Efficiency Engineer! NVIDIA is seeking extraordinary methodology engineers to design hardware...


  • Durham, United States NVIDIA Full time

    NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing. NVIDIA is a “learning machine” that constantly evolves by...


  • Durham, United States NVIDIA Full time

    For two decades, we have pioneered visual computing, the art and science of computer graphics. With our invention of the GPU - the engine of modern visual computing - the field has expanded to encompass video games, movie production, product design, medical diagnosis and scientific research. Today, we stand at the beginning of the next era, the AI computing...


  • Durham, North Carolina, United States NC School of Science and Mathematics Full time

    Join Team NCSSM at the #2 Best Public High School in the U.S POSITION LOCATION : Durham, NC or Morganton, NC NCSSM employees are generally required to live within a 2-hour commuting distance of the assigned duty station. CLOSING DATE: Open until filled - priority consideration to applications received prior to April 30th, P.M. HIRING SALARY : Salary...


  • Durham, NC, United States Nvidia Full time

    We are now looking for a Deep Learning Performance Analysis Architect! NVIDIA is seeking outstanding Performance Analysis Architects to help analyze and accelerate AI application performance at the intersection of both hardware and software.Intelligent machines powered by Artificial Intelligence that can learn, reason and interact with people are no longer...


  • Durham, United States NVIDIA Full time

    NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999 fueled the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI and enabled the next era of computing. NVIDIA is a “learning machine” that constantly evolves...


  • Durham, United States NVIDIA Full time

    Senior ASIC Physical Design PPA Engineer page is loaded Senior ASIC Physical Design PPA Engineer Apply locations US, CA, Santa Clara US, MA, Westford US, TX, Austin US, NC, Durham US, Remote time type Full time posted on Posted Yesterday job requisition id JR1980494 We are now looking for a motivated Senior ASIC Physical Design PPA (Performance, Power, Area)...


  • Durham, United States NVIDIA Full time

    At NVIDIA in Santa Clara, CA, USA, we are currently seeking a skilled AI/ML Infrastructure Engineer to join our team. As an Engineer, you will have a unique chance to enhance productivity for our researchers by implementing improvements throughout the entire stack. Your main responsibility will be to identify and address infrastructure gaps to ensure...


  • Durham, United States Cormetech Full time

    Description We are currently expanding our team and are looking for a Sr. Equipment Engineer. At CORMETECH our Engineers and Scientists have a passion for innovation to meet our clients’ needs. Your primary role will be to manage projects for the design and specification of manufacturing and processing equipment, installation, and start-up of new plant...