Senior Performance Software Engineer, Deep Learning Libraries

2 weeks ago

Santa Clara, United States NVIDIA Full time

We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA GPUs. The team delivers high-performance code to NVIDIA’s cuDNN, cuBLAS, and TensorRTlibraries to accelerate deep learning models. The team is proud to play an integral part in enabling the breakthroughs in domains such as image classification, speech recognition, and natural language processing. Join the team that is building the underlying software used across the world to power the revolution in artificial intelligence We’re always striving for peak GPU efficiency on current and future-generation GPUs. To get a sense of the code we write, check out our CUTLASS open-source project showcasing performant matrix multiply on NVIDIA’s Tensor Cores with CUDA. This specific position primarily deals with code lower in the deep learning software stack, right down to the GPU HW.

What you'll be doing:

  • Writing highly tuned compute kernels, mostly in C++ CUDA, to perform core deep learning operations (e.g. matrix multiplies, convolutions, normalizations)

  • Following general software engineering best practices including support for regression testing and CI/CD flows

  • Collaborating with teams across NVIDIA:

    • CUDA compiler team on generating optimal assembly code

    • Deep learning training and inference performance teams on which layers require optimization

    • Hardware and architecture teams on the programming model for new deep learning hardware features

What we need to see:

  • Masters or PhD degree or equivalent experience in Computer Science, Computer Engineering, Applied Math, or related field

  • 6+ years of relevant industry experience

  • Demonstrated strong C++ programming and software design skills, including debugging, performance analysis, and test design

  • Experience with performance-oriented parallel programming, even if it’s not on GPUs (e.g. with OpenMP or pthreads)

  • Solid understanding of computer architecture and some experience with assembly programming

Ways to stand out from the crowd:

  • Tuning BLAS or deep learning library kernel code

  • CUDA/OpenCL GPU programming

  • Numerical methods and linear algebra

  • LLVM, TVM tensor expressions, or TensorFlow MLIR


NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hard working people in the world working for us. If you're creative, autonomous, and love a challenge, consider joining our Deep Learning Library team and help us build the real-time, cost-effective computing platform driving our success in this exciting and quickly growing field.

The base salary range is 180,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

#deeplearning

  • Senior Performance Software Engineer for Deep Learning Libraries

    2 weeks ago

    Santa Clara, California, United States NVIDIA Full time

    Senior Performance Software Engineer for Deep Learning LibrariesWe are seeking a highly skilled Senior Performance Software Engineer to join our team in developing optimized code for NVIDIA GPUs. As a key member of our Deep Learning Library team, you will be responsible for writing highly tuned compute kernels in C++ CUDA to perform core deep learning...

  • Senior Performance Software Engineer for Deep Learning Libraries

    2 weeks ago

    Santa Clara, California, United States NVIDIA Full time

    Job Title: Senior Performance Software Engineer for Deep Learning LibrariesWe are seeking a highly skilled Senior Performance Software Engineer to join our team in developing optimized code for NVIDIA's deep learning libraries. As a key member of our team, you will be responsible for designing and implementing high-performance algorithms and data structures...

  • Senior Performance Software Engineer for Deep Learning Libraries

    4 days ago

    Santa Clara, California, United States NVIDIA Full time

    We are seeking a Senior Performance Software Engineer to join our Deep Learning Library team at NVIDIA.This role involves developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA GPUs. The team delivers high-performance code to NVIDIA's cuDNN, cuBLAS, and TensorRT libraries to accelerate deep learning models.Key...

  • Senior Performance Software Engineer for Deep Learning Libraries

    1 week ago

    Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Performance Software Engineer to join our team responsible for developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA GPUs.The ideal candidate will have a strong background in computer science, computer engineering, or a related field, and experience with performance-oriented...

  • Senior Deep Learning Software Engineer

    4 days ago

    Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Deep Learning Software Engineer to develop and productize NVIDIA's deep learning solutions in autonomous driving vehicles.The ideal candidate will have a strong background in deep learning and experience with NVIDIA's software libraries, including CUDA and TensorRT.As a member of our Solution Engineering-Automotive Deep...

  • Senior Deep Learning Software Engineer

    2 weeks ago

    Santa Clara, California, United States NVIDIA Full time

    Join NVIDIA's Innovative TeamWe're seeking a highly skilled Senior Deep Learning Software Engineer to join our cuDNN team. As a key member of our team, you'll be responsible for designing, building, and shipping our GPU-accelerated library of primitives for deep neural networks.Key Responsibilities:Develop production-quality software that ships as part of...

  • Senior Deep Learning Software Engineer, cuDNN

    2 weeks ago

    Santa Clara, California, United States NVIDIA Full time

    Join Our Team of InnovatorsWe're seeking a highly skilled Senior Deep Learning Software Engineer to join our cuDNN team at NVIDIA. As a key member of our team, you'll play a crucial role in designing, building, and shipping our GPU-accelerated library of primitives for deep neural networks.About the RoleAs a Senior Deep Learning Software Engineer, you'll be...

  • Senior Infrastructure Software Engineer for Deep Learning Libraries

    1 week ago

    Santa Clara, California, United States NVIDIA Full time

    Design and Develop Scalable InfrastructureNVIDIA's Deep Learning Libraries Group is seeking an experienced software engineer to design and develop scalable infrastructure for our deep learning libraries. The role spans multiple products, including cuDNN and TensorRT. The mission is to streamline development, build, and test across NVIDIA's diverse set of...

  • Senior Deep Learning Software Engineer, cuDNN

    1 week ago

    Santa Clara, California, United States NVIDIA Full time

    We're seeking a highly skilled Senior Deep Learning Software Engineer to join our cuDNN team at NVIDIA. As a key member of our team, you will be responsible for designing, building, and shipping cuDNN, our GPU-accelerated library of primitives for deep neural networks.Key Responsibilities:Develop production-quality software that ships as part of NVIDIA's AI...

  • Senior Performance Engineer

    2 weeks ago

    Santa Clara, United States NVIDIA Full time

    NVIDIA is hiring senior software engineers to build and optimize the tools Deep Learning engineers use across the world to design, develop, and deploy AI applications. We are an ambitious, forward-thinking and diverse team that influences all areas of NVIDIA's AI platform and directly contributes to premiere Deep Learning frameworks - PyTorch, JAX and...

  • Senior Deep Learning Software Engineer, cuDNN

    3 days ago

    Santa Clara, California, United States NVIDIA Full time

    We're seeking a Senior Deep Learning Software Engineer to join our cuDNN teamDo you enjoy crafting software systems to solve complex problems and writing fast code? We're looking for skilled software engineers to help design, build, and ship cuDNN: our GPU-accelerated library of primitives for deep neural networks. The era of AI has begun, and we're powering...

  • Senior Deep Learning Software Engineer for cuDNN Team

    5 days ago

    Santa Clara, California, United States NVIDIA Full time

    Job SummaryWe're seeking a highly skilled Senior Deep Learning Software Engineer to join our cuDNN team. As a key member of our team, you will be responsible for designing, building, and shipping cuDNN, a GPU-accelerated library of primitives for deep neural networks.Key Responsibilities- Develop production-quality software that ships as part of NVIDIA's AI...

  • Senior Deep Learning Software Engineer, cuDNN

    2 weeks ago

    Santa Clara, United States NVIDIA Full time

    We're now looking for a Senior Deep Learning Software Engineer for our cuDNN team!Do you love writing fast code and crafting software systems to solve complex problems? We are looking for hardworking software engineers to help design, build, and ship cuDNN: our GPU-accelerated library of primitives for deep neural networks. Intelligent machines powered by AI...

  • Deep Learning Software Engineer

    3 days ago

    Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Deep Learning Software Engineer to join our team at NVIDIA. As a member of our Solution Engineering-Automotive Deep Learning team, you will apply groundbreaking NVIDIA deep learning model training/inference software libraries for deployment on NVIDIA's hardware architecture.Key Responsibilities:Develop new deep learning...

  • Senior Deep Learning Software Engineer

    3 weeks ago

    Santa Clara, California, United States Nvidia Full time

    Job Title: Senior Deep Learning Software EngineerWe are seeking a highly skilled Senior Deep Learning Software Engineer to join our team at NVIDIA. As a key member of our model optimization group, you will play a pivotal role in designing and building our automated inference and deployment solution.Key Responsibilities:Architect and design a modular and...

  • Senior Performance Engineer

    1 month ago

    US, CA, Santa Clara NVIDIA Full time

    NVIDIA is hiring senior software engineers to build and optimize the tools Deep Learning engineers use across the world to design, develop, and deploy AI applications. We are an ambitious, forward-thinking and diverse team that influences all areas of NVIDIA's AI platform and directly contributes to premiere Deep Learning frameworks - PyTorch, JAX and...

  • Senior Deep Learning Software Engineer

    1 week ago

    Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Deep Learning Software Engineer to join our Solution Engineering-Automotive Deep Learning team. As a key member of our team, you will be responsible for developing and productizing NVIDIA's deep learning solutions in autonomous driving vehicles.Key responsibilities include:Developing new deep learning architectures and...

  • Senior Deep Learning Software Engineer, cuDNN

    1 month ago

    US, CA, Santa Clara NVIDIA Full time

    We're now looking for a Senior Deep Learning Software Engineer for our cuDNN team!Do you love writing fast code and crafting software systems to solve complex problems? We are looking for hardworking software engineers to help design, build, and ship cuDNN: our GPU-accelerated library of primitives for deep neural networks. Intelligent machines powered by AI...

  • Senior Software Engineer for Deep Learning Inference Workflows

    1 week ago

    Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Software Engineer to join our Deep Learning Inference Workflows team. As a key member of our team, you will be responsible for developing components of TensorRT, NVIDIA's SDK for high-performance deep learning inference.Key Responsibilities: Develop graph parsers, optimizers, and tools for effective deployment of...

  • Senior Deep Learning Software Engineer

    1 week ago

    Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Deep Learning Software Engineer to design and build our automated inference and deployment solution.As part of the team, you will play a pivotal role in architecting and designing a modular and scalable software platform to provide an excellent user experience with broad model support and optimization...