Senior Performance Software Engineer, Deep Learning Libraries

3 weeks ago

Santa Clara CA United States NVIDIA Full time
We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA GPUs. The team delivers high-performance code to NVIDIA’s cuDNN, cuBLAS, and TensorRTlibraries to accelerate deep learning models. The team is proud to play an integral part in enabling the breakthroughs in domains such as image classification, speech recognition, and natural language processing. Join the team that is building the underlying software used across the world to power the revolution in artificial intelligence We’re always striving for peak GPU efficiency on current and future-generation GPUs. To get a sense of the code we write, check out our CUTLASS open-source project showcasing performant matrix multiply on NVIDIA’s Tensor Cores with CUDA. This specific position primarily deals with code lower in the deep learning software stack, right down to the GPU HW.

What you'll be doing:

Writing highly tuned compute kernels, mostly in C++ CUDA, to perform core deep learning operations (e.g. matrix multiplies, convolutions, normalizations)

Following general software engineering best practices including support for regression testing and CI/CD flows

Collaborating with teams across NVIDIA:

CUDA compiler team on generating optimal assembly code

Deep learning training and inference performance teams on which layers require optimization

Hardware and architecture teams on the programming model for new deep learning hardware features

What we need to see:

Masters or PhD degree or equivalent experience in Computer Science, Computer Engineering, Applied Math, or related field

6+ years of relevant industry experience

Demonstrated strong C++ programming and software design skills, including debugging, performance analysis, and test design

Experience with performance-oriented parallel programming, even if it’s not on GPUs (e.g. with OpenMP or pthreads)

Solid understanding of computer architecture and some experience with assembly programming

Ways to stand out from the crowd:

Tuning BLAS or deep learning library kernel code

CUDA/OpenCL GPU programming

Numerical methods and linear algebra

LLVM, TVM tensor expressions, or TensorFlow MLIR

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hard working people in the world working for us. If you're creative, autonomous, and love a challenge, consider joining our Deep Learning Library team and help us build the real-time, cost-effective computing platform driving our success in this exciting and quickly growing field.

The base salary range is 180,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

#deeplearning

  • Senior Performance Software Engineer, Deep Learning Libraries

    3 weeks ago

    Santa Clara, CA, United States NVIDIA Full time

    We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries! Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you! As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA...

  • Senior Performance Software Engineer, Deep Learning Libraries

    2 weeks ago

    Santa Clara, CA, United States NVIDIA Full time

    We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries! Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you! As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA...

  • Senior Performance Software Engineer, Deep Learning Libraries

    2 weeks ago

    Santa Clara, United States NVIDIA Full time

    We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries! Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you! As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA...

  • Senior Performance Software Engineer, Deep Learning Libraries

    3 weeks ago

    Santa Clara, United States NVIDIA Full time

    We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries! Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you! As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA...

  • Senior Performance Software Engineer, Deep Learning Libraries

    3 weeks ago

    Santa Clara, United States NVIDIA Full time

    We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries! Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you! As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA...

  • Senior Performance Software Engineer, Deep Learning Libraries

    3 weeks ago

    Santa Clara, United States NVIDIA Full time

    We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries! Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you! As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA...

  • Senior Performance Software Engineer, Deep Learning Libraries

    4 days ago

    Santa Clara, United States NVIDIA Full time

    We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA...

  • Senior Performance Software Engineer, Deep Learning Libraries

    7 days ago

    Santa Clara, United States NVIDIA Full time

    We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries! Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you! As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA...

  • Senior Performance Software Engineer, Deep Learning Libraries

    2 weeks ago

    Santa Clara, United States NVIDIA Full time

    We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries! Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you! As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA...

  • Senior Performance Engineer

    4 weeks ago

    Santa Clara, United States NVIDIA Full time

    Senior Performance Engineer - Deep Learning page is loaded Senior Performance Engineer - Deep Learning Apply locations US, CA, Santa Clara US, CA, Remote time type Full time posted on Posted 30+ Days Ago job requisition id JR1969570 NVIDIA is hiring senior software engineers to build and optimize the tools Deep Learning engineers use across the world to...

  • Senior Performance Engineer

    2 weeks ago

    Santa Clara, United States NVIDIA Full time

    Senior Performance Engineer - Deep Learning page is loaded Senior Performance Engineer - Deep Learning Apply locations US, CA, Santa Clara US, CA, Remote time type Full time posted on Posted 30+ Days Ago job requisition id JR1969570 NVIDIA is hiring senior software engineers to build and optimize the tools Deep Learning engineers use across the world to...

  • Performance Engineer

    37 minutes ago

    Santa Clara, United States NVIDIA Full time

    NVIDIA is hiring software engineers at all experience levels to build and optimize the tools Deep Learning engineers use across the world to design, develop, and deploy AI applications. This position will embed you in an ambitious and diverse team that influences all areas of NVIDIA's AI platform and directly contributes to premiere Deep Learning frameworks...

  • Senior Compiler Engineer

    2 months ago

    Santa Clara, United States NVIDIA Full time

    We are looking for a Senior Deep Learning Compiler Engineer. NVIDIA is hiring software engineers for its Deep Learning Compiler team. Academic and commercial groups around the world are using GPUs to power a revolution in deep learning, enabling breakthroughs in many areas, e.g. image classification, speech recognition, recommendation systems, large language...

  • Software Engineering Manager

    4 weeks ago

    Santa Clara, CA, United States NVIDIA Corporation Full time

    Software Engineering Manager - Libraries page is loaded Software Engineering Manager - Libraries Apply locations US, CA, Santa Clara US, CA, Remote time type Full time posted on Posted Yesterday job requisition id JR1981753 We are looking for a software engineering manager to lead our development efforts for math libraries in the AI, HPC, and Quantum...

  • Senior Software Architecture Engineer

    7 days ago

    Santa Clara, United States ATR International Full time

    We are seeking a Senior Software Architecture Engineer for a very important client Job Description The rapid acceleration of deep learning and generative AI is leading to new generations of high-performance and low-power chip architecture At the Company, architecture engineers work at the forefront of this technological leap in computer architecture Our...

  • Senior Engineer,Software

    4 weeks ago

    Santa Clara, CA, United States NVIDIA Corporation Full time

    Senior Software Engineer, GPU Communications and Networking page is loaded Senior Software Engineer, GPU Communications and Networking Apply locations US, CA, Santa Clara time type Full time posted on Posted 2 Days Ago job requisition id JR1972306 NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance...

  • Senior Software Engineer, GPU Communications and Networking

    4 weeks ago

    Santa Clara, CA, United States NVIDIA Corporation Full time

    Senior Software Engineer, GPU Communications and Networking page is loaded Senior Software Engineer, GPU Communications and Networking Apply locations US, CA, Santa Clara time type Full time posted on Posted 2 Days Ago job requisition id JR1972306 NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance...

  • Senior Software Engineer, Deep Learning

    2 months ago

    Palo Alto, CA, United States Tesla Inc Full time

    **Senior Software Engineer, Deep Learning - Autopilot AI**????Engineering & Information Technology????Palo Alto, California?? ID111813???? **The Role** As a member of the Autopilot AI team you will design, implement, and optimize deep learning dataset generation, training, and evaluation tools and infrastructure to advance the state of the art in perception...

  • Senior Software Engineer, JAX

    3 weeks ago

    Santa Clara, CA, United States NVIDIA Full time

    NVIDIA is hiring senior engineers to develop its AI platform and more specifically its performance optimizations in deep learning frameworks using JAX, a tool that can differentiate between Python control code and NumPy code. Our goal is to deliver a polished, fast, modular and coordinated platform to handle data, training and analysis for a wide range of...

  • Software Engineering Manager

    3 weeks ago

    Santa Clara, United States NVIDIA Full time

    We are the GPU Communications Libraries and Networking team at NVIDIA. We deliver communication libraries like NCCL, NVSHMEM, UCX for Deep Learning and HPC. DL and HPC applications have a huge compute demand already and run on scales which go up to tens of thousands of GPUs. The GPUs are connected with high-speed interconnects (eg. NVLink, PCIe) within a...