Senior Performance Engineer

3 weeks ago


Santa Clara CA United States NVIDIA Full time

NVIDIA is hiring senior software engineers to build and optimize the tools Deep Learning engineers use across the world to design, develop, and deploy AI applications. We are an ambitious, forward-thinking and diverse team that influences all areas of NVIDIA's AI platform and directly contributes to premiere Deep Learning frameworks - PyTorch, JAX and TensorFlow. We work with multiple teams both inside and outside of NVIDIA across fields, as well as collaborate with the open-source community to optimize the best AI platform in the world

What you will be doing:

  • Develop and optimize open-source libraries, like Transformer Engine, which enables the fastest training of Large Language Models using low precision data formats, and TensorFlow Distributed Embeddings, providing ability to easily scale training of huge recommender systems on multiple GPUs.

  • Study and tune Deep Learning training workloads at large scale, including important enterprise models.

  • Build and support NVIDIA submissions to community benchmarks like MLPerf.

  • Optimize the performance of influential, modern Deep Learning models coming out of academic and industry research, for NVIDIA GPUs and systems.

  • Explore new technologies and advise design of new hardware generations and core platform software components.

What we need to see:

  • BS in Computer Science, Electrical Engineering or a related field (or equivalent experience).

  • Demonstrated ability with 6+ years of C++ and Python programming.

  • Strong background with parallel programming, preferably on GPUs.

  • Knowledge of Computer Architecture and/or Operating Systems.

  • Proven experience developing large software projects.

  • Excellent verbal and written communication skills.

Ways to stand out from the crowd:

  • Experience with Deep Learning Frameworks, like PyTorch, JAX, Tensorflow or MXNet.

  • Experience training language models.

  • Background with performance analysis and profiling of workloads.

  • Participation in the open-source community.

  • Proven experience working with multidisciplinary teams.

The base salary range is 180,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits . NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.



  • Santa Clara, United States NVIDIA Full time

    NVIDIA is hiring senior software engineers to build and optimize the tools Deep Learning engineers use across the world to design, develop, and deploy AI applications. We are an ambitious, forward-thinking and diverse team that influences all areas of NVIDIA's AI platform and directly contributes to premiere Deep Learning frameworks - PyTorch, JAX and...


  • Santa Clara, United States NVIDIA Full time

    NVIDIA is hiring senior software engineers to build and optimize the tools Deep Learning engineers use across the world to design, develop, and deploy AI applications. We are an ambitious, forward-thinking and diverse team that influences all areas of NVIDIA's AI platform and directly contributes to premiere Deep Learning frameworks - PyTorch, JAX and...


  • Santa Clara, CA, United States NVIDIA Full time

    We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries! Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you! As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA...


  • Santa Clara, United States NVIDIA Full time

    We are now looking for a Senior Performance Software Engineer for Deep Learning Libraries! Do you enjoy tuning parallel algorithms and analyzing their performance? If so, we want to hear from you! As a deep learning library performance software engineer, you will be developing optimized code to accelerate linear algebra and deep learning operations on NVIDIA...


  • Santa Clara, CA, United States NVIDIA Full time

    We are hiring senior engineers to work on the CUDA driver and runtime, core components of our platform for accelerating general purpose computation on the GPU. Our team analyzes performance of applications, investigates bottlenecks in software or hardware and delivers features and improvements to better realize the potential of NVIDIA hardware for a growing...


  • Santa Clara, United States NVIDIA Full time

    NVIDIA is currently seeking a Senior Developer Technology Engineer for High-Performance Databases!Would you enjoy researching new algorithms and memory management techniques to accelerate databases on modern computer architectures? Do you like investigating hardware and system bottlenecks, and optimizing performance of data intensive applications? Are...


  • Santa Clara, United States CV Library Full time

    We are hiring senior engineers to work on the CUDA driver and runtime, core components of our platform for accelerating general purpose computation on the GPU. Our team analyzes performance of applications, investigates bottlenecks in software or hardware and delivers features and improvements to better realize the potential of NVIDIA hardware for a growing...


  • Santa Clara, CA, United States Cypress HCM Full time

    A medical device manufacturing client is looking to hire a new senior quality engineer for their catheter division of business! This Sr. Catheter Quality Engineer will develop, establish, and maintain quality engineering methodologies, systems and practices which meet customer and regulatory requirements. This role will be focused on providing quality...


  • Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior GPU Performance Architect to join our AI Applications team. As a key member of our architecture group, you will be responsible for designing and developing innovative GPU architectures that deliver the highest performance in the world for graphics processing.Your primary focus will be on competitive analysis and...

  • Performance Engineer

    3 weeks ago


    Santa Clara, CA, United States NVIDIA Full time

    NVIDIA is hiring software engineers at all experience levels to build and optimize the tools Deep Learning engineers use across the world to design, develop, and deploy AI applications. This position will embed you in an ambitious and diverse team that influences all areas of NVIDIA's AI platform and directly contributes to premiere Deep Learning frameworks...


  • Santa Clara, CA, United States Polaris Wireless Full time

    COMPANY AND POSITION SUMMARYCOMPANY:             Polaris WirelessPOSITION(S):           Senior Research EngineerABOUT POLARIS WIRELESSFounded in 2001, Polaris Wireless Inc. is the leading provider of US FCC compliant, high accuracy, software-based wireless location solutions to operators, law enforcement agencies and location-based...


  • Santa Clara, California, United States Applied Materials Full time

    About the Role:The Senior Mechanical Engineer is responsible for the design, development, and implementation of custom mechanical tooling, fixturing, and associated processes to enable the handling, assembly, and/or disassembly of parts, components, sub-assemblies, and final assemblies throughout the product life cycle. This position establishes standards...


  • Santa Clara, CA, United States Dell Full time

    Senior Principal Power Engineer As AI growth is accelerating, we’re developing ground-breaking technologies and customer solutions to lead the industry. These technologies are rapidly changing and we’re developing the supplier base and internal capabilities to always stay ahead of demand. We’re involved in assessing the competition, developing...


  • Santa Clara, California, United States Halo Industries, Inc. Full time

    Job Title: Senior Systems Automation EngineerJob Summary:Halo Industries, Inc. is seeking a highly skilled Senior Systems Automation Engineer to lead the development and integration of our groundbreaking semiconductor manufacturing technology. As a key member of our team, you will leverage your expertise in system design, integration, and automation to...

  • Performance Engineer

    3 weeks ago


    Santa Clara, United States NVIDIA Full time

    NVIDIA is hiring software engineers at all experience levels to build and optimize the tools Deep Learning engineers use across the world to design, develop, and deploy AI applications. This position will embed you in an ambitious and diverse team that influences all areas of NVIDIA's AI platform and directly contributes to premiere Deep Learning frameworks...


  • santa clara, United States Cypress HCM Full time

    A medical device manufacturing client is looking to hire a new senior quality engineer for their catheter division of business! This Sr. Catheter Quality Engineer will develop, establish, and maintain quality engineering methodologies, systems and practices which meet customer and regulatory requirements. This role will be focused on providing quality...


  • Santa Clara, United States Cypress HCM Full time

    A medical device manufacturing client is looking to hire a new senior quality engineer for their catheter division of business! This Sr. Catheter Quality Engineer will develop, establish, and maintain quality engineering methodologies, systems and practices which meet customer and regulatory requirements. This role will be focused on providing quality...


  • santa clara, United States Cypress HCM Full time

    A medical device manufacturing client is looking to hire a new senior quality engineer for their catheter division of business! This Sr. Catheter Quality Engineer will develop, establish, and maintain quality engineering methodologies, systems and practices which meet customer and regulatory requirements. This role will be focused on providing quality...


  • Santa Clara, United States Advanced Micro Devices , Inc. Full time

    Overview: WHAT YOU DO AT AMD CHANGES EVERYTHING We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences the building blocks for the data center, artificial intelligence, PCs, gaming and embedded....


  • Santa Clara, United States Advanced Micro Devices , Inc. Full time

    Overview: WHAT YOU DO AT AMD CHANGES EVERYTHING We care deeply about transforming lives with AMD technology to enrich our industry, our communities, and the world. Our mission is to build great products that accelerate next-generation computing experiences the building blocks for the data center, artificial intelligence, PCs, gaming and embedded....