Senior Deep Learning Profiling Tools Engineer

4 weeks ago


Santa Clara, California, United States Nvidia Full time
Job Description

NVIDIA's Deep Learning Architecture and Libraries Group is seeking a software engineer to contribute to the development of our performance analysis capabilities. As a member of our team, you will collaborate with GPU architects, CUDA developers, and deep learning performance engineers to design and implement innovative approaches to hardware and software profiling.

Your work will focus on developing software tools to profile and analyze AI workloads on NVIDIA systems, working with multi-disciplinary teams to design, implement, and verify new features for profiling and monitoring. You will also define software/hardware metrics for performance analysis of AI workloads and verify them for upcoming architectures.

Key Responsibilities:

  • Design and develop software tools to profile and analyze AI workloads on NVIDIA systems
  • Work with multi-disciplinary teams to design, implement, and verify new features for profiling and monitoring
  • Define software/hardware metrics for performance analysis of AI workloads and verify them for upcoming architectures

Requirements:

  • Bachelors, Masters, or PhD in relevant field (e.g. CS, EE, CE) or equivalent experience
  • 8+ years of relevant experience (including graduate work if applicable)
  • Proficiency in C++ and Python
  • Experience with deep learning Frameworks (e.g. PyTorch, JAX, TRT, ONNX, Triton) and strong understanding of deep learning fundamentals
  • Strong computer science fundamentals - algorithms, data structures, optimization, debugging, operating systems, and parallel computing

Preferred Qualifications:

  • Experience with performance analysis of AI training/inference applications
  • Knowledge of device drivers and/or compiler implementation
  • Knowledge of GPU and/or CPU architecture and general computer architecture principles

NVIDIA offers a competitive salary range of $180,000 - $276,000, as well as equity and benefits. We are committed to fostering a diverse work environment and are an equal opportunity employer.



  • Santa Clara, California, United States NVIDIA Full time

    We are seeking a Senior Deep Learning Algorithm Engineer to join our team at NVIDIA. As a key member of our team, you will be responsible for optimizing deep learning training workloads on state-of-the-art hardware and software platforms.Key Responsibilities:Understand, analyze, profile, and optimize deep learning training workloads on state-of-the-art...


  • Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly experienced software professional to join our team and contribute to the development of next-generation distributed backends for premier Deep Learning frameworks.You will work on building a platform that can scale a wide range of model architectures to thousands of GPUs, leveraging validated task-based runtime systems like Legate,...


  • Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Software Engineer to join our Deep Learning Inference Workflows team. As a key member of our team, you will be responsible for developing components of TensorRT, NVIDIA's SDK for high-performance deep learning inference.Key Responsibilities: Develop graph parsers, optimizers, and tools for effective deployment of...


  • Santa Clara, California, United States XPENG Motors Full time

    Job Title: Senior Deep Learning EngineerAbout the Role:We are seeking a highly skilled Senior Deep Learning Engineer to join our team at XPeng Motors. As a key member of our autonomous driving team, you will be responsible for researching, implementing, and evaluating deep-learning-based methods for prediction and planning problems.Responsibilities:*...


  • Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Software Engineer to join our Deep Learning software team. As a key member of our team, you will be responsible for developing components of TensorRT, NVIDIA's SDK for high-performance deep learning inference.Key Responsibilities:Develop graph parsers, optimizers, and tools for effective deployment of trained deep...


  • Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Software Engineer to join our Deep Learning software team. As a key member of our team, you will be responsible for developing components of TensorRT, NVIDIA's SDK for high-performance deep learning inference.Key Responsibilities:Develop graph parsers, optimizers, and tools for effective deployment of trained deep...


  • Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Deep Learning Software Engineer to design and build our automated inference and deployment solution.As part of the team, you will play a pivotal role in architecting and designing a modular and scalable software platform to provide an excellent user experience with broad model support and optimization...


  • Santa Clara, California, United States NVIDIA Full time

    Join Our Team of InnovatorsWe're seeking a highly skilled Senior Deep Learning Software Engineer to join our cuDNN team at NVIDIA. As a key member of our team, you'll play a crucial role in designing, building, and shipping our GPU-accelerated library of primitives for deep neural networks.About the RoleAs a Senior Deep Learning Software Engineer, you'll be...


  • Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Deep Learning Software Engineer to join our Solution Engineering-Automotive Deep Learning team. As a key member of our team, you will be responsible for developing and productizing NVIDIA's deep learning solutions in autonomous driving vehicles.Key responsibilities include:Developing new deep learning architectures and...


  • Santa Clara, California, United States NVIDIA Full time

    We are seeking a highly skilled Senior Deep Learning Software Engineer to develop and productize NVIDIA's deep learning solutions in autonomous driving vehicles.The ideal candidate will have a strong background in deep learning and experience with NVIDIA's software libraries, including CUDA and TensorRT.As a member of our Solution Engineering-Automotive Deep...


  • Santa Clara, California, United States NVIDIA Full time

    We're seeking a highly skilled Senior Deep Learning Software Engineer to join our cuDNN team at NVIDIA. As a key member of our team, you will be responsible for designing, building, and shipping cuDNN, our GPU-accelerated library of primitives for deep neural networks.Key Responsibilities:Develop production-quality software that ships as part of NVIDIA's AI...


  • Santa Clara, California, United States NVIDIA Full time

    NVIDIA is a leader in the field of deep learning, and we're seeking a talented Senior System Software Engineer to join our team. As a key member of our deep learning software engineering team, you will be responsible for optimizing deep learning algorithms for training and inference, as well as integrating them into existing systems and tools.Key...


  • Santa Clara, California, United States NVIDIA Full time

    We're seeking a Senior Deep Learning Software Engineer to join our cuDNN teamDo you enjoy crafting software systems to solve complex problems and writing fast code? We're looking for skilled software engineers to help design, build, and ship cuDNN: our GPU-accelerated library of primitives for deep neural networks. The era of AI has begun, and we're powering...


  • Santa Clara, California, United States NVIDIA Full time

    As a Senior MLOps Engineer, you will play a key role in building software that will be used by the entire world. You will work with high-class software engineers to implement a large-scale toolset that tests deep learning models and frameworks on the most powerful computers.The ability to work in a multifaceted, fast-paced environment is required, as well as...


  • Santa Clara, California, United States NVIDIA Full time

    At NVIDIA, we're building software that will be used by the entire world. As a Senior MLOps Engineer, Deep Learning Algorithms, you'll work with high-class software engineers to implement a large-scale toolset that tests deep learning models and frameworks on the most powerful computers.The ability to work in a multifaceted, fast-paced environment is...


  • Santa Clara, California, United States NVIDIA Full time

    Job SummaryWe're seeking a highly skilled Senior Deep Learning Software Engineer to join our cuDNN team. As a key member of our team, you will be responsible for designing, building, and shipping cuDNN, a GPU-accelerated library of primitives for deep neural networks.Key Responsibilities- Develop production-quality software that ships as part of NVIDIA's AI...


  • Santa Clara, California, United States NVIDIA Full time

    At NVIDIA, we're building software that will be used by the entire world. As a Senior MLOps Engineer, Deep Learning Algorithms, you'll work with high-class software engineers to implement a large-scale toolset that tests deep learning models and frameworks on the most powerful computers.The ability to work in a multifaceted, fast-paced environment is...


  • Santa Clara, California, United States NVIDIA Full time

    Job SummaryNVIDIA is seeking a highly skilled Senior Software Engineer to join our TensorRT team in developing industry-leading deep learning inference software for NVIDIA AI accelerators. As a Senior Software Engineer, you will be responsible for designing and implementing inference optimizations to enable real-time AI applications on personal computing...


  • Santa Clara, California, United States NVIDIA Full time

    Senior Performance Software Engineer for Deep Learning LibrariesWe are seeking a highly skilled Senior Performance Software Engineer to join our team in developing optimized code for NVIDIA GPUs. As a key member of our Deep Learning Library team, you will be responsible for writing highly tuned compute kernels in C++ CUDA to perform core deep learning...


  • Santa Clara, California, United States NVIDIA Full time

    NVIDIA is a leader in the generative AI revolution, and our Algorithmic Model Optimization Team is at the forefront of optimizing generative AI models for maximal inference efficiency. Our team focuses on techniques ranging from neural architecture search and pruning to sparsity, quantization, and automated deployment strategies.We conduct applied research...