Deep Learning CUDA Engineer with a Focus on Innovation

7 days ago


Palo Alto, California, United States xAI Full time

Company Overview:

xAI is a pioneering organization dedicated to developing cutting-edge AI systems that accurately understand the universe and aid humanity in its pursuit of knowledge.

We operate with a flat organizational structure, where all employees are expected to be hands-on and contribute directly to the company's mission. Leadership is given to those who show initiative and consistently deliver excellence.

The team is small, highly motivated, and focused on engineering excellence. We encourage engineers to work across multiple areas of the company, fostering a collaborative environment where all members share the title 'Member of Technical Staff.'

About the Role:

We are seeking an exceptional Deep Learning CUDA Engineer with a passion for innovation to join our team. The successful candidate will have a strong background in low-level CUDA kernel optimizations, proficiency in profiling and debugging tools such as Nsight, and experience implementing state-of-the-art deep learning techniques.

Key Responsibilities:

  • Developing and improving low-level CUDA kernel optimizations for inference and training software stack.
  • Profiling, debugging, and optimizing single and multi-GPU operations using tools like Nsight.
  • Implementing the latest methods from the deep learning literature in low-level CUDA kernels.
  • Innovating new ideas that bring us closer to the limits of a GPU.

Ideal Qualifications:

  • Experience building high-performance GeMM CUDA kernels using Tensor cores or CUDA cores from scratch or by utilizing CuTe/CUTLASS.
  • Familiarity with attention kernel implementation and ability to extend existing kernels or write them from scratch.
  • Strong understanding of register pressure, shared-memory usage, and GPU utilization through tools like Nsight.
  • Comfortable with writing both forward and backward kernels while considering floating point errors.
  • Optimizing for both memory-bound and compute-bound operations.

What We Offer:

A competitive salary range of $220,000 - $450,000 USD per annum, based on location and experience, plus benefits that include relocation assistance, flexible work arrangements, and opportunities for professional growth and development.

Interview Process:

The interview process typically consists of four technical interviews: coding assessment, systems hands-on, project deep-dive, and meet-and-greet with the wider team. All interviews are conducted via Google Meet and last approximately one week.



  • Palo Alto, California, United States Idaho Occupational Therapy Associaton Full time

    Job Title: Deep Learning EngineerCompany Overview: At ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC, we believe that collaboration and innovation are key to success in the field of artificial intelligence.Estimated Salary: $100,000 - $160,000 per year, depending on experience and qualifications.Job Description: We are seeking a skilled Deep Learning Engineer to...


  • Palo Alto, California, United States Mashgin Inc Full time

    Join Our Team!Mashgin Inc. is a dynamic and innovative company that's changing the way we shop. We're looking for a skilled Deep Learning Engineer for Image Analysis to join our team and help us take our products to the next level.Salary:$120,000 - $160,000 per yearJob Description:We're seeking a talented engineer to develop and implement cutting-edge deep...


  • Palo Alto, California, United States Tesla Full time

    We are looking for a talented Deep Learning Systems Developer to join our team at Tesla. As a key member of our team, you will be responsible for developing and implementing cutting-edge deep learning systems that drive innovation in AI and ML.ResponsibilitiesDevelop and implement deep learning systems that drive innovation in AI and ML.Collaborate with...


  • Palo Alto, California, United States Rivian Full time

    About RivianRivian is dedicated to building a more sustainable future through its innovative electric vehicles. The company's mission is centered around preserving the world's adventurous spirit and protecting the environment for future generations.As a leading player in the electric vehicle market, Rivian continuously challenges traditional approaches to...


  • Palo Alto, California, United States xAI Full time

    Machine Learning Expert WantedWe're xAI, a cutting-edge organization pushing the boundaries of artificial intelligence. Our mission is to create AI systems that can accurately understand the universe and drive human progress.We're looking for a talented Deep Learning Expert to join our team and help us achieve this ambitious goal. You'll work alongside...


  • Palo Alto, California, United States xAI Full time

    About xAIxAI is a cutting-edge artificial intelligence organization dedicated to creating sophisticated AI systems that can accurately understand the universe and contribute to humanity's pursuit of knowledge.We are a small, highly motivated team focused on engineering excellence. Our organization is ideal for individuals who appreciate challenging...


  • Palo Alto, California, United States Xai Full time

    Job Description and RequirementsAs an AI Engineer at xAI, you will be part of a dynamic team working on cutting-edge AI projects. Your primary responsibilities will include training trillion-parameter neural networks at scale, rapidly implementing state-of-the-art methods from the deep learning literature, and innovating new ideas for pre-training and...


  • Palo Alto, California, United States Salesforce Full time

    Job Summary:We're looking for a highly skilled Deep Learning Scientist to join our team at Salesforce. As a Deep Learning Scientist, you'll be responsible for designing and developing novel deep learning models and algorithms that can be applied to real-world problems.About Salesforce:Salesforce is a cloud-based software company that provides customer...


  • Palo Alto, California, United States Arc Institute Full time

    We are seeking an experienced machine learning research engineer to join our team at Arc Institute in Palo Alto, California. As a researcher in our institute, you will contribute to the development and application of Arc's frontier DNA foundation model (Evo) and Arc's Virtual Cell Initiative.About the positionThis role requires an experienced machine...


  • Palo Alto, California, United States Idaho Occupational Therapy Associaton Full time

    Job OverviewWe are seeking a highly skilled Senior Deep Learning Research Scientist to join our team at HP Labs. As a member of our research team, you will have the opportunity to work on cutting-edge projects in the field of machine learning, focusing on applications such as computer vision, natural language processing, and reinforcement learning.About the...


  • Palo Alto, California, United States AppLovin Full time

    **Company Overview:**At AppLovin, we leverage cutting-edge technology to connect businesses with their potential customers. Our innovative platform utilizes advanced machine learning capabilities to rival those of industry giants.**Salary and Benefits:**We offer a competitive compensation package, including top-tier salaries in the industry, estimated at...


  • Palo Alto, California, United States AppLovin Full time

    OverviewWe are at the forefront of advertising technology, leveraging advanced machine learning technologies to connect businesses with their potential customers.Salary & BenefitsThe competitive compensation package includes a top-tier salary in the range of $180,000 - $250,000 per year, as well as comprehensive benefits such as free medical, dental, and...


  • Palo Alto, California, United States Salesforce Full time

    Role OverviewWe are seeking an exceptional Deep Learning Research Scientist to join our team at Salesforce. As a research scientist, you will play a crucial role in advancing the state of the art in AI and driving innovation in large-scale Generative AI, Natural Language Processing (NLP), and Deep Learning.About the RoleThis is a unique opportunity to work...


  • Palo Alto, California, United States Tesla Full time

    Tesla is committed to developing humanoid bi-pedal robots at scale to automate repetitive and mundane tasks in manufacturing and logistics. This initiative presents a unique opportunity to work on cutting-edge neural network algorithms for deep learning, culminating in their deployment to real-world production applications.Our team of deep learning research...


  • Palo Alto, California, United States Quantum Technologies USA Full time

    Job Description: We are seeking a highly skilled Deep Learning Expert to join our research team at Quantum Technologies USA. As a key member of our team, you will be responsible for developing and applying advanced machine learning techniques to solve complex problems in various industries.About the Role: This is a full-time position with an estimated salary...


  • Palo Alto, California, United States ETHEREUM TECHNOLOGIES LLC Full time

    Job OverviewWe are seeking a highly skilled Deep Learning Researcher to join our team at Ethereum Technologies LLC. This is an excellent opportunity for a motivated individual to work on cutting-edge projects in the field of Artificial Intelligence.The ideal candidate will have a Ph.D. degree in Artificial Intelligence, Machine Learning, Robotics, or a...


  • Palo Alto, California, United States EarnIn Full time

    At EarnIn, we're pioneers in earned wage access, dedicated to delivering real-time financial flexibility for individuals living paycheck to paycheck. Our products empower community members to access their earnings as they earn them, without mandatory fees, interest rates, or credit checks.We have a world-class leadership team and top-notch funding partners...


  • Palo Alto, California, United States Pinterest Job Advertisements Full time

    We're looking for a skilled Machine Learning Engineer II to join our team at Pinterest.As a Machine Learning Engineer II, you'll be responsible for developing and implementing machine learning models that enable visually rich experiences on our platform. You'll work closely with our cross-functional teams to design and develop clean, efficient, and...


  • Palo Alto, California, United States Matroid Full time

    Join us at MatroidWe're seeking an accomplished AI Deployment Specialist to spearhead the development and implementation of cutting-edge computer vision systems. With a strong background in deep learning and computer vision, you'll be responsible for designing and deploying state-of-the-art models, integrating them into existing workflows, and ensuring...


  • Palo Alto, California, United States Robotics Prcocess Automation, LLC Full time

    About the Role    We are seeking a highly skilled Senior Machine Learning Research Scientist to join our team and lead advanced research projects in various industries, including healthcare, finance, and manufacturing. As part of our team, you will work on developing cutting-edge machine learning solutions and collaborating with experts across multiple...