Tech Lead, ML Infrastructure

3 days ago


Mountain View CA United States Nuro, Inc. Full time

Who We Are 

Nuro exists to better everyday life through robotics. Founded in 2016, Nuro is a leading autonomous technology company with vehicles on road today in California and Texas. The company’s core technology is the Nuro Driver, an integrated autonomous driving system consisting of state-of-the-art, AI-first software and custom-built sense and compute hardware. The first commercial application of the Nuro Driver is autonomous goods delivery with our custom, electric, zero-occupant vehicles in partnership with some of the most recognized brands in the world including Uber and FedEx.

About the Role

The ML Infra team is growing and we are looking for talented engineers to join us. Nuro is pursuing an ML-first software stack. Our team provides solutions to empower machine learning development in Nuro and optimize on-cloud training and onboard inference. Our solutions include a distributed training platform, ML compiler, model components libraries, e.t.c. We are looking for a tech lead to drive the initiatives in distributed training and inference optimization, the key technology to scale our deep learning models to achieve higher performance. 

About the Work

  • Lead the exploration of the latest technology of distributed training and inference optimization.
  • Dive deep into the pain points of ML teams and understand model development bottlenecks.
  • Define and drive the technical strategy for model optimization.
  • Collaborate with ML teams to ensure smooth adoption of the model optimization solutions.
  • Promote engineering best practices and cultivate a culture of continuous improvement in the team.

About You

  • 6+ years of work or research experience in ML Infra, distributed training, model inference or GPU programming.
  • Knowledge in using at least one deep learning framework, e.g. Tensorflow, Pytorch, JAX. Be able to understand deep learning algorithms, e.g. computer vision, NLP, behavior planning.
  • Proficient in C++/C and Python. Strong coding ability.
  • Strong communication and teamwork skills. Be passionate about exploring and promoting cutting edge technology.

Bonus Points  

  • Experience with CUDA, Cublas, Cudnn or any other Nvidia SDKs.
  • Experience with model quantization or pruning.
  • Experience with compilers or ML compilers (e.g. TensorRT, Triton, XLA, Clang).
  • Experience with AI algorithms and hardware codesign (e.g. Depthwise Conv, Flash Attention).
  • Experience with distributed training speedup (e.g. FSDP, DeepSpeed).

At Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $202,350 and $303,050 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.

At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics.

#J-18808-Ljbffr

  • San Jose, CA, United States Cisco Systems, Inc. Full time

    Tech Lead – AI/ML Infrastructure Engineer Location: San Jose, California, US Compensation Range: 173100 USD - 241700 USD Job Type: Professional Job Id: 1426055 Application window has been extended and expected to close 11/15/2024. Who We Are: The Cisco Distributed System Engineering (DSE) group is at the forefront of developing products that power the...


  • Mountain View, California, United States Waymo Full time

    About WaymoWaymo is a pioneering autonomous driving technology company dedicated to revolutionizing the way people move. With a mission to be the most trusted driver, we have been at the forefront of this industry since its inception as the Google Self-Driving Car Project in 2009.Our journey has been marked by significant milestones, including providing over...


  • Mountain View, United States NewsBreak Full time

    Job DescriptionJob DescriptionAbout NewsBreakNewsBreak is redefining the way users interact with local news and their communities. By bridging local users, local content creators, and local businesses, our mission is to foster safer, more vibrant, and authentically connected lives. Through robust collaborations with thousands of local publishers and...


  • Mountain View, United States Nuro Full time

    Who We Are Nuro exists to better everyday life through robotics. Founded in 2016, Nuro has spent eight years developing autonomous driving (AD) technology and commercializing AD applications. The Nuro Driver™ is our world-class autonomous driving system that combines AD hardware with our generalized AI-first self-driving software. Built to learn and...


  • Mountain View, United States Nuro Full time

    Who We Are Nuro exists to better everyday life through robotics. Founded in 2016, Nuro has spent eight years developing autonomous driving (AD) technology and commercializing AD applications. The Nuro Driver™ is our world-class autonomous driving system that combines AD hardware with our generalized AI-first self-driving software. Built to learn and...


  • Mountain View, CA, United States Acceler8 Talent Full time

    Founding AI/ML + LLM EngineerIntroduction: We're seeking a Founding AI/ML + LLM Engineer to join our team. This role is a unique opportunity to leverage your expertise in AI/ML and large language models (LLMs) to revolutionize the chip design industry. As a Founding AI/ML + LLM Engineer, you'll play a crucial part in developing the core technology that will...


  • Mountain View, CA, United States Gatik Full time

    Who we are Gatik, the leader in autonomous middle-mile logistics, is revolutionizing the B2B supply chain with its autonomous transportation-as-a-service (ATaaS) solution and prioritizing safe, consistent deliveries while streamlining freight movement by reducing congestion. The company focuses on short-haul, B2B logistics for Fortune 500 retailers and in...


  • Mountain View, California, United States NewsBreak Full time

    Company Overview:NewsBreak is a pioneering local news app that has revolutionized the way users interact with their communities. Founded in 2015, the company has established itself as the nation's premier local news provider, bridging local users, content creators, and businesses across the nation.The company's headquarters is located in the tech hub of...


  • mountain view, United States Acceler8 Talent Full time

    Founding AI/ML + LLM EngineerIntroduction: We're seeking a Founding AI/ML + LLM Engineer to join our team. This role is a unique opportunity to leverage your expertise in AI/ML and large language models (LLMs) to revolutionize the chip design industry. As a Founding AI/ML + LLM Engineer, you'll play a crucial part in developing the core technology that will...


  • mountain view, United States Acceler8 Talent Full time

    Founding AI/ML + LLM EngineerIntroduction: We're seeking a Founding AI/ML + LLM Engineer to join our team. This role is a unique opportunity to leverage your expertise in AI/ML and large language models (LLMs) to revolutionize the chip design industry. As a Founding AI/ML + LLM Engineer, you'll play a crucial part in developing the core technology that will...


  • Mountain View, United States Acceler8 Talent Full time

    Founding AI/ML + LLM EngineerIntroduction: We're seeking a Founding AI/ML + LLM Engineer to join our team. This role is a unique opportunity to leverage your expertise in AI/ML and large language models (LLMs) to revolutionize the chip design industry. As a Founding AI/ML + LLM Engineer, you'll play a crucial part in developing the core technology that will...


  • Mountain View, United States US Tech Solutions Full time

    Job Description:The client is building products that predict and simulate Earth systems and how they interact with the built environment. They believe mapping and measuring changes to the human and natural world will help them manage climate-related risks. The goal is to enable users to understand how mitigation actions would shift their risk...


  • Mountain View, California, United States NewsBreak Full time

    About NewsBreakNewsBreak is revolutionizing the way users interact with local news and their communities by bridging local users, content creators, and businesses.We foster safer, more vibrant, and authentically connected lives through robust collaborations with thousands of local publishers and businesses across the nation.Our MissionWe are redefining the...

  • Lead Engineer

    1 week ago


    Mountain View, California, United States Coupang Full time

    About UsCoupang is a pioneering e-commerce company that has disrupted the multi-billion-dollar industry with its innovative approach to making shopping, eating, and living easier than ever. Our mission is to build the future of commerce, pushing the boundaries of what's possible to solve problems and break traditional tradeoffs.Job OverviewWe are seeking an...

  • Founding Engineer

    1 month ago


    Mountain View, CA, United States Acceler8 Talent Full time

    Founding Engineer (AI/ML/LLM)IntroductionWe're seeking a Founding Engineer (AI/ML/LLM) with a passion for transforming chip design processes through cutting-edge technology. If you have significant experience in AI/ML and large language models, this is an opportunity to apply your skills in a challenging and dynamic environment. Your work will directly...


  • Mountain View, CA, United States Nuro, Inc. Full time

    Who We Are Nuro exists to better everyday life through robotics. Founded in 2016, Nuro has spent eight years developing autonomous driving (AD) technology and commercializing AD applications. The Nuro Driver is our world-class autonomous driving system that combines AD hardware with our generalized AI-first self-driving software. Built to learn and improve...


  • Mountain View, United States Nuro, Inc. Full time

    Who We Are  Nuro exists to better everyday life through robotics. Founded in 2016, Nuro is a leading autonomous technology company with vehicles on road today in California and Texas. The company’s core technology is the Nuro Driver, an integrated autonomous driving system consisting of state-of-the-art, AI-first software and custom-built sense and...


  • Mountain View, United States Nuro Full time

    Who We Are Nuro exists to better everyday life through robotics. Founded in 2016, Nuro has spent eight years developing autonomous driving (AD) technology and commercializing AD applications. The Nuro Driver is our world-class autonomous driving system that combines AD hardware with our generalized AI-first self-driving software. Built to learn and improve...

  • Founding Engineer

    3 months ago


    mountain view, United States Acceler8 Talent Full time

    Founding Engineer (AI/ML/LLM)IntroductionWe're seeking a Founding Engineer (AI/ML/LLM) with a passion for transforming chip design processes through cutting-edge technology. If you have significant experience in AI/ML and large language models, this is an opportunity to apply your skills in a challenging and dynamic environment. Your work will directly...

  • Founding Engineer

    4 weeks ago


    Mountain View, United States Acceler8 Talent Full time

    Founding Engineer (AI/ML/LLM)IntroductionWe're seeking a Founding Engineer (AI/ML/LLM) with a passion for transforming chip design processes through cutting-edge technology. If you have significant experience in AI/ML and large language models, this is an opportunity to apply your skills in a challenging and dynamic environment. Your work will directly...