Staff Machine Learning Engineer, Acceleration

Staff Machine Learning Engineer, Optimization Join to apply for the Staff Machine Learning Engineer, Optimization role at Waymo Staff Machine Learning Engineer, Optimization 5 days ago Be among the first 25 applicants Join to apply for the Staff Machine Learning Engineer, Optimization role at Waymo Get AI-powered advice on this job and more exclusive features. Waymo is an autonomous driving technology company with the mission to be the most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo DriverThe World's Most Experienced Driverto improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo One, a fully autonomous ride-hailing service, and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over one million rider-only trips, enabled by its experience autonomously driving tens of millions of miles on public roads and tens of billions in simulation across 13+ U.S. states. Waymo has successfully deployed self-driving cars in real-world environments now, our imperative is to scale this capability. Scale is driven by large models and data, and we are moving to ever-larger models which generalize by being trained on more data. To achieve this, we're focused on optimizing model inference and training, ensuring these advancements gracefully generalize across multiple platforms. In this role, you'll work embedded in an ML Engineering and Modeling team, working hand-in-hand to drive scale and multi-platform support of models. This role requires to follow the latest developments in efficient ML and bring those innovations to Waymos production systems. You Will Optimize neural model architectures and systems for high performance on multiple GPU and TPU platforms (e.g., onboard vs simulation platform) Optimize neural model performance and overall system performance for systems with hard real-time constraints (Waymos onboard system) Develop post-training algorithms (e.g., quantization), low-level optimizations (e.g., kernel optimization), etc. for improving inference speed and reducing inference memory consumption on modern GPU and TPU architectures Develop new neural model architectures (e.g., sparse architectures), decoding strategies (e.g., speculative decoding), etc. for improving inference performance on modern GPU and TPU architectures Optimize model training speed and efficiency for large models (often memory bound) and for fine-tuning (often i/o bound) Collaborate with ML infra teams (inference frameworks, training frameworks), Onboard hardware and Simulation teams, and Alphabets research teams You Must Have Masters degree or PhD in Computer Science, Engineering, or a related technical field 3+ years of experience in software development for neural model inference or neural model training, and 1+ years experience with neural model inference and training optimization on modern GPU/TPU architectures 5+ years experience in software development for real-time systems, ideally experience with real-time systems running on device (e.g., Waymos onboard system) Proficiency in C++, Python, and modern deep learning toolkits like PyTorch or JAX Passionate about low-level neural net optimization and willingness to learn new architectures and tools Deep understanding of latency and quality tradeoffs as it applies to neural network architectures and practical experience making said tradeoffs We Prefer Experience in ML-driven production systems that develops models with large-scale data, training, evaluation, and deployment Experience with developing and optimizing large-scale vision, video, or multi-modal foundation models Familiarity with end-to-end models and their development challenges Agility in a fast-paced environment The expected base salary range for this full-time position across US locations is listed below. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Your recruiter can share more about the specific salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during the hiring process. Waymo employees are also eligible to participate in Waymos discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements. Salary Range $238,000$302,000 USD Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Job function Engineering and Information Technology Industries Technology, Information and Internet Referrals increase your chances of interviewing at Waymo by 2x Sign in to set job alerts for Machine Learning Engineer roles. Software Engineer, Machine Learning (Multiple Levels) - Slack San Francisco, CA $167,300.00-$334,600.00 5 days ago Research Engineer - Machine Learning (ML) San Francisco, CA $180,000.00-$240,000.00 6 days ago San Francisco, CA $140,000.00-$180,000.00 6 months ago Machine Learning Engineer (I, II, or Sr.) Machine Learning Scientist, NLP (All Levels) San Francisco, CA $200,000.00-$300,000.00 5 months ago San Francisco, CA $140,000.00-$215,000.00 1 month ago Machine Learning Engineer (I, II, or Sr.) San Francisco, CA $140,000.00-$170,000.00 1 day ago Machine Learning Scientist, NLP (All Levels) San Francisco, CA $200,000.00-$300,000.00 4 months ago San Francisco, CA $150,000.00-$260,000.00 4 months ago San Francisco, CA $140,000.00-$160,000.00 5 months ago Burlingame, CA $140,000.00-$180,000.00 10 hours ago San Francisco, CA $100,000.00-$180,000.00 1 year ago Redwood City, CA $167,200.00-$250,800.00 5 days ago San Francisco, CA $140,000.00-$290,000.00 8 months ago San Francisco, CA $100,000.00-$300,000.00 2 weeks ago San Francisco, CA $88,000.00-$140,000.00 1 month ago San Francisco, CA $150,000.00-$250,000.00 1 month ago San Francisco, CA $175,000.00-$225,000.00 8 months ago San Mateo, CA $140,000.00-$210,000.00 1 month ago San Francisco, CA $130,000.00-$238,000.00 3 days ago San Francisco, CA $175,000.00-$250,000.00 1 month ago Machine Learning Engineer, AI (FULLY REMOTE) San Francisco, CA $176,600.00-$225,900.00 2 weeks ago Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr