Staff Software Engineer, ML Data Platform Specialist

4 weeks ago

San Francisco, California, United States Cruise Full time
Job Description

We're Cruise, a self-driving service designed for the cities we love. Our mission is to build the world's most advanced self-driving vehicles to safely connect people to the places, things, and experiences they care about.

We believe self-driving vehicles will help save lives, reshape cities, give back time in transit, and restore freedom of movement for many. Our cars are designed to be safe, reliable, and efficient, and we're committed to making them accessible to everyone.

As a Staff Software Engineer, ML Data Platform, you will be responsible for building and supporting a petabyte-scale data platform in the cloud. You will work with our team to develop powerful foundations for Cruise's ML Data Platform tools, frameworks, and services.

Responsibilities include:

  • Ensuring scalable, transparent, and reliable data ingestion and management
  • Development of fast, robust, and spike-resistant data consumption, data mining, and processing tools for the entire company
  • Development of orchestration for large-scale post-processing, and computational pipelines

What you'll be doing:

Lead us in the development, optimization, and productionization of the next generation data processing platform using Beam and Spark in the cloud. Build self-serve capabilities to help customers adopt the next generation data processing platform. Use the latest cloud technologies to own, design, implement, and test scalable distributed data systems in the cloud. Champion engineering excellence by continuously improving systems and processes.

What you must have:

  • Experience building a data processing system using Beam / Spark and its ecosystems from the ground up
  • Experience optimizing those data processing clusters for cost efficiency and performance
  • Experience building serving systems capable of delivering data at high-throughput, low-latency, and high QPS in a cost-efficient and spike-resilient manner
  • Experience building full ML model lifecycle solutions - from feature engineering to training, validation, deployment, and monitoring
  • Experience building scalable infrastructure on the cloud with Python or Java/Scala (or similar)
  • 10+ years working with big data
  • BS, MS, or Ph.D. in Computer Science, Electrical Engineering, Mathematics, Physics, or another relevant field; or equivalent real-world experience
  • Passionate about self-driving technology and its potential impact on the world
  • Attention to detail and a passion for seeking truth
  • A track record of efficiently solving complex problems
  • Startup mentality - openness to dealing with unknown unknowns and wearing many hats

Bonus points:

  • Demonstrable expertise in building end-to-end data ingestion, processing, and serving systems at petabyte scale from the ground up
  • Proficiency in writing SQL queries for analytic purposes
  • Relevant publications

Why Cruise?

We're committed to building a diverse, equitable, and inclusive environment, both in our workplace and in our products. We believe that self-driving technology has the potential to make a positive impact on the world, and we're looking for talented individuals to join our team and help us achieve our mission.

We offer a competitive salary and benefits package, including medical, dental, and vision insurance, as well as a 401(k) matching program. We're also committed to providing opportunities for professional growth and development, including training and education programs.

How to Apply:

If you're passionate about self-driving technology and want to be part of a team that's changing the world, we encourage you to apply. Please submit your resume and a cover letter explaining why you're a good fit for this role. We can't wait to hear from you

  • Staff Software Engineer

    4 weeks ago

    San Francisco, California, United States Linktree Full time

    About the RoleAs a Staff Software Engineer on Linktree's Data Platform team, you will play a critical role in designing and building a robust, scalable data platform that drives innovative experiences in our core product.Your contributions will unlock new opportunities for our tens of millions of users and our billions of visitors around the world, helping...

  • Senior Software Engineering, Data Platform Specialist

    4 weeks ago

    San Francisco, California, United States Instabase Full time

    Unlock the Power of AI and MLAt Instabase, we're passionate about harnessing the potential of cutting-edge AI innovation to empower organizations to tackle complex unstructured data challenges.With a strong focus on customer-centricity, our market opportunity is vast and ever-expanding.We're seeking a talented Senior Software Engineer to join our team and...

  • Staff Software Engineer, Machine Learning Platform Specialist

    4 weeks ago

    San Francisco, California, United States Discord Full time

    Machine Learning Platform Software EngineerDiscord is a leading platform for gamers and communities, with over 200 million active users each month. Our platform plays a unique role in the future of gaming, and we're looking for a skilled software engineer to join our Machine Learning Platform team.This position is responsible for designing and building the...

  • Staff Software Engineer, ML Ops

    4 weeks ago

    San Francisco, California, United States Ripple Full time

    About the RoleWe are seeking a highly skilled Staff Software Engineer, ML Ops to join our team at Ripple. As a key member of our engineering team, you will be responsible for designing and implementing scalable, auditable, and maintainable machine learning services.Key ResponsibilitiesBuild the platform and tools to enable scalable, auditable, and...

  • Software Engineer

    2 days ago

    San Francisco, California, United States Eventual Computing Full time

    About Eventual ComputingEventual Computing is a cutting-edge data platform that empowers data scientists and engineers to build scalable data applications across ETL, analytics, and ML/AI.We are on a mission to bridge the gap between traditional tabular data analytics and modern ML/AI workloads. Our open-source distributed data engine, Daft, runs on 800k CPU...

  • Senior Software Engineer, Data and ML Infrastructure Specialist

    4 weeks ago

    San Francisco, California, United States Unity Technologies Full time

    Job DescriptionUnity Technologies is seeking a talented Senior Data and ML Infrastructure Engineer to join our team. As a key member of our Data & ML Platform team, you will collaborate with engineers, product specialists, and data experts to research, prototype, and develop world-class applications, services, and pipelines, leveraging over 60 billion daily...

  • Lead Data Platform Engineer

    4 weeks ago

    San Francisco, California, United States Sephora Full time

    About the Role:We are seeking a highly skilled Lead Data Platform Engineer to join our team at Sephora. As a key member of our technology group, you will be responsible for driving ML initiatives for the enterprise and developing innovative solutions to help our customers discover products.Key Responsibilities:Operationalize ML solutions and work alongside...

  • AI/ML Infrastructure Engineer, GenAI Platform

    3 weeks ago

    San Francisco, California, United States Magical Tome Full time

    About TomeTome is a cutting-edge platform that empowers enterprise sellers and account managers to simplify complex research and strategic planning. Our state-of-the-art models leverage thousands of data sources to surface actionable knowledge about customers. A team of experienced sellers, engineers, and researchers tunes and customizes our system to meet...

  • Senior Software Engineer, Machine Learning Platform Specialist

    4 weeks ago

    San Francisco, California, United States Discord Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our Machine Learning Platform team at Discord. As a key member of our team, you will be responsible for designing and building the platform that ML engineers and data scientists use to understand and delight Discord's users and keep them safe.Key ResponsibilitiesDesign and build...

  • AI/ML Engineer

    4 weeks ago

    San Francisco, California, United States WEX Inc Full time

    About the RoleWe are seeking a highly motivated and results-oriented AI/ML Engineer to join our team at WEX Inc. As a key member of our AI Engineering team, you will be responsible for designing, testing, and deploying AI/ML platforms and tools to drive business growth and customer satisfaction.Key ResponsibilitiesCollaborate with stakeholders to understand...

  • Staff Software Engineer, Data Platform Specialist

    3 weeks ago

    San Francisco, California, United States CHAOS Industries Full time

    CHAOS Inc. Overview:CHAOS Industries is a global technology company delivering cutting-edge capabilities to the defense and critical industrial sectors. Founded in 2022 by a seasoned leadership team, CHAOS has established itself as the go-to platform for world-class engineers to build mission-critical technologies.Role Overview:This is a highly collaborative...

  • Senior Staff Machine Learning Engineer, Platform

    1 month ago

    San Francisco, California, United States Databricks Full time

    About the Role:We are seeking a highly skilled Senior Staff Machine Learning Engineer to join our team at Databricks. As a technical lead, you will oversee and supervise projects and engineers on the team, playing a key role in building our Generative AI platform and products.Key Responsibilities:Design and implement our ML infrastructure and GenAI platform...

  • Senior Staff Machine Learning Engineer, Platform Development

    4 weeks ago

    San Francisco, California, United States Databricks Full time

    About the Role:We are seeking a highly skilled Senior Staff Machine Learning Engineer to play a key role in building our Generative AI platform and products. As a technical lead, you will oversee and supervise projects and engineers on the team, driving our technology vision and roadmap.Key Responsibilities:Design and implement our ML infrastructure and...

  • Senior Staff Machine Learning Engineer

    3 weeks ago

    San Francisco, California, United States Databricks Full time

    Pioneering a cutting-edge Generative AI platform, Databricks is seeking a highly skilled Senior Staff Machine Learning Engineer to spearhead the development of our ML infrastructure and drive our technology vision & roadmap.Key Responsibilities:• Oversee projects and engineers, ensuring seamless collaboration and technical excellence.• Design and...

  • Staff Software Engineer, Platform Specialist

    1 month ago

    San Francisco, California, United States Technacity Group Full time

    Job DescriptionWe are seeking a highly skilled Staff Software Engineer, Platform Specialist to join our team at Technacity Group. As a key member of our Platform team, you will be responsible for developing our multi-platform game engine and building toward our vision of a "write once, run anywhere" game engine.Key Responsibilities:Develop game engine...

  • Senior Software Engineer, Platform

    4 weeks ago

    San Francisco, California, United States Galileo Co. Full time

    About Galileo Co.Galileo Co. is a leading-edge technology company founded in 2021 by a team of seasoned engineering leaders from Google AI and Uber AI. With over $23M in funding and backed by top-tier investors, Galileo Co. is poised to revolutionize the AI/ML industry with its cutting-edge Large Language Model (LLM) evaluation and experimentation...

  • Staff Software Engineer, Data Platform

    4 weeks ago

    San Francisco, California, United States Chaos Industries Full time

    CHAOS Inc. is a global technology company delivering next-generation capabilities to the defense and critical industrial sectors.Founded in 2022 by a seasoned leadership team, CHAOS has quickly become the place where world-class multi-disciplinary engineers come to build mission-critical technologies.CHAOS has a mission-focused culture, dedicated to solving...

  • Data Platform Engineer

    4 weeks ago

    San Francisco, California, United States Robust Intelligence Full time

    About the RoleWe are seeking a highly skilled Data Platform Engineer to join our ML Data and Quality team at Robust Intelligence. As a key member of our team, you will be responsible for building the ML data infrastructure based on the requirements of the ML team and the product needs.Key Responsibilities:Design, develop, and deploy innovative AI solutions...

  • Software Engineer, AI/ML Infrastructure Specialist

    4 weeks ago

    San Francisco, California, United States Together AI Full time

    Job ResponsibilitiesInfrastructure Development:Identify and resolve infrastructure gaps to ensure reliable, efficient, and scalable AI/ML solutions.AI/ML Solutions:Develop advanced AI/ML infrastructure solutions to enhance the efficiency of our ML teams, leveraging expertise in distributed systems and large-scale data processing.System Design:Design and...

  • Data Platform Manager

    4 weeks ago

    San Francisco, California, United States Grammarly Full time

    About the RoleWe are seeking a highly skilled and experienced Data Platform Manager to join our team at Grammarly. As a key member of our Data Platform team, you will be responsible for managing and evolving our data infrastructure, engineering, and governance processes to support modern machine learning (ML) use cases, self-serve analytics, and data policy...