Petabyte-Scale Data Architect

6 days ago


San Francisco, California, United States Cruise Full time
Join Cruise's Data Science Team:

We're looking for a talented Staff Software Engineer to join our team as a key member of our ML Data Platform. As a member of our team, you will be responsible for designing, developing, and deploying large-scale data systems in the cloud. Your expertise in Beam and Spark will be instrumental in building a next-generation data processing platform that enables fast, reliable, and scalable data ingestion and management.

This is an exceptional opportunity to work on a high-impact project that has the potential to transform the way we live and work. If you are passionate about self-driving technology and have a strong background in software engineering, we encourage you to apply.

About You:
  • You have 10+ years of experience working with big data.
  • You are proficient in Python or Java/Scala and have experience building scalable infrastructure in the cloud.
  • You have a deep understanding of data processing systems and can design and develop efficient solutions.
  • You are passionate about self-driving technology and have a strong desire to contribute to a project that has the potential to make a significant impact.

Salary Range: $175,100 - $257,500 per year.

Benefits:
  • Competitive salary and benefits package.
  • Medical, dental, and vision insurance.
  • 401(k) matching program.
  • Fertility benefits.
  • Dependent care flexible spending account.
  • Flexible spending account and health savings account.


  • San Francisco, California, United States Genmo Full time

    About the RoleWe are seeking an experienced Senior/Staff AI Infra Engineer to join our team at Genmo.Job Summary:As a Senior/Staff AI Infra Engineer, you'll be responsible for designing, building, and scaling our petabyte-scale data infrastructure.Key Responsibilities:Design highly scalable data infrastructure and systems to process petabyte-scale data...


  • San Diego, California, United States Apple Full time

    **About the Role:**We are seeking an experienced Site Reliability Engineer to join our Data Analytics team at Apple. As a key member of our team, you will be responsible for building, monitoring, and troubleshooting complex data infrastructure at the petabyte scale.**Responsibilities:**Builddesign, deploy, and manage complex data infrastructure at the...


  • San Francisco, California, United States Genmo Full time

    About UsGenmo is a research lab dedicated to building open, state-of-the-art models for video generation towards unlocking the right brain of AGI.Job OpportunityWe're seeking a skilled Data Infrastructure Engineer to join our team and contribute to the development of our petabyte-scale data infrastructure.Responsibilities:Design and implement scalable data...


  • San Francisco, California, United States Genmo Full time

    We are Genmo, a research lab dedicated to building open, state-of-the-art models for video generation towards unlocking the right brain of AGI. Our team is extremely technical with leaders in distributed systems, GPU programming and large-scale training.Job OverviewWe're seeking an experienced Senior/Staff AI Infra Engineer to design, build, and scale our...


  • San Jose, California, United States Tik Tok Full time

    TikTok is a leading short-form mobile video platform that inspires creativity and brings joy to its users worldwide. As a Senior Data Architect at TikTok, you will play a crucial role in shaping the company's data strategy and developing real-time data solutions that drive business growth.Job DescriptionIn this role, you will be responsible for designing and...


  • San Francisco, California, United States Lambda Inc. Full time

    About the RoleWe are seeking an experienced Data Storage Solutions Architect to join our team at Lambda Inc. This is a unique opportunity to design, implement, and deliver storage offerings for our GPU cloud.Key ResponsibilitiesDesign and develop scalable storage solutions that meet the needs of our high-performance computing environment.Collaborate with...


  • San Francisco, California, United States MongoDB Full time

    MongoDB is a leading developer data platform empowering innovators to create, transform, and disrupt industries by unleashing the power of software and data. We enable organizations of all sizes to build modern applications with ease.The Atlas Online Archive service provides low-cost, tiered storage for querying infrequently-accessed, read-only data. By...


  • San Francisco, California, United States Discord Full time

    About DiscordDiscord is a platform that revolutionizes the way people connect and engage with each other around games and shared interests. As a hub for gamers and communities, we're committed to providing a seamless experience that fosters meaningful relationships and unforgettable moments.Your Future AwaitsWe're seeking an accomplished Senior Staff...


  • San Francisco, California, United States Spellbrush Full time

    About Spellbrush">Spellbrush is a world-renowned generative AI studio behind the critically acclaimed anime game niji・journey. We're passionate about pushing the boundaries of what's possible in the anime and video game industry.">Job Overview">We're seeking an exceptional Technical Data Architect to join our team. As a key member, you'll design and build...


  • San Francisco, California, United States Genmo Full time

    Job TitleData Infrastructure EngineerCompany OverviewWe are Genmo, a research lab dedicated to building open, state-of-the-art models for video generation towards unlocking the right brain of AGI.Salary$250,000 - $350,000 per year, depending on experience.Job DescriptionWe're seeking an experienced Senior/Staff AI Infra Engineer to design, build, and scale...


  • San Jose, California, United States Tik Tok Full time

    Job DescriptionReal-Time Data Architect, Ad Platform is a key position in our ad data platform team. You will work closely with product managers and data analysts to design and develop state-of-the-art streaming and batch data processing solutions that support both the TikTok ads platform and our internal business intelligence platform.You will have...


  • San Francisco, California, United States Genmo Full time

    At Genmo, we're pushing the boundaries of video generation and unlocking the right brain of AGI.Job DescriptionWe're seeking an experienced Senior/Staff AI Infra Engineer to design, build, and scale our petabyte-scale data infrastructure.Key Responsibilities:Design highly scalable data infrastructure and systems to process petabyte-scale data stores.Manage...


  • San Francisco, California, United States Scale AI Full time

    Scaling AI InnovationJoin Scale AI, where we're transforming the way organizations build and deploy AI. Our mission is to accelerate the development of AI applications, making this transition happen faster across every industry.As a Senior Software Engineer, GenAI Growth, you'll be part of our Growth team, responsible for building products for our...


  • San Francisco, California, United States Mindlance Full time

    Solutions for Success:Mindlance is a trusted partner for businesses seeking innovative solutions. As a Platform Security Architect, you will play a key role in securing our SaaS platform and ensuring compliance with FedRAMP Moderate level controls. Your expertise will help us stay ahead of the competition and deliver exceptional results for our clients.About...


  • San Francisco, California, United States World Labs Full time

    World Labs is pioneering the development of Large World Models to enable AI systems that understand and interact with complex 3D environments. As a member of our team, you will design, implement, and optimize large-scale distributed data pipelines for AI model training. We're seeking candidates with strong engineering skills and expertise in data processing...


  • San Jose, California, United States Adobe Inc. Full time

    Unlock the Power of Customer ProfilesWe are seeking a highly skilled Chief Data Architect or Lead Big Data Engineer to join our team at Adobe Inc. in designing and implementing key components of ingesting and maintaining petabyte of Profile data.About the OpportunityAs part of our mission to deliver exceptional digital experiences, we are building Adobe...


  • San Francisco, California, United States Scale AI, Inc. Full time

    About Scale AI, Inc.At Scale AI, Inc., our mission is to accelerate the development of AI applications. For years, Scale has been the leading AI data foundry, helping fuel advancements in AI, including generative AI, defense applications, and autonomous vehicles. With recent investments, we're accelerating the abundance of frontier data to pave the road to...


  • San Jose, California, United States Tik Tok Full time

    About the RoleStreaming Data Engineer, Large-Scale Systems is a critical position in our ad data platform team. You will work closely with product managers and data analysts to build state-of-the-art streaming and batch data processing solutions. The entire data pipeline supports both the TikTok ads platform and our internal business intelligence...


  • San Francisco, California, United States OpenAI Full time

    About the RoleWe are seeking a seasoned Video Infrastructure Architect to spearhead the development of OpenAI's video infrastructure for ingesting, processing, and serving video at scale.In this critical role, you will work closely with product engineers and researchers to understand current needs and architect systems that accelerate our efforts. As we...


  • San Francisco, California, United States Oleria Security Full time

    Oleria Security is a leading provider of adaptive and autonomous identity security solutions. We empower organizations to accelerate at the pace of change, trusting that their data is protected.Job Overview:We are seeking an experienced Senior Backend Software Engineer to join our team. As an early hire, you will have the opportunity to build and help...