Distributed Data Architect

6 days ago


San Francisco, California, United States OpenAI Full time

About the Role

As a Distributed Data Architect, you will play a crucial part in building and operating the foundational data infrastructure that enables products and teams at OpenAI.

Key responsibilities include:

  1. Designing, building, and maintaining data infrastructure systems such as distributed compute, data orchestration, distributed storage, streaming infrastructure
  2. Ensuring our data platform can scale reliably to the next several orders of magnitude
  3. Accelerating company productivity by empowering fellow engineers & teammates with excellent data tooling and systems
  4. Partnering with product engineers, trust & safety, and other teams to build technical foundations

Some of the technologies you'll be working with include Apache Spark, Clickhouse, Python, Terraform, Kafka, Azure EventHub, Vector DBs.



  • San Francisco, California, United States Intelliswift Software Full time

    We are looking for a talented Distributed System Architect to design and implement our Kafka infrastructure at Intelliswift Software. The ideal candidate will have extensive experience with Confluent Kafka and be able to architect and implement scalable, high-performance distributed systems.Responsibilities include designing and implementing scalable Kafka...


  • San Francisco, California, United States Anyscale Full time

    We're seeking a skilled Distributed Systems Architect to join our team at Anyscale. Our mission is to democratize distributed computing and make it accessible to software developers of all skill levels.As a Distributed Systems Architect, you'll play a key role in building the best place to run Ray, a popular open-source project that's creating an ecosystem...


  • San Francisco, California, United States MongoDB Full time

    MongoDB's Atlas Search Query team is looking for a highly skilled Distributed System Architect to join our ranks. As a key member of our team, you'll design and implement a cloud-based search service that allows users to execute complex search queries using the MongoDB Query Language.You'll work closely with our team to develop new features, optimize...


  • San Francisco, California, United States AI Talent Flow Full time

    We are seeking a Cloud Data Architect to join our team at AI Talent Flow. This role involves designing and implementing scalable data systems that can handle large amounts of data. As a Cloud Data Architect, you will work on building the infrastructure for our cloud service, ensuring it is reliable, secure, and performant.The ideal candidate has experience...


  • San Francisco, California, United States Activision Full time

    About Us:At Activision, we're committed to creating innovative experiences that bring people together. As a Staff Software Engineer on our Data Platforms team, you'll play a pivotal role in shaping the future of our digital advertising success.Your Role:We're seeking an experienced software engineer to lead dynamic data solutions and architect a robust...


  • San Francisco, California, United States Unreal Gigs Full time

    We're seeking a highly skilled Data Architect Specialist to join our team at Unreal Gigs. In this role, you'll play a key part in designing and implementing scalable data pipelines that handle high-volume, high-velocity data.The ideal candidate will have extensive experience with big data technologies such as Apache Spark, Hadoop, Kafka, and Hive. They'll be...


  • San Jose, California, United States Mindlance Full time

    Distributed Systems Architect PositionWe are seeking an experienced Distributed Systems Architect to join our team. As a Distributed Systems Architect, you will be responsible for designing and building large-scale distributed systems. You will work closely with our engineering team to ensure that our systems are secure, scalable, and highly available.Key...


  • San Francisco, California, United States Hinge Health Full time

    **About the Role**Hinge Health is a pioneering healthcare company transforming pain treatment and prevention using advanced technology, AI, and expert clinical care. As a Data Architect and Engineer, you will play a critical role in designing and building self-service tools and automation that enable application engineers and data analysts to manage,...


  • San Francisco, California, United States AI Talent Flow Full time

    Job OverviewWe are seeking a highly skilled Distributed Systems Architect to join our team at AI Talent Flow. As a key member of our engineering team, you will be responsible for designing and developing scalable and reliable distributed systems that support AI applications at scale.The successful candidate will have experience in building correct,...


  • San Francisco, California, United States Naptha AI Full time

    We are seeking a highly skilled Distributed Infrastructure Architect to design and build the foundational systems that will power the next generation of AI agent networks at Naptha AI. This is a rare opportunity to shape the future of AI infrastructure at a massively ambitious scale.Naptha AI offers a unique chance to work on building the infrastructure for...

  • Data Architect

    2 weeks ago


    San Diego, California, United States Apple Full time

    Job DescriptionWe are seeking a highly skilled Data Architect to join our team at Apple. As a key member of our Software Engineering group, you will be responsible for designing and developing large-scale data solutions that drive business growth and efficiency.The ideal candidate will have a strong background in architecting, designing, and developing...

  • Lead Data Architect

    4 weeks ago


    San Francisco, California, United States Windfall Full time

    Key Responsibilities:We're seeking a Lead Data Architect to build out our core data asset and lead our data engineering team. Key responsibilities include designing and building data pipelines, working closely with our data science team, and building supporting data services and applications.Requirements:We're looking for a strong leader with 8+ years of...


  • San Francisco, California, United States Nextdoor Full time

    Your Future Role:We are seeking a Distributed Datastore Architect to join our Core Services team. As a key member of this team, you will be responsible for designing and implementing a distributed, globally replicated graph store with high availability tiered caching. This datastore will provide predictable performance and enable product engineers to move...


  • San Francisco, California, United States Windfall Full time

    Windfall is a leading people intelligence and AI company that empowers go-to-market teams with actionable insights. By democratizing access to people data, organizations can intelligently prioritize resources to drive greater business outcomes. To achieve this mission, we are seeking an experienced Chief Data Infrastructure Architect to join our core data...


  • San Francisco, California, United States Sentry Full time

    About the RoleSentry is on a mission to help developers write better software faster. As a Senior Software Engineer on our platform team, you will be responsible for building and maintaining the infrastructure that powers our performance and error monitoring tools. This includes designing and implementing new analytics platforms, expanding Search and Storage...


  • San Francisco, California, United States EvenUp Inc. Full time

    About the RoleAs a highly skilled Data Infrastructure Architect at EvenUp Inc., you will play a crucial role in shaping our data pipelines and infrastructure to drive business growth. We are seeking an experienced professional with expertise in designing and building distributed data systems, architecting and scaling event-driven architectures, and...


  • San Diego, California, United States Apple Full time

    Job Description:Distributed Systems Architect - Cloud EngineeringDesign novel distributed architectures to accelerate software build, test, and deployment.Combine problem domain expertise with established techniques to achieve high performance, reliability, and long-term maintainability.Analyze requirements, existing solutions, and systems to inform...


  • San Francisco, California, United States AI Talent Flow Full time

    Job OverviewA high-performance distributed systems architect is required to join the team at AI Talent Flow, responsible for building scalable and reliable data platforms that power our cloud service. As a key member of our engineering team, you will work closely with cross-functional teams to design, develop, and operate our open-source Chroma data plane.In...


  • San Francisco, California, United States Succinct Full time

    Innovate with Succinct, a pioneer in blockchain scaling, interoperability, and privacy solutions. As a Senior Software Engineer, you'll play a crucial role in developing our distributed proving cluster for SP1 and prover network in our San Francisco office.About the RoleThis position requires expertise in architecting and maintaining a highly available...


  • San Francisco, California, United States Databricks Inc. Full time

    Databricks Inc. is a leading provider of cloud-based data and AI solutions. As a Cloud Data Architect Lead, you will play a crucial role in shaping the company's technical direction and driving innovation in data engineering, analytics, and machine learning.Our ideal candidate will have a strong background in designing and implementing distributed data...