Data Infrastructure Engineer

1 month ago


San Francisco, United States Acceler8 Talent Full time

Data Infrastructure Engineer

Are you an experienced Data Infrastructure Engineer ready to tackle challenges in AI and data processing at an unprecedented scale? Our organization is looking for a skilled professional to join our dynamic team. Here, technology and innovation intersect to create smarter solutions that redefine human-computer interactions.

About the Company:

We are a prominent entity in the tech industry, celebrated for our innovative approach to Artificial Intelligence. Our work is about enhancing the partnership between humans and technology, striving to exceed the current capabilities and achievements in the field. Supported by leading investors and collaborators such as March Capital, Thrive Capital, AMD, and NVIDIA, our venture is well-capitalized and poised for significant breakthroughs.

About the Role:

As a Data Infrastructure Engineer, you will be pivotal in designing and building a robust infrastructure that can handle and process petabytes of data efficiently. This role demands a proactive approach to developing scalable systems that are crucial for training cutting-edge AI models. Your work will involve close collaboration with our data research and data crawling teams to ensure the infrastructure not only meets but exceeds the required standards of reliability and performance.

What We Can Offer You:

  • A chance to work on petabyte-scale data systems, pushing the boundaries of data processing.
  • Opportunities to innovate and implement new data preparation methods alongside top-tier professionals.
  • Exposure to cutting-edge technology in a supportive and challenging environment.
  • Competitive compensation and benefits, including relocation assistance for qualified candidates.

Key Responsibilities:

  • Design and implement scalable data processing infrastructure suitable for extensive AI training.
  • Orchestrate large-scale workloads across massive computing clusters.
  • Maintain and enhance distributed computing environments to support evolving data needs.
  • Collaborate with various teams to integrate new data preparation technologies and methods.
  • Address and resolve infrastructure issues efficiently, ensuring high availability and performance.

The Data Infrastructure Engineer role is designed for individuals who thrive in fast-paced environments and are eager to drive technological advancements. If you are passionate about developing systems that impact the future of AI, we encourage you to apply and join our mission to revolutionize digital interactions.

Relevant Keywords: data orchestration, high-throughput systems, Kubernetes, cloud services, distributed computing, AI training, petabyte-scale data handling, machine learning model training.



  • San Francisco, United States Acceler8 Talent Full time

    Data Infrastructure EngineerAre you an experienced Data Infrastructure Engineer ready to tackle challenges in AI and data processing at an unprecedented scale? Our organization is looking for a skilled professional to join our dynamic team. Here, technology and innovation intersect to create smarter solutions that redefine human-computer interactions.About...


  • San Francisco, United States Acceler8 Talent Full time

    Data Infrastructure EngineerAre you an experienced Data Infrastructure Engineer ready to tackle challenges in AI and data processing at an unprecedented scale? Our organization is looking for a skilled professional to join our dynamic team. Here, technology and innovation intersect to create smarter solutions that redefine human-computer interactions.About...


  • San Francisco, CA, United States Acceler8 Talent Full time

    Data Infrastructure Engineer Are you an experienced Data Infrastructure Engineer ready to tackle challenges in AI and data processing at an unprecedented scale? Our organization is looking for a skilled professional to join our dynamic team. Here, technology and innovation intersect to create smarter solutions that redefine human-computer interactions. ...


  • San Francisco, CA, United States Acceler8 Talent Full time

    Data Infrastructure Engineer Are you an experienced Data Infrastructure Engineer ready to tackle challenges in AI and data processing at an unprecedented scale? Here, technology and innovation intersect to create smarter solutions that redefine human-computer interactions. We are a prominent entity in the tech industry, celebrated for our innovative...


  • San Francisco, CA, United States Retool Full time

    WHY WE'RE LOOKING FOR YOU: Retool is a fast-growing company with quickly evolving business needs. We’re looking to hire engineers to help us build out our data ecosystem to serve the needs of our business today and for broader scale years from now. We're looking for someone who is ready to get their hands dirty, is motivated by having an impact...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...


  • San Francisco, United States People Data Labs Full time

    Job DescriptionJob DescriptionAbout UsAt People Data Labs, we're committed to democratizing access to high-quality B2B data and leading the emerging DaaS economy. We empower developers, engineers, and data scientists to create innovative, compliant data products at scale with our clean, easy-to-use datasets of resume, company, location, and education...

  • Software Engineer

    2 weeks ago


    San Francisco, CA, United States Karkidi Full time

    You’ll help in executing the roadmap for data infrastructure and systems to power the world’s first AI recruiter built by Moonhub. You'll play a pivotal role in the development of tools and infrastructure that democratize data access and enable core capabilities across the organization You’ll architect offline and online data pipelines to...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, CA, United States Eon Systems PBC Full time

    Location Type Full time Department AI This role As a data engineer, you will be responsible for acquisition, processing and handling of large amounts of complex neuroscientific data. You will build and maintain an end-to-end cloud-based data pipeline structure from data capture to providing processed data to our ML models. You will be collaborating...


  • San Francisco, CA, United States X Corp. Full time

    Are you prepared to join the X team and help build the ultimate real-time information-sharing app, revolutionizing how people connect? At X, we're on a mission to become a trusted global digital public square, committed to minimal censorship within legal boundaries. Our goal is to empower every user to freely create and share ideas, fostering open public...


  • San Francisco, United States Nextdata Technologies Inc Full time

    The company Decentralized data is the future. Data mesh is the right idea. Were here to make it a reality. Nextdata OS is a data-mesh-native platform built to meet the challenge of decentralizing data at scale. We are inventing a new way for developers to work with data and share it responsibly via data product containers. Our vision is to build a world...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, CA, United States EON Systems, Inc. Full time

    This role As a data engineer, you will be responsible for acquisition, processing and handling of large amounts of complex neuroscientific data. You will build and maintain an end-to-end cloud-based data pipeline structure from data capture to providing processed data to our ML models. You will be collaborating closely with the human / animal brain data...


  • San Francisco, California, United States Retool Full time

    ABOUT RETOOL: At Retool, we're changing the way software is built. We've developed the fastest way to build internal tools, saving companies time, resources, and engineering bandwidth. Whether it's refunding orders, underwriting loans, managing marketplaces, rolling out new features, analyzing transactions, or providing customer support, Retool makes it...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of machine learning infrastructure! At our company, we're passionate about pushing the boundaries of artificial intelligence and machine learning. Our mission is to develop robust and scalable infrastructure solutions that empower data scientists and machine learning engineers to...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of machine learning infrastructure! At our company, we're passionate about pushing the boundaries of artificial intelligence and machine learning. Our mission is to develop robust and scalable infrastructure solutions that empower data scientists and machine learning engineers to...


  • San Francisco, United States Unreal Gigs Full time

    Job DescriptionJob DescriptionCompany Overview: Welcome to the forefront of machine learning infrastructure! At our company, we're passionate about pushing the boundaries of artificial intelligence and machine learning. Our mission is to develop robust and scalable infrastructure solutions that empower data scientists and machine learning engineers to...


  • San Francisco, CA, United States Airbnb Full time

    As a senior technical individual contributor, you will bring a unique skill set and experience to our organization, and work to solve some of the broader technical challenges . Our engineering organization is one where we value everyones input and ideas. Although you will be at the senior level or higher, all individual contributors at Airbnb are Software...


  • San Francisco, United States CHALK INC Full time

    About Chalk: Instead of relying on dated technologies like Spark, we built Chalk from the ground up to provide a best-in-class experience for our users - the experience we've always dreamed of. Chalk makes it simple to integrate new features, backtest changes, and deliver real-time machine learning and generative AI. Chalk's infrastructure is not just about...


  • San Francisco, United States CHALK INC Full time

    About Chalk: Instead of relying on dated technologies like Spark, we built Chalk from the ground up to provide a best-in-class experience for our users - the experience we've always dreamed of. Chalk makes it simple to integrate new features, backtest changes, and deliver real-time machine learning and generative AI. Chalk's infrastructure is not just about...


  • San Francisco, United States Twelve Labs Inc. Full time

    We’re a fast-moving, diverse team pushing the frontiers of artificial intelligence. At Twelve Labs, our mission is to help developers build programs that can see, listen, and understand the world as we do by bringing the world’s most powerful video understanding infrastructure to market. As a part of achieving this mission, we are building foundation AI...