Software Engineer, Data Infrastructure

3 months ago


San Francisco, United States Acceler8 Talent Full time

Software Engineer, Data Infrastructure


Overview: We are a technology company focused on enhancing the partnership between humans and computers to achieve groundbreaking advancements. Our approach spans from user experience to model optimization, aiming to maximize user value per computational effort.


About the Company: We are a small, driven team committed to making significant strides in real-world AI applications. Supported by leading venture capital firms and major tech companies, we are financially stable and positioned for long-term success. Our team is diverse and multidisciplinary, dedicated to solving complex AI challenges.


About the Role: As a Data Infrastructure Engineer, you will play a crucial role in designing, implementing, and optimizing scalable systems to handle vast amounts of data for AI training. This role demands close collaboration with our data research and data crawling teams to ensure the infrastructure is both reliable and efficient.


What We Can Offer You:

  • Competitive salary and comprehensive benefits package
  • Opportunities for professional growth and development
  • Collaborative and innovative work environment
  • Relocation assistance for new employees
  • Access to cutting-edge technology and resources
  • Fully onsite work environment in San Francisco


Key Responsibilities:

  • Develop and maintain petabyte-scale data processing systems for AI training datasets
  • Manage workloads across large computing clusters
  • Architect and sustain distributed computing environments
  • Implement new data preparation methods in collaboration with the data research team
  • Quickly troubleshoot and resolve infrastructure-related issues


Qualifications:

  • Over 6 years of experience in data-intensive applications and software development
  • Proficient in Kubernetes and containerization
  • Experience with cloud services such as AWS, GCP, etc.
  • Strong programming skills in languages like Go, Rust, or C++
  • Background in building and maintaining infrastructure for ML model training data processing


Relevant Keywords: Data Infrastructure, Scalable Systems, AI, Kubernetes, Containerization, Cloud Services, Data Orchestration, Software Development, Go, Rust, C++, Machine Learning



  • San Francisco, United States Acceler8 Talent Full time

    Software Engineer, Data InfrastructureOverview: We are a technology company focused on enhancing the partnership between humans and computers to achieve groundbreaking advancements. Our approach spans from user experience to model optimization, aiming to maximize user value per computational effort.About the Company: We are a small, driven team committed to...


  • San Francisco, California, United States Watershed Technology Full time

    About WatershedWatershed is a software platform that empowers organizations to run world-class climate programs. Our success is measured by the carbon reduction achievements of our customers. We're seeking talented individuals who share our passion for product-building, mission-oriented work, and collaborative culture.The RoleWe're building a brand new Data...


  • San Francisco, California, United States Anyscale Full time

    About Anyscale:We're on a mission to make distributed computing accessible to software developers of all skill levels.We're commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning.Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to...


  • San Francisco, California, United States Faire Inc Full time

    About Faire IncFaire Inc is an online wholesale marketplace that empowers independent retailers around the globe to grow their businesses. Our platform connects these entrepreneurs with the best products from around the world, helping them discover new opportunities and reach new customers.We're looking for a talented Software Engineer to lead our Core Data...


  • San Francisco, California, United States Baton (A Ryder Technology Lab) Full time

    Job Title: Senior Software Engineer - InfrastructureWe are seeking a highly skilled Senior Software Engineer to join our Infrastructure team at Baton, a technology innovation lab for Ryder. As a key member of our team, you will be responsible for designing and developing our core web infrastructure, ensuring scalability, reliability, and security.Key...


  • San Francisco, California, United States Slapdash Full time

    Join Our Team as a Software Engineer - InfrastructureWe are seeking an experienced Software Engineer - Infrastructure to join our team at Slapdash. As a key member of our engineering team, you will be responsible for building and maintaining our cloud infrastructure, ensuring it is scalable, secure, and optimized for performance.About the RoleDesign and...


  • San Francisco, California, United States Human Capital Solutions Full time

    About the JobAt Human Capital Solutions, we are seeking a talented Security Infrastructure Software Engineer to join our pioneering team. Our company develops leading software for data-driven decisions and operations, empowering partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more.The RoleOur products...


  • San Francisco, California, United States Notion Labs Full time

    About UsWe're on a mission to empower every person, team, and company to tailor their software to solve any problem and take on any challenge. Our goal is to make it possible for everyone to build or modify the software they use every day. At Notion Labs, we're passionate about building a company as diverse and creative as the millions of people we reach...


  • San Francisco, California, United States Orb Full time

    About OrbOrb is a cutting-edge billing infrastructure company that empowers businesses to unlock their revenue potential. We believe that pricing and billing should not be a barrier to innovation and growth.Our mission is to provide a modern, scalable, and reliable billing infrastructure that enables businesses to focus on building great products and...


  • San Francisco, California, United States Acceler8 Talent Full time

    Job Overview:We are a technology company focused on enhancing the partnership between humans and computers to achieve groundbreaking advancements. Our approach spans from user experience to model optimization, aiming to maximize user value per computational effort.About the Company:We are a small, driven team committed to making significant strides in...


  • San Francisco, California, United States Baton (A Ryder Technology Lab) Full time

    Job Title: Senior Software Engineer - InfrastructureBaton, a technology innovation lab for Ryder, is seeking a highly skilled Senior Software Engineer to join our Infrastructure team. As a key member of our team, you will play a crucial role in designing and implementing robust testing infrastructure that enhances engineering productivity and sets a high...


  • San Francisco, California, United States Parafin Inc Full time

    About Us:At Parafin, we're dedicated to empowering small businesses to grow and thrive. Our mission is to provide innovative financial services that make a real difference in the lives of entrepreneurs and their communities.We're a team of passionate individuals who share a common goal: to build a platform that enables small businesses to access the...


  • San Francisco, California, United States Anyscale Full time

    About AnyscaleAnyscale is a company on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We're commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have...


  • San Francisco, California, United States ASB Resources Full time

    Job Title: Infrastructure Software EngineerWe are seeking a highly skilled Infrastructure Software Engineer to join our team at ASB Resources.About the RoleThis is an exciting opportunity for a talented engineer to design, develop, and maintain scalable infrastructure solutions for data ingestion into ZL & Vantage platforms.Key ResponsibilitiesDesign and...


  • San Francisco, United States Acceler8 Talent Full time

    Data Infrastructure EngineerAre you an experienced Data Infrastructure Engineer ready to tackle challenges in AI and data processing at an unprecedented scale? Our organization is looking for a skilled professional to join our dynamic team. Here, technology and innovation intersect to create smarter solutions that redefine human-computer interactions.About...


  • San Francisco, California, United States Acceler8 Talent Full time

    About the RoleWe are seeking a Senior Software Engineer (AI Infrastructure / MLOps) to join our pioneering AI startup focused on enhancing data quality for machine learning. This role offers the chance to work on large-scale web applications and tackle complex challenges in a rapidly growing field.As a Senior Software Engineer (AI Infrastructure / MLOps),...


  • San Francisco, California, United States Jerry Full time

    About the Role:Jerry is seeking a seasoned Senior Data Engineer to lead the development of a new infrastructure solution that will support the company's rapid growth and scalability needs.As a key member of the Data team, you will partner with data scientists, software engineers, and cross-functional stakeholders to build data pipelines that provide critical...


  • San Francisco, California, United States Parafin Full time

    About the RoleWe're seeking an experienced software engineer to join our Infrastructure team and help build the foundation for our rapidly growing financial technology platform. The Infrastructure team at Parafin owns core platforms spanning across cloud infrastructure, developer experience, data infrastructure, and security.As a key member of our team,...


  • San Francisco, California, United States Acceler8 Talent Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team as an AI Infrastructure Specialist. This role offers the opportunity to work on large-scale web applications and tackle complex challenges in a rapidly growing field.As a Senior Software Engineer, you will be responsible for developing and maintaining our flagship web...


  • san francisco, United States Acceler8 Talent Full time

    Senior Software Engineer (AI Infrastructure / MLOps) Introduction: We are seeking a Senior Software Engineer (AI Infrastructure / MLOps) to join our team. This role offers a unique opportunity to work on cutting-edge MLOps technologies and develop large-scale web applications for data-centric AI.About the Company: Our team comprises MIT PhDs who have worked...