Software Engineer, Infrastructure Data Plane

5 days ago


San Francisco, California, United States Anyscale Full time

About Anyscale:

We're on a mission to make distributed computing accessible to software developers of all skill levels.

We're commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning.

Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

We're building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

We're backed by top investors, with $250+ million raised to date.


About the Role:

We're looking for a Software Engineer to join the Infrastructure Data Plane team.

Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop.

At the Cloud Platform Data Plane team, we build the scalable, secure, and robust backbone to realize this vision.

We're seeking a talented Software Engineer with a strong background in data plane development and expertise in container technologies.

As part of our engineering team, you will play a crucial role in designing, implementing, and optimizing data plane solutions that power our cutting-edge products.

You will work on the open-source Ray, our major infinite laptop proprietary product, and the integration and interaction between the two as well as critical customer features.

Responsibilities include:

  • Design and develop components to manage Ray applications and auxiliary containers running on the data plane
  • Create cutting-edge features to enhance reliability, performance, scalability, and observability of Anyscale-managed Ray workloads
  • Implement and maintain accelerator support
  • Manage and optimize storage, networking, and security aspects of the data plane
  • Handle dependencies and container image management
  • Participate in code reviews, design discussions, and architecture planning sessions
  • Provide on-call support and collaborate with customer and field teams to troubleshoot data plane issues
  • Work with a team of leading distributed systems and machine learning experts

We're looking for someone with:

  • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
  • 3+ years of experience writing high-quality production code
  • Hands-on experience building high-performance distributed systems at scale
  • Proficiency in Go and Python
  • In-depth knowledge of low-level operating system foundations (Linux kernel, file systems, containers)
  • Comprehensive understanding of network protocols and associated tools
  • Ability to work independently and collaboratively in a fast-paced environment
  • Customer-focused mindset with excellent communication skills

Bonus points for:

  • Master's degree in Computer Science or related technical field
  • Contributions to open-source projects in dataplane or container technologies
  • Familiarity with cloud platforms (AWS, Google Cloud, Azure) and Kubernetes

Anyscale is an Equal Opportunity Employer. We evaluate candidates without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.



  • San Francisco, California, United States Anyscale Full time

    About AnyscaleAnyscale is a company on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We're commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have...


  • San Francisco, California, United States Anyscale Full time

    About Anyscale:Anyscale is revolutionizing distributed computing by making it accessible to developers of all skill levels. We're commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning.Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to...


  • San Francisco, California, United States Watershed Technology Full time

    About WatershedWatershed is a software platform that empowers organizations to run world-class climate programs. Our success is measured by the carbon reduction achievements of our customers. We're seeking talented individuals who share our passion for product-building, mission-oriented work, and collaborative culture.The RoleWe're building a brand new Data...


  • San Francisco, California, United States Faire Inc Full time

    About Faire IncFaire Inc is an online wholesale marketplace that empowers independent retailers around the globe to grow their businesses. Our platform connects these entrepreneurs with the best products from around the world, helping them discover new opportunities and reach new customers.We're looking for a talented Software Engineer to lead our Core Data...


  • San Francisco, California, United States Baton (A Ryder Technology Lab) Full time

    Job Title: Senior Software Engineer - InfrastructureWe are seeking a highly skilled Senior Software Engineer to join our Infrastructure team at Baton, a technology innovation lab for Ryder. As a key member of our team, you will be responsible for designing and developing our core web infrastructure, ensuring scalability, reliability, and security.Key...


  • San Francisco, California, United States Slapdash Full time

    Join Our Team as a Software Engineer - InfrastructureWe are seeking an experienced Software Engineer - Infrastructure to join our team at Slapdash. As a key member of our engineering team, you will be responsible for building and maintaining our cloud infrastructure, ensuring it is scalable, secure, and optimized for performance.About the RoleDesign and...


  • San Francisco, California, United States Human Capital Solutions Full time

    About the JobAt Human Capital Solutions, we are seeking a talented Security Infrastructure Software Engineer to join our pioneering team. Our company develops leading software for data-driven decisions and operations, empowering partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more.The RoleOur products...


  • San Francisco, California, United States Notion Labs Full time

    About UsWe're on a mission to empower every person, team, and company to tailor their software to solve any problem and take on any challenge. Our goal is to make it possible for everyone to build or modify the software they use every day. At Notion Labs, we're passionate about building a company as diverse and creative as the millions of people we reach...


  • San Francisco, California, United States Orb Full time

    About OrbOrb is a cutting-edge billing infrastructure company that empowers businesses to unlock their revenue potential. We believe that pricing and billing should not be a barrier to innovation and growth.Our mission is to provide a modern, scalable, and reliable billing infrastructure that enables businesses to focus on building great products and...


  • San Francisco, California, United States Acceler8 Talent Full time

    Job Overview:We are a technology company focused on enhancing the partnership between humans and computers to achieve groundbreaking advancements. Our approach spans from user experience to model optimization, aiming to maximize user value per computational effort.About the Company:We are a small, driven team committed to making significant strides in...


  • San Francisco, California, United States Baton (A Ryder Technology Lab) Full time

    Job Title: Senior Software Engineer - InfrastructureBaton, a technology innovation lab for Ryder, is seeking a highly skilled Senior Software Engineer to join our Infrastructure team. As a key member of our team, you will play a crucial role in designing and implementing robust testing infrastructure that enhances engineering productivity and sets a high...


  • San Francisco, California, United States Parafin Inc Full time

    About Us:At Parafin, we're dedicated to empowering small businesses to grow and thrive. Our mission is to provide innovative financial services that make a real difference in the lives of entrepreneurs and their communities.We're a team of passionate individuals who share a common goal: to build a platform that enables small businesses to access the...


  • San Francisco, California, United States ASB Resources Full time

    Job Title: Infrastructure Software EngineerWe are seeking a highly skilled Infrastructure Software Engineer to join our team at ASB Resources.About the RoleThis is an exciting opportunity for a talented engineer to design, develop, and maintain scalable infrastructure solutions for data ingestion into ZL & Vantage platforms.Key ResponsibilitiesDesign and...


  • San Francisco, California, United States Acceler8 Talent Full time

    About the RoleWe are seeking a Senior Software Engineer (AI Infrastructure / MLOps) to join our pioneering AI startup focused on enhancing data quality for machine learning. This role offers the chance to work on large-scale web applications and tackle complex challenges in a rapidly growing field.As a Senior Software Engineer (AI Infrastructure / MLOps),...


  • San Francisco, California, United States Jerry Full time

    About the Role:Jerry is seeking a seasoned Senior Data Engineer to lead the development of a new infrastructure solution that will support the company's rapid growth and scalability needs.As a key member of the Data team, you will partner with data scientists, software engineers, and cross-functional stakeholders to build data pipelines that provide critical...


  • San Francisco, California, United States Parafin Full time

    About the RoleWe're seeking an experienced software engineer to join our Infrastructure team and help build the foundation for our rapidly growing financial technology platform. The Infrastructure team at Parafin owns core platforms spanning across cloud infrastructure, developer experience, data infrastructure, and security.As a key member of our team,...


  • San Francisco, California, United States Acceler8 Talent Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team as an AI Infrastructure Specialist. This role offers the opportunity to work on large-scale web applications and tackle complex challenges in a rapidly growing field.As a Senior Software Engineer, you will be responsible for developing and maintaining our flagship web...


  • San Francisco, California, United States Databricks Full time

    Job DescriptionWe are seeking a highly skilled Staff Software Engineer to join our Cloud Infrastructure team at Databricks. As a key member of our engineering team, you will be responsible for designing, developing, and operating large-scale distributed systems that power our cloud-based data platform.Key Responsibilities:Design and implement scalable and...


  • San Francisco, California, United States Baton Full time

    Job DescriptionBaton is a technology innovation lab for Ryder, a leading logistics company. We're seeking a Senior Software Engineer to join our Infrastructure team.This role involves creating robust testing infrastructure to enhance engineering productivity and set a high standard for code quality.You'll work with our Head of Engineering to enable our...

  • Senior Data Engineer

    2 weeks ago


    San Francisco, California, United States Jerry Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to lead the development of a new infrastructure solution that will support our growing business needs. As a key member of our Data team, you will partner with data scientists, software engineers, and cross-functional stakeholders to build data pipelines that provide critical data and insights...