Software Engineer, Data Plane

4 weeks ago


San Francisco, United States Anyscale Full time

About Anyscale:

At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

About the role

Anyscale is looking for a Software Engineer to join the Infrastructure Data Plane team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. At the Cloud Platform Data Plane team, we build the scalable, secure, and robust backbone to realize this vision.

We are seeking a talented Software Engineer with a strong background in data plane development and expertise in container technologies. As part of our engineering team, you will play a crucial role in designing, implementing, and optimizing data plane solutions that power our cutting-edge products.

You will be able to work on the open-source Ray, our major infinite laptop proprietary product, and the integration and interaction between the two as well as critical customer features.

As part of your role, you will

  • Design and develop components to manage Ray applications and auxiliary containers running on the data plane
  • Create cutting-edge features to enhance reliability, performance, scalability, and observability of Anyscale-managed Ray workloads
  • Implement and maintain accelerator support
  • Manage and optimize storage, networking, and security aspects of the data plane
  • Handle dependencies and container image management
  • Participate in code reviews, design discussions, and architecture planning sessions
  • Provide on-call support and collaborate with customer and field teams to troubleshoot data plane issues
  • Work with a team of leading distributed systems and machine learning experts

We'd love to hear from you if you have

  • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
  • 3+ years of experience writing high-quality production code
  • Hands-on experience building high-performance distributed systems at scale
  • Proficiency in Go and Python
  • In-depth knowledge of low-level operating system foundations (Linux kernel, file systems, containers)
  • Comprehensive understanding of network protocols and associated tools
  • Ability to work independently and collaboratively in a fast-paced environment
  • Customer-focused mindset with excellent communication skills

Bonus

  • Master's degree in Computer Science or related technical field
  • Contributions to open-source projects in dataplane or container technologies
  • Familiarity with cloud platforms (AWS, Google Cloud, Azure) and Kubernetes

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish

#J-18808-Ljbffr

  • San Francisco, United States Amazon Full time

    Sr. Software Engineer, Data Plane, NPD Forwarding Stack, Data Plane Job ID: 2776438 | Amazon Data Services, Inc. AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage,...


  • San Francisco, United States Amazon Full time

    Sr. Software Engineer, Data Plane, NPD Forwarding Stack, Data PlaneJob ID: 2776438 | Amazon Data Services, Inc.AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage,...


  • San Francisco, CA, United States Amazon Full time

    Sr. Software Engineer, Data Plane, NPD Forwarding Stack, Data Plane Job ID: 2776438 | Amazon Data Services, Inc. AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage,...


  • San Francisco, California, United States People Data Labs Full time

    Role OverviewWe are seeking an exceptional Software Engineering Lead to join our team at People Data Labs. This role is a fantastic opportunity to drive our self-serve product offerings, grow new revenue, and develop innovative data products.


  • San Jose, United States ACL Digital Full time

    Role: Senior Software Engineer Location: San Jose, CA, Richardson, TX, Irving, TX, Basking Ridge, NJ, Bedminster, NJ, and Branchburg, NJ (Hybrid) Duration: 12+ Months C2C is open Highlighted in yellow are must, non- negotiable . JOB DESCRIPTION: As a software consultant, you will be interacting with software engineers, network/system operations staff,...


  • San Jose, California, United States ACL Digital Full time

    ACL Digital is seeking a seasoned Senior Software Engineer to join our team.The ideal candidate will have a strong background in software development, with a focus on building scalable software systems and software infrastructure.About the Role:We are looking for an experienced software consultant who can interact with software engineers, network/system...


  • San Diego, California, United States Apple Full time

    Company OverviewAt Apple, we are passionate about innovation and delivering cutting-edge products that transform the world. Our Wireless Technologies and Ecosystems team is seeking a talented Cellular Software Engineer to join our elite team of engineers.SalaryThe base pay for this role ranges between $115,700 and $174,200, depending on your skills,...


  • San Francisco, California, United States United Software Group Full time

    Job Title: Data Engineering Lead - AI/ML OperationsWe are seeking a highly skilled Data Engineering Lead with expertise in AI/ML operations to join our team at United Software Group. This role will be responsible for overseeing the development and implementation of data engineering solutions that enable the company's AI/ML initiatives.About the Role:The...


  • San Francisco, United States Wherobots Full time

    We are looking for passionate, skilled, and experienced software engineers to join Wherobots' dynamic team in building the geospatial cloud database of the future, its cloud platform, and control plane. As a backend software engineer, you will play a crucial role in designing, developing, and maintaining the backend services and infrastructure that powers...


  • San Francisco, United States Wherobots Full time

    We are looking for passionate, skilled, and experienced software engineers to join Wherobots' dynamic team in building the geospatial cloud database of the future, its cloud platform, and control plane. As a backend software engineer, you will play a crucial role in designing, developing, and maintaining the backend services and infrastructure that powers...

  • Software Engineer

    1 week ago


    San Francisco, California, United States Tbwa ChiatDay Inc Full time

    Principal Software Engineer, BackendCHAOS Inc. is a technology company specializing in defense and critical industrial sectors. The company has developed next-generation capabilities and is known for its mission-focused culture, dedicated to solving complex technical challenges. Its unique agile engineering approach enables rapid prototyping, while...

  • Software Engineer

    5 days ago


    San Francisco, United States Sara Software Systems Full time

    bem Share this job San Francisco, CA, USA Full Time Role Highlights Computer Science Integrations Software Systems LLMs AI Tools, Libraries and Frameworks Description The company leverages LLMs to create a new interface between humans and systems to build robust and scalable software solutions. The role involves working directly with founders to...


  • San Jose, United States Cisco Systems, Inc. Full time

    The Cisco Distributed System Engineering (DSE) group is at the forefront of developing products that power the largest networks in the world. The networking industry is going through a massive transformation to build the next generation infrastructure to meet the needs of AI/ML workloads and continuously increasing internet users and applications. We are...


  • San Francisco, United States Braintrust Data Full time

    About the companyBraintrust is the end-to-end developer platform for building world-class AI products. AI development is a relatively new paradigm combining code and datasets, incrementally refining both using frequent evaluations. Our product lets you evaluate LLM applications and iteratively improve them, with a rich set of tools to visualize changes and...


  • San Francisco, California, United States WEX Inc Full time

    Job OverviewWe are seeking a highly skilled Sr. Principal Data Software Engineer to join our team at WEX Inc.About the Role:As a key member of our data engineering team, you will be responsible for designing and implementing scalable, reliable, and cost-effective data architectures.You will work closely with stakeholders to understand business requirements...


  • San Francisco, United States Pano AI Full time

    Who we areThe problem: Every minute matters in fire response. As climate change amplifies the intensity of wildfires—with longer fire seasons, dryer fuels, and faster winds—new ignitions spread faster and put more communities at risk. Today, most wildfires are detected by bystanders and reported via 911, meaning it can take hours to detect a fire, verify...


  • San Francisco, California, United States Amazon Full time

    About the Role:We are seeking an experienced Senior Software Engineer to join our Data Plane team. As a key member of our team, you will be responsible for designing and implementing state-of-the-art Linux-based networking platforms.Our team owns packet forwarding in our networking devices, which is the core functionality of a networking switch. You will...


  • san jose, United States ACL Digital Full time

    Looking for a candidate with ODL, Open API (RESTCONF/NETCONF) in below mentioned location.Job Title: Senior Software EngineerLocation: San Jose, CA, Richardson, TX, Irving, TX, Basking Ridge, NJ, Bedminster, NJ, and Branchburg, NJ, Atlanta, GA (Hybrid)Duration: 12+ monthsJob DescriptionAs a software consultant, you will be interacting with software...


  • San Jose, United States ACL Digital Full time

    Looking for a candidate with ODL, Open API (RESTCONF/NETCONF) in below mentioned location.Job Title: Senior Software EngineerLocation: San Jose, CA, Richardson, TX, Irving, TX, Basking Ridge, NJ, Bedminster, NJ, and Branchburg, NJ, Atlanta, GA (Hybrid)Duration: 12+ monthsJob DescriptionAs a software consultant, you will be interacting with software...


  • San Francisco, United States Pano AI Full time

    Who we are The problem: Every minute matters in fire response. As climate change amplifies the intensity of wildfires-with longer fire seasons, dryer fuels, and faster winds-new ignitions spread faster and put more communities at risk. Today, most wildfires are detected by bystanders and reported via 911, meaning it can take hours to detect a fire, verify...