Senior Software Engineer, Distributed Systems

2 weeks ago

San Francisco, United States Mixpanel Full time

We are actively recruiting for multiple Software Engineers across different levels for our org

About the Role

Mixpanel is powered by a custom distributed database. This system ingests more than 1 Trillion user-generated events every month while ensuring end-to-end latencies of under a minute and queries typically scan more than 1 Quadrillion events over the span of a month. As our existing customers grow in volume and we add new ones, we expect this growth in traffic to continue. The Distributed Systems engineering teams are responsible for adding new capabilities and ensuring the smooth operation of the underlying systems.

Responsibilities

Mixpanel's infrastructure runs on Google Cloud Platform. We rely on Kubernetes and Docker for orchestration and containerization of our services. We primarily use Golang for writing services and all internal communication happens via GRPC. We use a combination of C and C++ wherever Golang doesn't meet our performance goals.

As an engineer on the Distributed Systems teams, you'll be responsible for:

  • Working with other engineers to build distributed systems that can handle data at scale
  • Debugging production issues across multiple services and all levels of our infrastructure stack
  • Ensuring reliability and uptime of the services you're responsible for
  • Keeping an eye on how much your service costs every month and removing inefficiencies wherever possible
  • Improving engineering standards and holding a high bar for code quality and simplicity
  • Pushing the boundaries on how our customers analyze their product data

A typical project requires a thorough understanding of how not just your service works but also how it interacts with other components. Here are some projects we've worked on in the past to give you an idea of what to expect:

  • Most of the systems in our stack provide at least once semantics. As a result, we risk duplicating events that flow through them. To overcome this limitation, we added support for event deduplication that can work at our scale. Typical approaches for deduplication don't perform well on large amounts of data, so we had to do something highly custom for our stack.
  • Back in 2019, we migrated our ingestion API service from Python to Golang for better performance and type safety. We had to do this while ensuring that both systems handle data the same way.
  • In 2021, as our traffic grew almost 100%, the cost of storing data became untenable. Our engineers worked on an incremental way to eventually realize almost $30000 in savings per month.

If projects like the ones listed above excite you, the Distributed Systems engineering team will be a great fit.

We're Looking For Someone Who Has

We have openings across multiple distributed systems teams. We're looking for engineers who have:

  • A strong grasp of computer science fundamentals when it comes to dealing with distributed systems and networks.
  • A knack for problem-solving and thinking from first principles.
  • A bias towards shipping early and iterating.
  • Experience building distributed systems or is eager to build that skillset.
#J-18808-Ljbffr

  • Senior Software Engineer

    7 days ago

    San Francisco, United States ZipRecruiter Full time

    Job DescriptionPosition: Senior Distributed Systems EngineerWe are looking for a senior distributed systems engineer to join the Core Team (aka our Distributed Systems Team). Our Core Team handles the scheduling, planning, and execution of data syncing. They work on the systems that power our core syncing engine that other engineering teams, as well as...

  • Senior Software Engineer

    1 month ago

    San Francisco, California, United States Ripple Full time

    Build the Future of PaymentsRipple is seeking a highly skilled Senior Software Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and deploying scalable and performant enterprise software solutions for our distributed payment applications.Key Responsibilities:Design and develop software...

  • Senior Distributed Systems Engineer

    12 hours ago

    San Francisco, United States Caldera Full time

    Senior Distributed Systems Engineer (Infrastructure) We're looking for an incredible senior engineer to help us build the future of blockchain scalability. This is an ideal opportunity for an engineer who is already passionate about tackling problems in blockchain scalability, or looking to break into the blockchain engineering space. If you're looking to...

  • Senior Distributed Systems Engineer

    2 weeks ago

    San Francisco, United States Caldera Full time

    Senior Distributed Systems Engineer (Infrastructure)We’re looking for an incredible senior engineer to help us build the future of blockchain scalability.This is an ideal opportunity for an engineer who is already passionate about tackling problems in blockchain scalability or looking to break into the blockchain engineering space. If you’re looking to...

  • Senior Distributed Systems Engineer

    2 weeks ago

    San Francisco, United States Arbitrum Full time

    Senior Distributed Systems Engineer (Infrastructure)We’re looking for an incredible senior engineer to help us build the future of blockchain scalability.This is an ideal opportunity for an engineer who is already passionate about tackling problems in blockchain scalability, or looking to break into the blockchain engineering space. If you’re looking to...

  • Software Engineer, Distributed Systems

    2 weeks ago

    San Francisco, United States OpenAI Full time

    About the TeamThe Platform Runtime team builds the low-level framework components to power our ML training systems. We work on building robust, scalable, high-performance components to support our distributed training workloads. Our priorities are to maximize the productivity of our researchers and our hardware, with the goal of accelerating progress towards...

  • Senior Software Engineer

    15 hours ago

    San Francisco, United States Skale Talent Full time

    Senior Software Engineer - ML infrastructure, distributed systems We’re partnering with a leading autonomous driving company in San Francisco who are looking for a Senior Software Engineer to join their team. They are working on a scalable highway autonomy product for the consumer car market. Working directly with several OEM partners, they’re building...

  • Software Engineer, Distributed Systems

    4 weeks ago

    San Francisco, United States OpenAI Full time

    About the Team The Platform Runtime team builds the low level framework components to power our ML training systems. We work on building robust, scalable, high performance components to support our distributed training workloads. Our priorities are to maximize the productivity of our researchers and our hardware, with the goal of accelerating progress...

  • Distributed Systems Software Engineer

    4 weeks ago

    San Diego, California, United States Canonical - Jobs Full time

    We are seeking a skilled software engineer to join our team at Canonical. As a Distributed Systems Software Engineer, you will play a key role in building and validating resilient distributed systems.Key Responsibilities:Create automated testing approaches and infrastructure for validating reliability, performance, and resilience of cloud orchestration tools...

  • Senior Software Engineer

    3 weeks ago

    San Francisco, United States Acceler8 Talent Full time

    Senior Software Engineer (AI Infrastructure / MLOps)Location: San Francisco (3 days per week in office)Introduction:We are seeking a Senior Software Engineer (AI Infrastructure / MLOps) to join a pioneering AI startup focused on enhancing data quality for machine learning. This role offers the chance to work on large-scale web applications and tackle complex...

  • Distributed Systems Software Engineer

    3 weeks ago

    San Francisco, United States salesforce.com, inc. Full time

    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job Category: Software EngineeringAbout Salesforce:We're Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry...

  • Senior Software Engineer

    1 month ago

    san francisco, United States Acceler8 Talent Full time

    Senior Software Engineer (AI Infrastructure / MLOps)Location: San Francisco (3 days per week in office)Introduction:We are seeking a Senior Software Engineer (AI Infrastructure / MLOps) to join a pioneering AI startup focused on enhancing data quality for machine learning. This role offers the chance to work on large-scale web applications and tackle complex...

  • Senior Software Engineer

    4 months ago

    San Francisco, United States Acceler8 Talent Full time

    Senior Software Engineer (AI Infrastructure / MLOps)Location: San Francisco (3 days per week in office)Introduction:We are seeking a Senior Software Engineer (AI Infrastructure / MLOps) to join a pioneering AI startup focused on enhancing data quality for machine learning. This role offers the chance to work on large-scale web applications and tackle complex...

  • Senior Software Engineer

    2 months ago

    san francisco, United States Acceler8 Talent Full time

    Senior Software Engineer (AI Infrastructure / MLOps)Location: San Francisco (3 days per week in office)Introduction:We are seeking a Senior Software Engineer (AI Infrastructure / MLOps) to join a pioneering AI startup focused on enhancing data quality for machine learning. This role offers the chance to work on large-scale web applications and tackle complex...

  • Senior Software Engineer, Distributed Systems

    3 weeks ago

    San Francisco, United States Cloudflare, Inc. Full time

    About UsAt Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world's largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without...

  • Senior/Staff/Principal Software Engineer

    2 weeks ago

    San Francisco, United States Argus Labs Full time

    Argus Labs is building the next generation of massively multiplayer online (MMO) games by empowering players with the extensive freedom to build, extend, and influence the game worlds they inhabit. Our approach is centered around World Engine, our state-of-the-art onchain game server framework.World Engine leverages a novel sharded rollup blockchain...

  • Software Engineering Architect

    2 weeks ago

    San Francisco, United States salesforce Full time

    To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job Category: Software EngineeringJob Details:About Salesforce: We’re Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across...

  • Software Engineer

    7 days ago

    San Francisco, United States Wayfinder Full time

    As a Distributed Systems Engineer at Browserbase, you’ll be directly responsible for developing our core web automation platform. You’ll ensure it is high performance, scalable, constantly evolving and growing, and that our customers know they can count on it.As a Distributed Systems Engineer at Browserbase, you will:Build, operate, and grow the...

  • Software Engineer, Distributed Systems

    3 weeks ago

    San Francisco, United States San Francisco Compute Co. Full time

    AboutWe’re the San Francisco Compute Company. We’re building the first real-time compute trading platform. We think that over the next decade, thousands of startups and labs are going to be training and serving large models. They need compute to do this, and we’re building a platform on which that compute can be traded. If we’re successful, it will...

  • Software Engineer

    1 week ago

    San Francisco, United States Informal Systems Inc. Full time

    Software Engineer, EVM SVM Infrastructure - Informal StakingFull TimeRemoteInformal SystemsInformal Systems was founded with a mission to foster trust in software and monetary systems. Our team spent years building state-of-the-art distributed systems and grappling with complexities and limitations. Despite securing billions of dollars in real-world value,...