Backend Infrastructure Lead

2 months ago

San Francisco, United States Martian Full time

About Martian:

  • Martian is doing for LLMs what Google did for websites. In the early internet, the number of websites was exploding and it was hard to figure out what website you should use for what task. Google fixed that problem by building a search engine that aggregated websites across the internet. A similar problem exists in AI today; the number of models is exploding and it's hard to figure out what model you should use for what task. Martian fixes that problem through a model router: You give us your prompt, we run it on the best model in real time.
  • We can do this because we've learned how to predict the performance of a model without running it. That lets us find a model which can complete your request with the highest performance and lowest cost. The value proposition is simple: stop worrying about AI, start focusing on product.
  • That idea -- making it so that people can stop worrying about AI -- is the core of what we do. Model-routing is just the first tool we're building to help understand the way in which models behave. By pioneering techniques like this, we want to solve the most fundamental problem in AI: understanding why models behave the way they do, and creating guarantees they'll behave the way we want.


About the role:

  • We are seeking someone to manage the development of the API and backend infrastructure that clients will use to access the model router API and the microservices around it.


In this role, you will:

  • Design and build the dev and prod platforms for our router and our enterprise product
  • Create excellent tooling, systems, and engineering culture for both the backend and ML Engineering teams
  • Own and execute on features for Martian’s core routing product
  • Help create a sharp and open culture — we’re a startup, many things will break, and we can work together to fix them
  • Like all other teams, we are responsible for the reliability of the systems we build. This includes an on-call rotation to respond to critical incidents as needed.

Key Requirements

  • DevOps, Infra, and K8s experience

You might thrive in this role if you:

  • Have 8+ years of engineering experience and includes 4+ years of infrastructure experience
  • Enjoy building and operating scalable, reliable, and secure systems
  • Have experience with: Kubernetes, Python, FastAPI, MongoDB, and Microservicess Architectures.


What We Offer:

  • Competitive salary and equity packages
  • Health, dental, and vision insurance plans
  • Unlimited PTO
  • Daily lunch
  • Team dinners

  • Backend Infrastructure Lead

    4 weeks ago

    san francisco, United States Martian Full time

    About Martian:Martian is doing for LLMs what Google did for websites. In the early internet, the number of websites was exploding and it was hard to figure out what website you should use for what task. Google fixed that problem by building a search engine that aggregated websites across the internet. A similar problem exists in AI today; the number of...

  • Backend Infrastructure Lead

    1 month ago

    san francisco, United States Martian Full time

    About Martian:Martian is doing for LLMs what Google did for websites. In the early internet, the number of websites was exploding and it was hard to figure out what website you should use for what task. Google fixed that problem by building a search engine that aggregated websites across the internet. A similar problem exists in AI today; the number of...

  • Backend Infrastructure Architect

    2 hours ago

    San Francisco, California, United States Openlayer Inc. Full time

    About the RoleAs a backend engineer at Openlayer Inc., you will play a pivotal role in architecting and building the infrastructure that powers our core product, enabling AI teams worldwide to deploy and monitor their models with confidence.Key ResponsibilitiesWe're seeking an experienced Backend Engineer to design and develop scalable, reliable, and secure...

  • Senior Backend Infrastructure Developer

    52 minutes ago

    San Francisco, California, United States Atomus Full time

    About AtomusWe are a leading provider of world-class cybersecurity solutions for critical organizations. Our mission is to deliver security compliance software as managed services, with professional support and relevant expertise.Located in San Francisco, CA, our team is dedicated to building scalable infrastructure to alleviate risk and ensure compliance...

  • Backend Infrastructure Architect for Blockchain Ecosystem

    2 hours ago

    San Francisco, California, United States Hashed, Inc. Full time

    About Halliday International Inc.Halliday unifies your Appchain, offering a seamless onboarding experience and one-click acquisition and management of any asset on any chain through our proprietary Orchestration Layer. Backed by prominent investors, we have partnered with leading developers to create a digital multi-chain ecosystem.Our team consists of...

  • Lead Engineer with backend and platform expertise

    2 weeks ago

    san francisco, United States Preffect Full time

    About the RolePreffect is seeking a seasoned Lead Engineer with backend and platform expertise to drive our technical infrastructure and guide our engineering team through the next phase of growth. As a technical leader, you will oversee the design and implementation of our backend systems, ensuring scalability, reliability, and security. You will play a...

  • Lead Engineer with backend and platform expertise

    2 weeks ago

    san francisco, United States Preffect Full time

    About the RolePreffect is seeking a seasoned Lead Engineer with backend and platform expertise to drive our technical infrastructure and guide our engineering team through the next phase of growth. As a technical leader, you will oversee the design and implementation of our backend systems, ensuring scalability, reliability, and security. You will play a...

  • Lead Engineer with backend and platform expertise

    2 weeks ago

    San Francisco, United States Preffect Full time

    About the RolePreffect is seeking a seasoned Lead Engineer with backend and platform expertise to drive our technical infrastructure and guide our engineering team through the next phase of growth. As a technical leader, you will oversee the design and implementation of our backend systems, ensuring scalability, reliability, and security. You will play a...

  • Member of Technical Staff: Backend Engineer

    2 months ago

    san francisco, United States Acceler8 Talent Full time

    Member of Technical Staff: Backend EngineerAre you an experienced backend engineer ready to tackle real-world AI challenges? We are seeking a Member of Technical Staff: Backend Engineer to join a leading company innovating in the AI space. This role is ideal for someone who excels at building robust backend systems and has a passion for solving complex...

  • Member of Technical Staff: Backend Engineer

    4 months ago

    San Francisco, United States Acceler8 Talent Full time

    Member of Technical Staff: Backend EngineerAre you an experienced backend engineer ready to tackle real-world AI challenges? We are seeking a Member of Technical Staff: Backend Engineer to join a leading company innovating in the AI space. This role is ideal for someone who excels at building robust backend systems and has a passion for solving complex...

  • Member of Technical Staff: Backend Engineer

    1 month ago

    san francisco, United States Acceler8 Talent Full time

    Member of Technical Staff: Backend EngineerAre you an experienced backend engineer ready to tackle real-world AI challenges? We are seeking a Member of Technical Staff: Backend Engineer to join a leading company innovating in the AI space. This role is ideal for someone who excels at building robust backend systems and has a passion for solving complex...

  • Backend Engineer

    3 weeks ago

    San Francisco, United States Standard Fleet Full time

    Why Standard Fleet? Electric vehicles are superior for just about every business use case. Businesses are rapidly adopting them but lack the software infrastructure to unlock their true value. Our mission is to accelerate the commercial adoption of electric vehicle fleets by setting the standard in EV fleet management. Every member of the Standard Fleet team...

  • Backend Architect

    2 weeks ago

    San Jose, California, United States Tik Tok Full time

    About UsTikTok is a global platform for short-form mobile video. We strive to inspire creativity and bring joy to our users. Our infrastructure is built to support the fast-paced nature of our platform.ResponsibilitiesWe are seeking a skilled Backend Engineer to join our team. Key responsibilities include designing, developing and maintaining robust and...

  • Backend Platform Engineer

    4 months ago

    San Francisco, United States Acceler8 Talent Full time

    Backend Platform EngineerLocation: San Francisco (Flexible/Hybrid)Introduction:We are looking for a skilled Backend Platform Engineer to join a leading AI-focused startup. In this role, you'll have the chance to shape our data platform and work with advanced MLOps technologies. If you have a solid engineering background and a knack for developing scalable...

  • Experienced Backend Engineer

    4 months ago

    San Francisco, United States Acceler8 Talent Full time

    Experienced Backend EngineerLocation: San Francisco (Flexible/Hybrid)Introduction:We are seeking an Experienced Backend Engineer to join a dynamic startup at the forefront of data-centric AI. Our company, a leading innovator in this field, is driven by a mission to enhance data quality for AI models. If you are an engineer with a robust background in...

  • BackEnd Software Engineer, BackEnd Developer

    2 weeks ago

    san francisco, United States MoTek Technologies Full time

    Sr. / Principal BackEnd Software Engineer - BackEnd Developer / Python / C / C++ Our Backend Software Engineers do the hard work to make sure we keep up with the immense amount of data volume growth we get each month. They maintain and improve our in-­house database and help design new backend infrastructure that is capable of processing billions of data...

  • BackEnd Software Engineer, BackEnd Developer

    2 weeks ago

    San Francisco, United States MoTek Technologies Full time

    Sr. / Principal BackEnd Software Engineer - BackEnd Developer / Python / C / C++ Our Backend Software Engineers do the hard work to make sure we keep up with the immense amount of data volume growth we get each month. They maintain and improve our in-­house database and help design new backend infrastructure that is capable of processing billions of data...

  • Backend Platform Engineer

    1 month ago

    san francisco, United States Acceler8 Talent Full time

    Backend Platform EngineerLocation: San Francisco (Flexible/Hybrid)Introduction:We are looking for a skilled Backend Platform Engineer to join a leading AI-focused startup. In this role, you'll have the chance to shape our data platform and work with advanced MLOps technologies. If you have a solid engineering background and a knack for developing scalable...

  • Backend Platform Engineer

    2 months ago

    san francisco, United States Acceler8 Talent Full time

    Backend Platform EngineerLocation: San Francisco (Flexible/Hybrid)Introduction:We are looking for a skilled Backend Platform Engineer to join a leading AI-focused startup. In this role, you'll have the chance to shape our data platform and work with advanced MLOps technologies. If you have a solid engineering background and a knack for developing scalable...

  • Backend Platform Engineer

    4 months ago

    San Francisco, United States Acceler8 Talent Full time

    Backend Platform EngineerLocation: San Francisco (Flexible/Hybrid)Introduction:We are looking for a skilled Backend Platform Engineer to join a leading AI-focused startup. In this role, you'll have the chance to shape our data platform and work with advanced MLOps technologies. If you have a solid engineering background and a knack for developing scalable...