Founding Backend Engineer

4 weeks ago

California, United States LiteLLM Full time

TLDR LiteLLM is an open-source LLM Gateway with 18K+ stars on GitHub and trusted by companies like Rocket Money, Samsara, Lemonade, and Adobe. Were rapidly expanding and seeking a founding full-stack engineer to help scale the platform. Were based in San Francisco. What is LiteLLM LiteLLM provides an open source Python SDK and Python FastAPI Server that allows calling 100+ LLM APIs (Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic) in the OpenAI format We have raised a $1.6M seed round from Y Combinator, Gravity Fund and Pioneer Fund. You can find more information on our website, Github and Technical Documentation. Why do companies use LiteLLM enterprise Companies use LiteLLM Enterprise once they put LiteLLM into production and need enterprise features like Prometheus metrics (production monitoring) and need to give LLM access to a large number of people with SSO (secure sign on) or JWT (JSON Web Tokens). What you will be working on Your main responsibility will be to ensure that LiteLLM unifies the format for calling LLM APIs in the OpenAI spec. This involves writing transformations to convert API requests from the OpenAI spec to the format of the LLM provider. You will work closely with our CEO and CTO. Example projects include: Migrating key systems from httpx to aiohttp for 10x higher throughput Adding support for Anthropic, Bedrock Anthropic thinking parameter Handling provider-specific quirks like OpenAI o-1 streaming support Ensuring LiteLLM can compute aggregate spend with 1M+ logs Adding cost tracking and logging for /v1/messages Anthropic API Our tech stack Backend on Python, FastAPI; frontend on JS/TS; Redis, Postgres, S3, GCS Storage, Datadog, Slack API. Who we are looking for 1-2 years experience in backend or full-stack development with production-grade systems Excited about open source software and engaging with users Experience in maintaining and scaling high-performance infrastructure Hardworking and able to work in a small, accountable team Eager to shape the infrastructure of a rapidly growing tool #J-18808-Ljbffr

  • Founding backend engineer

    3 weeks ago

    California, United States Athe Full time

    Athean began at Verkada as an internal sales prospecting tool in response to the challenges posed by a rapidly growing sales team, where traditional prospecting methods and existing tools were becoming less effective. Since its internal launch, weve seen overwhelming adoption from our 500 person sales team, with resounding preference over existing,...

  • Founding backend engineer

    1 hour ago

    California, United States Athe Full time

    Athean began at Verkada as an internal sales prospecting tool in response to the challenges posed by a rapidly growing sales team, where traditional prospecting methods and existing tools were becoming less effective. Since its internal launch, weve seen overwhelming adoption from our 500 person sales team, with resounding preference over existing,...

  • Founding Backend Engineer

    3 weeks ago

    California, United States LiteLLM Full time

    TLDR LiteLLM is an open-source LLM Gateway with 18K+ stars on GitHub and trusted by companies like Rocket Money, Samsara, Lemonade, and Adobe. Were rapidly expanding and seeking a founding full-stack engineer to help scale the platform. Were based in San Francisco. What is LiteLLM LiteLLM provides an open source Python SDK and Python FastAPI Server that...

  • Senior Backend Engineer

    4 weeks ago

    California, United States Nash Full time

    Nash is building the logistics infrastructure for the internet Last mile is a $500B industry powering digital commerce but managed largely with self managed API integrations. Nash approaches last mile orchestration with information completeness solutions from checkout, courier management, customer engagement, and post-purchase experience. Doing this enables...

  • Senior Backend Engineer

    3 weeks ago

    California, United States Nash Full time

    Nash is building the logistics infrastructure for the internet Last mile is a $500B industry powering digital commerce but managed largely with self managed API integrations. Nash approaches last mile orchestration with information completeness solutions from checkout, courier management, customer engagement, and post-purchase experience. Doing this enables...

  • Senior Backend Engineer

    2 weeks ago

    California, MO, United States Nash Full time

    Nash is building the logistics infrastructure for the internet Last mile is a $500B industry powering digital commerce but managed largely with self managed API integrations. Nash approaches last mile orchestration with information completeness solutions from checkout, courier management, customer engagement, and post-purchase experience. Doing this enables...

  • Founding Mobile Engineer

    1 week ago

    California, United States Next Ventures Full time

    This range is provided by Next Ventures. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $150,000.00/yr - $180,000.00/yr Senior Mobile Engineer Sports & Entertainment Startup We’re looking for a founding-level Senior Mobile Engineer to lead the development of cross-platform mobile apps...

  • Founding Product Engineer

    6 days ago

    California, United States Artie Full time

    About the roleWe're a small, dynamic team based in San Francisco, and we're looking for a founding engineer to join us. In this in-person role, you'll have the opportunity to wear multiple hats, interact directly with our customers, and play a vital part in shaping the future of our product.This is a challenging and dynamic role where you'll be working at...

  • Backend Software Engineer

    1 week ago

    California, United States Vapi Full time

    Company Overview Apple Intelligence and Google Gemini are about to onboard 4 billion people to voice assistants that actually talk like people. This marks a new beginning for voice as the world’s default interface. We will all want voice everywhere . Businesses are not ready. Products are not ready. We’re building the infrastructure that helps developers...

  • Senior Python Backend Engineer

    4 weeks ago

    California, United States activeloop llc Full time

    At Activeloop we are transforming the way organizations harness their data for AI with our Deep Lake and Multi-modal AI Search. Whether you're answering critical clinical questions or searching across vast repositories of scientific papers, we empower you to index, search and organize billions of documents, images, and videos intuitively using natural...