Full Stack Engineer, LLM APIs

3 weeks ago


San Francisco, United States Abridge AI Inc. Full time

Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients.

Our enterprise-grade technology transforms patient-clinician conversations into structured clinical notes in real-time, with deep EMR integrations. Powered by Linked Evidence and our purpose-built, auditable AI, we are the only company that maps AI-generated summaries to ground truth, helping providers quickly trust and verify the output. As pioneers in generative AI for healthcare, we are setting the industry standards for the responsible deployment of AI across health systems.

We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers working together to empower people and make care make more sense.

The Role

We are seeking Staff and Senior Full Stack Engineers to join our growing team You’ll help us build internal UI products to support LLM Model orchestration, evaluation and dataset curation. You will work closely with our Applied AI and product teams to build innovative ML powered solutions to push the state of the art in Healthcare AI technology.

What You'll Do
  • Design, build, and maintain highly scalable, cloud-based services using TypeScript, Python, and React.
  • Create tooling to support the ML model lifecycle including model evaluations, dataset curation and training infrastructure.
  • Build scalable infrastructure for LLM model orchestration powered by an intuitive and easy to use user experience.
  • Make architecture and technology decisions that align with business needs, balancing innovation with security and reliability.
  • Enhance our platform’s performance and scalability, with a focus on creating seamless user experiences.
  • Work cross-functionally with teams like product, machine learning, and design to ensure the success of new features from conception to deployment.
  • Research and evaluate commercial and open-source tools to implement the most effective and scalable solutions.
  • Advocate for best coding practices, mentor junior engineers, and ensure the growth of technical excellence across the team.
  • Build deep empathy for users, maintaining a user-centric mindset when implementing solutions.
  • Contribute to the development and expansion of our ML infrastructure, ensuring smooth interaction between the product and ML models.
What You'll Bring
  • 5+ years of experience building and scaling distributed systems using modern technologies like TypeScript, Python, React, and Node.js.
  • Hands-on experience integrating and working with Large Language Models (LLMs) and APIs, with familiarity in fine-tuning and prompt engineering.
  • Proficiency in working with cloud services (AWS, GCP), infrastructure as code (Terraform), and containerization (Docker, Kubernetes).
  • Proven experience leading engineering teams or owning major software components from development to production.
  • A background in optimizing and scaling inference systems for LLMs or similar AI-based systems is highly desirable.
  • Experience working in regulated environments (HIPAA, SOC 2, or HITRUST) is a plus.
  • A passion for learning new technologies and sharing knowledge within your team.

Base Salary: $185,000 USD - $265,000+ USD per year + Equity

The salary range provided is based on transparent pay guidelines and is an estimate for candidates residing in the San Francisco and New York City metro areas. The actual base salary will vary depending on the candidate's location, relevant experience, skills, qualifications, and other job-related factors. Additionally, this role may include the opportunity to participate in a company stock option plan as part of the total compensation package.

Must be willing to work from our SF office at least 3x per week (Relocation assistance is available for candidates willing to move to San Francisco).

This position requires a commitment to a hybrid work model, with the expectation of coming into the office a minimum of (3) three times per week.

Must be willing to travel up to 10%.

Why Work at Abridge?
  • Be a part of a trailblazing, mission-driven organization that is powering deeper understanding in healthcare through AI
  • Opportunity to work and grow with talented individuals and have ownership and impact at a high-growth startup.
  • Flexible/Unlimited PTO — Salaried team members can take off as much approved time off as they need, plus 13 paid holidays.
  • Equity — For all salaried team members.
  • Medical insurance — We pay 100% of the premium for you + 75% for dependents. 3 Aetna plans to choose from.
  • Dental & Vision insurance — We pay 100% of the premium for you + 75% for dependents. 2 Aetna plans to choose from.
  • Flexible Spending (FSA) & Health Savings (HSA) Accounts.
  • Learning and Development budget — $3,000 per year for coaching, courses, workshops, conferences, etc.
  • 401k Plan — Contribute pre-tax dollars toward retirement savings.
  • Paid Parental Leave — 16 weeks paid parental leave, for all full-time employees.
  • Flexible working hours — We care more about what you accomplish than what specific hours you’re working.
  • Home Office Budget — We provide up to $1,600 in a one-time reimbursement to set up your home office.
  • Sabbatical Leave — 30 days of paid Sabbatical Leave after 5 years of employment.
Diversity & Inclusion

Abridge is an equal opportunity employer. Diversity and inclusion is at the core of what we do. We actively welcome applicants from all backgrounds (including but not limited to race, gender, educational background, and sexual orientation).

#J-18808-Ljbffr

  • San Francisco, United States ZipRecruiter Full time

    Job Description Abridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients. Our enterprise-grade technology transforms patient-clinician...


  • San Francisco, United States ZipRecruiter Full time

    Job DescriptionAbridge was founded in 2018 with the mission of powering deeper understanding in healthcare. Our AI-powered platform was purpose-built for medical conversations, improving clinical documentation efficiencies while enabling clinicians to focus on what matters most—their patients.Our enterprise-grade technology transforms patient-clinician...


  • San Francisco, United States Kapwing Full time

    Video editing is the final frontier of software tools moving to the cloud. We're making the next generation of modern creators tools to enable everyone to share their story online. Join us at Kapwing on our mission to make content creation fast, accessible, and collaborative. Everyone is a creator. The problem, however, is that today's tools get in the way...


  • San Francisco, United States Kapwing Full time

    Video editing is the final frontier of software tools moving to the cloud. We're making the next generation of modern creators tools to enable everyone to share their story online. Join us at Kapwing on our mission to make content creation fast, accessible, and collaborative. Everyone is a creator. The problem, however, is that today's tools get in the way...


  • San Francisco, United States Kapwing Full time

    Video editing is the final frontier of software tools moving to the cloud. We're making the next generation of modern creators tools to enable everyone to share their story online. Join us at Kapwing on our mission to make content creation fast, accessible, and collaborative. Everyone is a creator. The problem, however, is that today's tools get in the way...

  • Founding Engineer

    2 weeks ago


    San Francisco, United States PathPilot Full time

    Who We’re Looking ForWe need a full-stack engineer with expertise in LLMs and experience using diverse data sources to generate actionable insights. You’ll be solving complex problems and building end-to-end solutions that power AI-driven products. If you’re skilled at turning ideas into reality and thrive in a fast-paced environment, this role is for...


  • San Francisco, United States Cadre Full time

    Full-Stack Engineer Location: San Francisco, CA Hybrid Employment type: Full-time Compensation: $140-180k Salary, 0.15-0.3% Equity About us We're Roger Healthcare, a fast-growing and profitable startup at the forefront of AI healthcare documentation solutions. Our culture reflects the spirit of a dynamic, young team that values close collaboration and...

  • AI Software Engineer

    3 weeks ago


    San Francisco, United States Perplexity AI Full time

    Job DescriptionJob DescriptionPerplexity is seeking an experienced Full Stack AI Software Engineer to help revolutionize the way people search and interact online. In this role, you'll translate cutting-edge AI advances into tangible products for our users.ResponsibilitiesPropose novel product features that can be built with LLMs and integrate them into...


  • San Francisco, United States Cadre Full time

    Full-Stack Engineer Location: San Francisco, CA Hybrid Employment type: Full-time Compensation: $140180k Salary, 0.150.3% Equity About us We're Roger Healthcare, a fast-growing and profitable startup at the forefront of AI healthcare documentation solutions. Our culture reflects the spirit of a dynamic, young team that values close...

  • Full Stack Engineer

    2 weeks ago


    San Francisco, United States Quilt.app Full time

    At Quilt, we're using LLMs and other AI tools to automate the future of technical selling.LLMs are capable of miracles, but without careful control and context they are just token-vomiting parrots.As a Full Stack Engineer, you will build new infrastructure and UX to make LLMs useful for thousands of technical sellers creating billions of dollars in...

  • Full Stack Engineer

    1 week ago


    San Francisco, United States Apex Systems Full time

    Job#: 2040317Job Description:Send resumes to lecklund@apexsystems.comFull Stack Developer:Building user interfaces to include administrative features and GUIs around monitoring calls, utilizing underlying LLMs.Experience with AI applications, NLP, LLM preferred. Independent research or project work in the domain is acceptable.Flexible architecture design...


  • San Francisco, United States Panda Training Oy Full time

    Location: Remote (we have offices in Helsinki, San Francisco and Curitiba where you could work)Employment Type: Full-TimeAt Pandatron, we’re revolutionizing the way organizations unlock the potential of their people through AI-driven coaching solutions. Our platform leverages the latest LLM/ML technologies to deliver personalized, scalable coaching...

  • Full Stack Engineer

    2 weeks ago


    San Francisco, United States Accend (YC S23) Full time

    About AccendAccend is pioneering the next generation of AI-powered risk, compliance and underwriting automation tools for fintechs and banks. Our platform streamlines complex KYB (Know Your Business) processes using AI, allowing risk experts at fintechs to focus on excelling at compliance and acquiring new customers. Our KYB solution is trusted by industry...

  • Full Stack Engineer

    1 month ago


    San Francisco, United States Venture Backed Tech Company Full time

    Job DescriptionJob DescriptionAbout UsDoctors are overwhelmed, burnt out, and leaving the field in large numbers. We are on a mission to change that. By combining deep empathy for clinicians with the latest AI technologies, we create products that make clinicians happier and more productive.Our first product is an AI-powered medical scribe that automates...

  • Fullstack Engineer

    2 weeks ago


    San Francisco, United States AccrueTalent Full time

    I’m working with an exciting, fast-growing startup in San Francisco that’s on the hunt for a talented Full Stack Engineer. If you’re looking to make a real impact by working with cutting-edge technologies like AI and LLMs, this is the opportunity for you!What You'll Do:Dive into the full stack—backend, frontend, infrastructure, and design—bringing...

  • Full stack engineer

    2 weeks ago


    San Francisco, United States Truva AI Full time

    Why Join TruvaTruva stands at the forefront of SaaS innovation, specializing in automating tasks, optimizing workflows, and delivering unparalleled sales productivity with LLMs. Truva is led by Gaurav - 2x founder and an alumnus of Stanford, and Anuja - an alumnus of Haas MBA from UC Berkeley. Together, they bring a combined experience of 20 years ranging...

  • Full Stack Engineer

    2 weeks ago


    San Francisco, United States SPHERE Full time

    We’re looking for a full stack engineer at Sphere to help build out our global tax compliance platform!About SphereSphere helps US software companies manage their global sales tax / VAT / GST compliance requirements.Companies like Runway AI choose our platform because we’re the only product that offers true global coverage, is easy to implement and...


  • San Francisco, United States Venture Backed Tech Company Full time

    Job Description Job Description About Us Doctors are overwhelmed, burnt out, and leaving the field in large numbers. We are on a mission to change that. By combining deep empathy for clinicians with the latest AI technologies, we create products that make clinicians happier and more productive. Our first product is an AI-powered medical scribe that automates...

  • Full Stack Engineer

    5 months ago


    San Francisco, United States Stealth Aviation AI Full time

    Are you passionate about revolutionizing aviation training through innovative mobile and desktop applications? Join our team as a Full Stack Engineer and contribute to the development of a groundbreaking platform that offers AI powered aviation training.About Us: We are a pioneering company focused on transforming training through AI. We are still in stealth...

  • Full Stack Engineer

    1 month ago


    san francisco, United States Stealth Aviation AI Full time

    Are you passionate about revolutionizing aviation training through innovative mobile and desktop applications? Join our team as a Full Stack Engineer and contribute to the development of a groundbreaking platform that offers AI powered aviation training.About Us: We are a pioneering company focused on transforming training through AI. We are still in stealth...