Senior Software Engineer, Infrastructure

6 days ago


Mountain View, CA, United States Otter.ai Full time
The Opportunity

We're looking for an experienced Senior Software Engineer to join a team that empowers you to grow, be your authentic self, and do your best work every day. At Otter, we've built a platform that simplifies note taking, saves time, improves productivity and accessibility, and makes collaboration effortless. If this mission resonates with you, let's talk.

We need your help building the infrastructure that powers some of the most advanced multi-language, automatic speech recognition (ASR) and real-time speaker identification systems on the market. You'll design and scale the backend platforms that bring cutting-edge speech AI to life, working shoulder-to-shoulder with our machine learning researchers and product managers to deliver resilient, high-performance systems that enable real-time, multilingual AI experiences at scale.

If you're passionate about building rock-solid infrastructure for AI-driven products, enjoy solving complex distributed-systems problems, and want your work to have an immediate impact on millions of users, this is your opportunity.
Your Impact
  • Design, build, and operate backend services that power real-time, multi-language, ASR and speaker identification features.
  • Architect scalable, fault-tolerant infrastructure across databases, queues, and pub/sub systems to support low-latency ML workflows.
  • Partner with ML teams to apply models into production (training pipelines, model deployment, versioning, and monitoring) for real-time and batch inference.
  • Improve system observability, reliability, and performance for large-scale speech data ingestion and streaming.
  • Contribute to the evolution of our platform architecture, including microservices, orchestration (Kubernetes), and API integrations.
  • Collaborate with cross-functional teams to streamline developer experience, CI/CD pipelines, and automated testing for ML-backed services.
We're Looking for Someone Who
  • Has5+ years of experience designing and building scalable backend systems and distributed infrastructure.
  • Is fluent in Python (bonus for C++) and familiar with building high-performance services.
  • Understands data structures, algorithms, distributed systems, and operating systems at a deep level.
  • Has worked with databases (SQL & NoSQL), queuing systems, and pub/sub solutions, and knows what's happening "under the hood."
  • Has experience with ML infrastructure / MLOps (e.g., model deployment, feature stores, pipelines) or is eager to learn quickly.
  • Enjoys collaborating with ML engineers and product teams to translate research into production-ready systems.
  • Thrives in a fast-paced environment where innovation and reliability go hand in hand.
Nice to Haves
  • Experience with real-time streaming frameworks (Kafka, Pulsar, Flink).
  • Hands-on experience with container orchestration (Kubernetes, ECS).
  • Familiarity with SDK integrations or developer platform design.
  • Experience building or optimizing speech/voice AI pipelines.
About Otter.ai

We are in the business of shaping the future of work. Our mission is to make conversations more valuable.

With over 1B meetings transcribed, Otter.ai is the world's leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.

Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are committed to building an inclusive and accessible workplace. We provide reasonable accommodations for qualified applicants throughout the hiring process.
Accessibility & Accommodations

Otter.ai is committed to providing reasonable accommodations for candidates with disabilities in our hiring process. If you need assistance or an accommodation during any stage of the recruitment process, please contact hr@otter.ai at least 3 business days before your interview.

*Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.
Salary range

Salary Range: $185,000 to $230,000.00 USD per year.

This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent on several factors. Our base salary is just one component of a comprehensive total rewards package.

  • Mountain View, CA, United States Nuro Full time

    Senior Software Engineer, Cloud Infrastructure Nuro is a self-driving technology company on a mission to make autonomy accessible to all. Founded in 2016, Nuro is building the world's most scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro licenses its core technology, the Nuro Driver, to support a wide range of applications,...


  • Mountain View, CA, United States Nuro Full time

    Senior Software Engineer, Cloud Infrastructure Nuro is a self-driving technology company on a mission to make autonomy accessible to all. Founded in 2016, Nuro is building the world's most scalable driver, combining cutting-edge AI with automotive-grade hardware. Nuro licenses its core technology, the Nuro Driver, to support a wide range of applications,...


  • Mountain View, CA, United States General Motors Full time

    Join General Motors in driving the future of AI innovation! Our AI Core Infrastructure team, under the Chief AI Officer, is at the forefront of powering GM's enterprise-wide AI capabilities, impacting everything from customer in-vehicle experiences to manufacturing excellence. We are focused on designing the foundational AI infrastructure that supports GM's...


  • Mountain View, CA, United States General Motors Full time

    Join General Motors in driving the future of AI innovation! Our AI Core Infrastructure team, under the Chief AI Officer, is at the forefront of powering GM's enterprise-wide AI capabilities, impacting everything from customer in-vehicle experiences to manufacturing excellence. We are focused on designing the foundational AI infrastructure that supports GM's...


  • Mountain View, CA, United States LinkedIn Full time

    Senior Software Engineer - Security Infrastructure Full-time Workplace Type: Hybrid LinkedIn is the worlds largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every...


  • Mountain View, CA, United States California Staffing Corporation Full time

    Senior Software Engineer, Infrastructure Payments Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas...


  • Mountain View, CA, United States Waymo Full time

    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver-The World's Most Experienced Driver™-to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo...


  • Mountain View, CA, United States Waymo Full time

    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver-The World's Most Experienced Driver™-to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo...


  • Mountain View, CA, United States Reliable Robotics Corporation Full time

    We're building safety-enhancing technology for aviation that will save lives. Automated aviation systems will enable a future where air transportation is safer, more convenient and fundamentally transformative to the way goods - and eventually people - move around the planet. We are a team of mission-driven engineers with experience across aerospace,...


  • Mountain View, CA, United States Reliable Robotics Corporation Full time

    We're building safety-enhancing technology for aviation that will save lives. Automated aviation systems will enable a future where air transportation is safer, more convenient and fundamentally transformative to the way goods - and eventually people - move around the planet. We are a team of mission-driven engineers with experience across aerospace,...