Senior Research Engineer, Model Inference

3 weeks ago


Mountain View, United States Otter.ai Full time
The Opportunity

If you are a Research Engineer with expertise in model optimization and integration into production environments, and a passion for applying state-of-the-art AI innovations to make conversations more valuable, look no further

As a Research Engineer on our Platform team, you'll advance the frontier of AI by maximizing efficiency and performance to achieve feats previously thought impossible. You'll do so by optimizing and deploying machine learning models for real-time applications. Join us alongside a cohort of industry-leading scientists, ML engineers, and production engineers as we grow Otter's AI-powered collaboration platform that's transcribed over 1B meetings. Together, we strive to elevate the value of conversations through innovative solutions.
Your Impact
  • Model optimization: Collaborate with machine learning researchers to understand model architectures and algorithms.
  • Implement optimization techniques to enhance machine learning models' efficiency and inference speed on production
  • Deployment and Integration: Work closely with product engineers to integrate machine learning models into production systems in a scalable way
  • Optimize models for real-time inference, ensuring low latency and high-throughput
  • Set up monitoring systems to track model performance in real time.
  • Ensure models can scale horizontally to handle the increased load.
  • Implement strategies for resource-efficient inference, considering factors such as memory usage and CPU/GPU utilization.
  • Collaborate with cross-functional teams to understand requirements and constraints.
  • Provide technical expertise on inference-related matters during the model development lifecycle.
  • Document the deployment and optimization processes for machine learning models.
We're looking for someone who
  • 5+ years of professional industry experience
  • Masters or Ph.D. degree in computer science, machine learning, speech/language processing or related field
  • Experience in PyTorch
  • Proficiency in Python
  • Experience in C++
  • Basic knowledge of CUDA
  • Strong understanding of machine learning models, algorithms, and deployment strategies
  • Experience with model optimization techniques and performance profiling
  • Familiarity with docker and Kubernetes
  • Knowledge of AWS
  • Experience with monitoring tools

About Otter.ai

We are in the business of shaping the future of work. Our mission is to make conversations more valuable.

With over 1B meetings transcribed, Otter.ai is the world's leading tool for meeting transcription, summarization, and collaboration. Using artificial intelligence, Otter generates real-time automated meeting notes, summaries, and other insights from in-person and virtual meetings - turning meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations. The company is backed by early investors in Google, DeepMind, Zoom, and Tesla.

Otter.ai is an equal opportunity employer. We proudly celebrate diversity and are dedicated to inclusivity.

*Otter.ai does not accept unsolicited resumes from 3rd party recruitment agencies without a written agreement in place for permanent placements. Any resume or other candidate information submitted outside of established candidate submission guidelines (including through our website or via email to any Otter.ai employee) and without a written agreement otherwise will be deemed to be our sole property, and no fee will be paid should we hire the candidate.

Salary range

Salary Range: $200,000 to $250,000 USD per year.

This salary range represents the low and high end of the estimated salary range for this position. The actual base salary offered for the role is dependent based on several factors. Our base salary is just one component of our comprehensive total rewards package.

  • Mountain View, California, United States Otter Full time

    About the RoleWe are seeking an experienced AI Inference Optimization Engineer to join our Platform team. As a key member of this team, you will be responsible for advancing the frontier of AI by maximizing efficiency and performance.Key Responsibilities:Model Optimization: Collaborate with machine learning researchers to understand model architectures and...


  • Mountain View, United States Otter.ai Full time

    The Opportunity If you are a Research Engineer with expertise in model optimization and integration into production environments, and a passion for applying state-of-the-art AI innovations to make conversations more valuable, look no further! As a Research Engineer on our Platform team, you'll advance the frontier of AI by maximizing efficiency and...


  • Mountain View, United States Intuit Full time

    Overview How should TurboTax be using causal inference and machine learning methods to make decisions across marketing, product, and business strategy? We are looking for a talented Staff Data Scientist who can lead the way in how we identify opportunities and drive major business impact with a well-rounded data science toolkit. Being part of our...


  • Mountain View, California, United States Otter Full time

    About OtterOtter is a pioneering startup based in Silicon Valley dedicated to revolutionizing conversations by making them more valuable. Our mission is to empower individuals and organizations to unlock the full potential of their interactions.Key Responsibilities:We are seeking a highly skilled Conversation AI Research Specialist to join our team. The...


  • Mountain View, California, United States HAUS Full time

    About Haus, a cutting-edge decision science platform:Haus revolutionizes the new digital privacy paradigm by harnessing frontier causal inference based econometric models to drive business outcomes. Our team of experts from Google, Netflix, Amazon, and Meta craft high-quality decision science tooling and incrementality testing, making it accessible to all...


  • Mountain View, California, United States DeepMind Technologies Limited Full time

    We are seeking an experienced Senior Multilingual Language Model Researcher to join our team at DeepMind Technologies Limited in Mountain View, California.Company OverviewDeepMind is a world leader in artificial intelligence research and technology. Our mission is to advance the state of AI for the benefit of humanity.Estimated Salary: $240,000 - $340,000...


  • Mountain View, United States NDC Tek Full time

    Senior Research Engineer - Mountain View - $500,000 Base SalaryNDC Tek are currently looking for multiple Senior Research Engineers based in the Mountain View area for a number of different clients spanning from text-to-video generation start-ups to NLP companies that accelerate contract review using Artificial Intelligence! Most if not all of our customers...


  • mountain view, United States NDC Tek Full time

    Senior Research Engineer - Mountain View - $500,000 Base SalaryNDC Tek are currently looking for multiple Senior Research Engineers based in the Mountain View area for a number of different clients spanning from text-to-video generation start-ups to NLP companies that accelerate contract review using Artificial Intelligence! Most if not all of our customers...


  • Mountain View, California, United States Amiri Recruiting Full time

    Job OverviewAmiri Recruiting is seeking a highly skilled Senior AI Research Software Engineer to join our team.This is an exciting opportunity to work on cutting-edge AI projects and contribute to the development of innovative technologies.About the RoleWe are looking for a talented engineer to lead our AI research efforts and drive the development of new...


  • Mountain View, California, United States Moveworks Full time

    Skill Up Your Career with Moveworks!Are you ready to take your career to the next level? Join Moveworks, a leading innovator in AI-powered search and automation, as a Machine Learning Engineer. With our state-of-the-art technology and collaborative team environment, you'll have the opportunity to develop and deploy large language models at scale.We're...


  • Mountain View, Arkansas, United States HMBL Full time

    About the RoleWe are seeking a highly skilled Senior NLP Research Engineer to join our team at HMBL. As a key member of our research and development team, you will be responsible for designing and developing cutting-edge NLP solutions that help people get unparalleled value from meetings and conversations.Key Responsibilities:Work with cutting-edge...


  • Mountain View, United States Samsung Electronics America North America Full time

    Samsung Ads is an advanced advertising technology company in rapid growth that focuses on enabling brands to connect with Samsung TV audiences as they are exposed to digital media by using the industrys most comprehensive data to build the worlds smartest advertising platform. Being part of an international company such as Samsung and doing business...


  • Mountain View, United States Samsung Electronics America North America Full time

    Samsung Ads is an advanced advertising technology company in rapid growth that focuses on enabling brands to connect with Samsung TV audiences as they are exposed to digital media by using the industrys most comprehensive data to build the worlds smartest advertising platform. Being part of an international company such as Samsung and doing business...


  • Mountain View, California, United States Microsoft Corporation Full time

    About the RoleWe are seeking a highly skilled Senior Machine Learning Research Engineer to join our team at Microsoft Corporation in Mountain View, CA.Job DescriptionThe ideal candidate will have extensive experience in machine learning research and development, with a strong background in deep learning, natural language processing, and computer vision. They...

  • Machine Learning Model

    5 months ago


    Mountain View, United States Samsung Electronics America North America Full time

    Samsung Ads is an advanced advertising technology company in rapid growth that focuses on enabling brands to connect with Samsung TV audiences as they are exposed to digital media by using the industry’s most comprehensive data to build the world’s smartest advertising platform. Being part of an international company such as Samsung and doing business...


  • mountain view, United States Acceler8 Talent Full time

    Pioneering (Lead) Machine Learning ResearcherJoin our pioneering team at the forefront of AGI computing. We're dedicated to crafting a comprehensive AGI compute platform, covering hardware and software from silicon to systems. If you're passionate about pushing the boundaries in systems-focused ML research, join us on this impactful journey!Key...


  • mountain view, United States Acceler8 Talent Full time

    Pioneering (Lead) Machine Learning ResearcherJoin our pioneering team at the forefront of AGI computing. We're dedicated to crafting a comprehensive AGI compute platform, covering hardware and software from silicon to systems. If you're passionate about pushing the boundaries in systems-focused ML research, join us on this impactful journey!Key...


  • Mountain View, United States Acceler8 Talent Full time

    Pioneering (Lead) Machine Learning ResearcherJoin our pioneering team at the forefront of AGI computing. We're dedicated to crafting a comprehensive AGI compute platform, covering hardware and software from silicon to systems. If you're passionate about pushing the boundaries in systems-focused ML research, join us on this impactful journey!Key...


  • mountain view, United States DeepRec.ai Full time

    Applied Machine Learning Research EngineerLocation: Onsite / Hybrid, Mountain View, CACompany: Stealth Mode GenAI StartupJoin a stealth mode GenAI startup backed by a top VC, they are currently a team of 10, with folks from Google, Twitter, and Coinbase to name a few. This company have recently secured a huge funding round and are focused on building...


  • Mountain View, United States DeepRec.ai Full time

    Applied Machine Learning Research EngineerLocation: Onsite / Hybrid, Mountain View, CACompany: Stealth Mode GenAI StartupJoin a stealth mode GenAI startup backed by a top VC, they are currently a team of 10, with folks from Google, Twitter, and Coinbase to name a few. This company have recently secured a huge funding round and are focused on building...