AI Inference Optimization Engineer

6 days ago


Mountain View, California, United States Otter Full time
About the Role

We are seeking an experienced AI Inference Optimization Engineer to join our Platform team. As a key member of this team, you will be responsible for advancing the frontier of AI by maximizing efficiency and performance.

Key Responsibilities:
  • Model Optimization: Collaborate with machine learning researchers to understand model architectures and algorithms, implementing optimization techniques to enhance machine learning models' efficiency and inference speed on production systems.
  • Deployment and Integration: Work closely with product engineers to integrate machine learning models into production systems in a scalable way, ensuring low latency and high-throughput.
  • Performance Monitoring: Set up monitoring systems to track model performance in real-time, ensuring models can scale horizontally to handle increased load and implement strategies for resource-efficient inference.
Requirements
  • 5+ years of professional industry experience
  • Masters or Ph.D. degree in computer science, machine learning, speech/language processing, or related field
  • Experience in PyTorch, Python, C++, CUDA, Docker, Kubernetes, AWS, and monitoring tools
  • Strong understanding of machine learning models, algorithms, and deployment strategies, as well as experience with model optimization techniques and performance profiling
About Otter.ai

Otter.ai is shaping the future of work by making conversations more valuable. With over 1B meetings transcribed, we are the world's leading tool for meeting transcription, summarization, and collaboration. Our mission is to turn meetings into accessible, collaborative, and actionable data that can be shared across teams and organizations.

Benefits
  • A competitive salary range of $200,000 to $250,000 USD per year
  • A comprehensive total rewards package, including opportunities for growth and development


  • Mountain View, California, United States Inworld AI Full time

    About Inworld AIInworld AI is a leading provider of artificial intelligence engines for games and interactive media. Our suite of AI components enables developers to build interactive, responsive, and personalized AI gaming experiences.We are seeking an experienced Artificial Intelligence Speech Engineer to join our team in Mountain View, CA, USA. This role...

  • AI Speech Engineer

    5 days ago


    Mountain View, California, United States Inworld AI Full time

    Company OverviewInworld AI is the leading AI engine for games and interactive media. Our suite of AI components enables developers to build interactive, responsive, and personalized AI gaming experiences, orchestrate models to create intelligent game behaviors, and unlock enhanced productivity with AI-generated content.We power experiences built by top...

  • AI Prompt Engineer

    5 days ago


    Mountain View, California, United States Contextual AI Full time

    About the RoleContextual AI's cutting-edge technology enables the development of production-grade AI applications. However, getting models to deliver optimal results requires a systematic approach to prompt engineering. As a Prompt Engineer at Contextual AI, you will apply a range of techniques to systematically discover and document best practices for...


  • Mountain View, California, United States Microsoft Corporation Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our AI Frameworks team at Microsoft. As a member of this team, you will have the opportunity to work on multiple levels of the AI software stack, including fundamental abstractions, programming models, compilers, runtimes, libraries and APIs to enable large scale training and...


  • Mountain View, California, United States Gatik AI Full time

    About UsGatik AI is a leader in autonomous middle mile logistics, delivering goods safely and efficiently using its fleet of light & medium-duty trucks. Our focus is on short-haul, B2B logistics for Fortune 500 customers, optimizing their hub-and-spoke supply chain operations, enhancing service levels, and reducing labor costs.Job SummaryWe are seeking a...

  • Product Owner

    4 days ago


    Mountain View, California, United States Inworld AI Full time

    Ahead of the CurveWe are seeking an experienced Senior Product Manager to lead our AI systems product development. As a key member of our team, you will be responsible for driving the product vision and strategy for AI-powered agents, focusing on developing systems for agentic behavior, planning, reasoning, and player interaction.About Inworld AIInworld AI...

  • AI Mapping Expert

    5 days ago


    Mountain View, California, United States Gatik AI Full time

    **Job Summary:**We're looking for a talented AI Research Scientist to join our team at Perot Jain, where you'll play a crucial role in designing and refining ML algorithms for autonomous truck navigation in complex environments. Collaborating with experts in AI, robotics, and software engineering, you'll work on Offline and Online Mapping Research tracks,...

  • AI Engineer

    1 day ago


    Mountain View, California, United States Inworld AI Full time

    Company Overview">Inworld AI is the leading AI engine for games and interactive media, empowering developers to create immersive experiences.


  • Mountain View, California, United States Inworld AI Full time

    About Inworld AIInworld AI is a leading innovator in the field of AI-powered gaming and interactive media. Our cutting-edge AI engine enables developers to create immersive, responsive, and personalized gaming experiences.We are seeking an experienced Senior Product Manager to lead the development of our AI Engine, including API and SDKs. The ideal candidate...


  • Mountain View, California, United States Ai Brainer Full time

    At Ai Brainer, we are looking for a Senior Data Science Specialist, AI Innovations to join our team. This is a full-time position.Job Summary:We are seeking an experienced Senior Data Science Specialist to lead the development of cutting-edge AI innovations in computational chemistry and material science. As a key member of our team, you will work closely...


  • Mountain View, California, United States Databricks Full time

    About the RoleAs a Data Science Intern at Databricks, you will be an integral part of our data team, working alongside experienced data scientists and engineers to transform business and operations data into actionable insights. This role offers a unique opportunity to join a dynamic team that drives product design, customer acquisition and retention...


  • Mountain View, California, United States Gatik AI Full time

    Unlock the Future of Autonomous LogisticsGatik AI is a pioneer in autonomous middle-mile logistics, revolutionizing the B2B supply chain with its innovative transportation-as-a-service solution. As an AI Research Scientist, you will play a pivotal role in designing and refining ML algorithms that enable our trucks to safely navigate complex...


  • Mountain View, California, United States Inworld AI Full time

    About Inworld AIInworld AI is a leading developer of AI engines for games and interactive media. Our innovative suite of AI components enables developers to build interactive, responsive, and personalized gaming experiences.We power experiences built by top game development studios and have partnerships with industry leaders such as Microsoft Xbox, Epic...


  • Mountain View, California, United States Inworld AI Full time

    About Inworld AIInworld AI is revolutionizing the gaming industry with its innovative AI-powered solutions. Our AI engine empowers developers to build immersive, interactive, and responsive gaming experiences.We are looking for an experienced Senior Product Manager to drive the development of our AI Engine, including API and SDKs. The ideal candidate will...


  • Mountain View, California, United States Inworld AI Full time

    About UsInworld AI is a pioneering company in the field of AI-powered gaming and interactive media. Our mission is to empower developers to create immersive, interactive, and responsive gaming experiences.We are seeking a highly skilled Senior Product Manager to lead the development of our AI Engine, including API and SDKs. The ideal candidate will have a...


  • Mountain View, California, United States Gatik AI Full time

    About the RoleWe are seeking a skilled Data Engineer to join our AV Infrastructure & DataOps team at Gatik AI, focusing on critical automation tools and pipelines for our autonomous vehicle software stack.This team is at the forefront of our efforts to streamline and optimize our processes for the development, validation & deployment of Gatik's autonomous...


  • Mountain View, California, United States Inworld AI Full time

    About Inworld AIInworld AI is a leading provider of cutting-edge AI technology, empowering developers to create immersive and interactive experiences. With a $500 million valuation and backing from top-tier investors, we're at the forefront of revolutionizing the gaming industry.We're seeking an experienced Machine Learning Engineer to join our team in...


  • Mountain View, California, United States WorldLink US Full time

    Job OverviewWe are seeking an AI Engineer to join our team at WorldLink US in Mountain View, CA. As an AI Engineer for Edge Applications, you will design and develop Large Language Model (LLM) applications for mobile, wearable, and IoT devices.The ideal candidate will have expertise in building LLM-driven applications optimized for on-device deployment. You...


  • Mountain View, California, United States Otter Full time

    About OtterOtter is a pioneering startup based in Silicon Valley dedicated to revolutionizing conversations by making them more valuable. Our mission is to empower individuals and organizations to unlock the full potential of their interactions.Key Responsibilities:We are seeking a highly skilled Conversation AI Research Specialist to join our team. The...


  • Mountain View, California, United States Inworld AI Full time

    Inworld AI is seeking a skilled Cloud DevOps/Site Reliability Engineer to maintain and optimize our infrastructure.ResponsibilitiesInfrastructure Management: Contribute to Infrastructure-as-Code (Terraform) and maintain cloud infrastructure on AWS, Azure, or GCP platforms.Pipeline Orchestration: Develop CI/CD pipelines using Github Actions, Helm, and ArgoCD...