Multimodal Speech Engineer, AI Companion

7 days ago

Palo Alto, California, United States 1X Technologies AS Full time

About 1X

We're an AI and robotics company based in Palo Alto, California, on a mission to build a truly abundant society through general‑purpose robots capable of performing any kind of work autonomously.

We believe that to truly understand the world and grow in intelligence, humanoid robots must live and learn alongside us. That's why we're focused on developing friendly home robots designed to integrate seamlessly into everyday life.

We're looking for curious, driven, and passionate people who want to help shape the future of robotics and AI. If this mission excites you, we'd be thrilled to hear from you and explore how you might contribute to our journey.

Role Overview

The AI Companion team creates the speech interface for NEO, as well as the physical awareness behaviors that evokes trust, warmth, and competence when NEO interacts with people.

As a Multimodal Speech Engineer on the AI Companion Team, you will lead the effort to create a conversational speech model, from design to data collection to deployment. You will develop real-time architectures that enable NEO to not only converse with users, but also incorporate other modalities like vision, spatial audio, and body language.

You will work closely with the design team to reflect NEO's personality and 1X's brand values in the way NEO speaks and responds to users, and the autonomy team to ensure that NEO's speech models are aware of its own physical capabilities.

Responsibilities

  • Design and implement data pipelines for large scale speech interactions from NEO data and external datasets
  • Train speech2speech models to be aware of NEO's embodiment
  • Design appropriate responses for a variety of user queries
  • Synchronize speech with body language

  • Customize NEO with different personalities

  • 3+ years of experience in speech and audio modeling domains

  • Experience in multi-modal conversational models (language, audio, vision) is a strong plus
  • Ability to take open-ended problems in conversation models, come up with creative solutions, implement proof-of-concepts, and translate those to production.

Benefits & Compensation

  • Salary Range: $150,000 - $250,000
  • Health, dental, and vision insurance
  • 401(k) with company match
  • Paid time off and holidays

Equal Opportunity Employer

1X is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, ancestry, citizenship, age, marital status, medical condition, genetic information, disability, military or veteran status, or any other characteristic protected under applicable federal, state, or local law.

  • Full-Stack Engineer, AI Companion

    5 days ago

    Palo Alto, California, United States 1X Technologies AS Full time

    Job description Full-Stack Engineer, AI CompanionLocation: Palo Alto, CA (on-site)About 1XWe build humanoid robots that work alongside people to solve labor shortages and create abundance.The RoleAs a Full-Stack Engineer on the AI Companion team, you will help create the multimodal, voice-driven interface for NEO, our humanoid home robot. You'll work at the...

  • Product Engineer

    1 day ago

    Palo Alto, California, United States Luma AI Full time

    The Opportunity Luma AI is a full-stack AI lab building Multimodal AGI. We train our own foundational models and build the products that sit on top of them. We combine the massive compute resources and capital of a major tech leader with the agility and individual impact of a focused, early-stage startup. This unique environment allows you to operate with...

  • Research Engineer

    3 days ago

    Palo Alto, California, United States Luma AI Full time

    About Luma AILuma's mission is to build multimodal AI to expand human imagination and capabilities. We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable, and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation...

  • Security Engineer

    4 days ago

    Palo Alto, California, United States Luma AI Full time

    About Luma AI: Luma's mission is to build multimodal AI to expand human imagination and capabilities. We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable, and useful systems, the next step for function change will come from vision. So we are working on training and scaling up multimodal...

  • Software Engineer

    5 days ago

    Palo Alto, California, United States Luma AI Full time

    About Luma AILuma's mission is to build multimodal AI to expand human imagination and capabilities. We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable, and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation...

  • AI/ML Engineer

    1 day ago

    Palo Alto, California, United States Nightfall AI Full time

    About Nightfall:Nightfall is the AI-native, unified data loss prevention and insider risk management platform that protects sensitive data across SaaS apps, GenAI tools, email, endpoint devices, and more. Hundreds of customers, spanning AI innovators to top 10 banks, trust Nightfall to detect and stop data exfiltration at scale. Nightfall enables...

  • AI Product Engineer

    1 day ago

    Palo Alto, California, United States Luma AI Full time

    The Opportunity Luma AI is building the next era of AI with Omni models that can see, hear, and understand the world. As a full-stack company, we control the entire vertical from the GPU cluster to the user interface. We operate with the resources to compete at the forefront while maintaining a lean structure that ensures you will be part of the core...

  • Solutions Engineer

    2 weeks ago

    Palo Alto, California, United States Archetype AI Full time

    About Archetype AIArchetype AI is developing the world's first AI platform to bring AI into the real world. Formed by an exceptionally high-caliber team from Google, Archetype AI is building a foundation model for the physical world, a real-time multimodal LLM for real life, transforming real-world data into valuable insights and knowledge that people will...

  • iOS Engineer

    7 days ago

    Palo Alto, California, United States Luma AI Full time

    The OpportunityLuma AI operates as a full-stack AI lab, training foundational models and building the products that utilize them. We have secured the capital and compute resources of a major tech company while maintaining the high-impact structure of a focused startup. This unique position allows our core engineering team to operate with immense leverage,...

  • Enterprise Backend Engineer

    5 days ago

    Palo Alto, California, United States Luma AI Full time

    The OpportunityAt Luma AI, we believe multimodality is critical for intelligence. We are a full-stack lab, training foundational models and building the products that utilize them. We offer the rare opportunity to work with the resources of a massive corporation while maintaining the speed and impact of an elite engineering team.Where You Come InYou will...