Research Engineer, Reinforcement Learning

3 days ago

Sunnyvale CA United States 1X Technologies Full time

Targeted start date: Immediately. Relocation provided.

Research Engineers in reinforcement learning are generalists who develop reinforcement learning algorithms for humanoid locomotion and manipulation policies. A typical day involves prototyping reinforcement learning algorithms or building distributed infrastructure for training and simulation. You will own the RL policies and train in both sim and real to bring capabilities to NEO. You will integrate and distill RL policies and data into foundation model training. You will work closely with other AI team members and also develop independently.

1X's mission is to create an abundant supply of physical labor through safe, intelligent androids that work alongside humans. Since 2014, we’ve designed our products with large-scale manufacturing in mind, so we can produce androids at a high enough volume to meet the world’s labor demand.

Our wheeled Android EVE is engineered to work with you, from guarding to logistics, and our bipedal model, NEO, is designed to become a household android with broad deployment in various applications. Our products will understand both natural language and physical space, so they can complete useful tasks in any environment.


We’ve established our dual HQ in San Francisco and Norway. Our positions require in-person presence to ensure effective execution and seamless collaboration in our hardware-focused environment. We value passion for our work and encourage candidates who share our dedication to join our team.

Why this job is exciting

Your role on the team will be to build RL algorithms in simulation and real and integrate RL into the overall learning picture. You will work across the AI stack and solve gaps in model training and inference. We aim to (1) double the number of tasks the robot can perform and (2) half the error rate on existing tasks, quarter over quarter. The team works closely together to prioritize direction and scale up a single approach to a production-ready system.

Responsibilities

  1. Build RL algorithms to bring generalized capabilities to NEO.
  2. Work with our robot operations team to scale up our datasets and model capabilities.

REQUIREMENTS

Must-Haves

  1. Bachelor’s degree in Computer Science or equivalent.
  2. 3+ years of professional, full-time experience on robot learning.
  3. Experience with physical simulators (Pybullet, IssacSim, Mujoco, etc.) and training RL policies in simulation.
  4. Ability to rapidly prototype ideas in code in an independent manner.
  5. Published research in top ML conferences (NeurIPS, CoRL, RSS, ICML, etc.).

Nice-to-Haves

  1. Experience with GPU simulation.
  2. Have built large programming projects on your own for fun (e.g. open source projects).
  3. Training large-scale ML models such as visual foundation models, large language models, pixel-level generative models.
  4. Have implemented highly performant software.
Compensation

We offer a total compensation package including base salary from US$105,000 to US$250,000 annually, with generous stock options and other benefits.

Introduction Stage - we have initial conversations to get to know you better.

  • (30m) Recruiter Screen with Win Yu.
  • (45m) Hiring Manager Screen with the AI team.

Team Interview Stage - we then dive into your experience in more depth and introduce you to members of the team. This is also the stage where you will do your take-home challenge.

  • (90m) Technical Deep-Dive conversation with the AI team.

Final Interview Stage - we move you to our final round.

  • (15m) Role expectation management with Eric Jang.
  • (30m) Conversation with CEO Bernt Øivind Børnich.

Location

This position is based in Sunnyvale, California, USA, at our newly renovated AI headquarters. We offer visa sponsorship for exceptional candidates. Joining our team means becoming a valued member of one of the biggest brands in humanoid robotics, where you'll play a part in shaping the future of general-purpose androids.

A value driven team
These are the ideas that express our team’s culture and how we work:
Be Nice - Collaboration is our driving force. Our team creates an open, trusting environment where everyone can be their most creative.
Stay Smart - A world-changing team needs the brightest minds in every discipline. This is where people come to work, learn, and grow to their full potential.
Make History - Everything we do gets us closer to one ambitious vision: general-purpose androids helping people around the globe. We believe what we build today will impact generations.

1X is an inclusive and equal-opportunity employer that values diversity. We consider all qualified applicants regardless of race, religion, gender, age, sexual orientation, disability, or any other protected class. If you have a disability or special need that requires accommodation, please don't hesitate to let us know during the interview process. We will do our best to accommodate your needs.

#J-18808-Ljbffr

  • Research Engineer, Reinforcement Learning

    2 weeks ago

    Sunnyvale, United States 1X Technologies AS Full time

    Target start date: Immediately. Relocation provided. We are at the forefront of developing advanced humanoid robots designed for household use. Our mission is to create an abundant supply of labor via safe, intelligent humanoids. As we transition from R&D to full-scale manufacturing, we seek an experienced Research Engineer, Reinforcement Learning. We are...

  • Reinforcement Learning Engineer

    1 week ago

    Sunnyvale, United States Figure Full time

    Figure is an AI Robotics company developing a general purpose humanoid. Our Humanoid is designed for corporate tasks targeting labor shortages and jobs that are undesirable or unsafe. We are based in Sunnyvale, CA and require 5 days/week in-office collaboration. It's time to build. We are looking for a Reinforcement Learning Engineer. You will own the...

  • Reinforcement Learning Engineer

    1 week ago

    Sunnyvale, United States Figure Full time

    Figure is an AI Robotics company developing a general purpose humanoid. Our Humanoid is designed for corporate tasks targeting labor shortages and jobs that are undesirable or unsafe. We are based in Sunnyvale, CA and require 5 days/week in-office collaboration. It's time to build. We are looking for a Reinforcement Learning Engineer. You will own the...

  • Reinforcement Learning Engineer

    1 month ago

    Sunnyvale, United States Figure Full time

    Figure is an AI Robotics company developing a general purpose humanoid. Our Humanoid is designed for corporate tasks targeting labor shortages and jobs that are undesirable or unsafe. We are based in Sunnyvale, CA and require 5 days/week in-office collaboration. It's time to build. We are looking for a Reinforcement Learning Engineer. You will own the...

  • Research Engineer

    4 days ago

    San Francisco, CA, United States RI Research Instruments GmbH Full time

    You want to build large scale ML systems from the ground up. You care about making safe, steerable, trustworthy systems. As a Research Engineer, you'll touch all parts of our code and infrastructure, whether that's making the cluster more reliable for our big jobs, improving throughput and efficiency, running and designing scientific experiments, or...

  • Robot Learning Research Scientist

    1 week ago

    Sunnyvale, California, United States 1X Technologies AS Full time

    Immerse in Robotics InnovationWe are 1X Technologies AS, a pioneering force in humanoid robotics. Our mission is to revolutionize household assistance through advanced, safe, and intelligent robots.Unlock Your PotentialPursue a role that combines research and development with cutting-edge technology.Collaborate with an exceptional team of experts pushing the...

  • Machine Learning Research Engineer

    3 days ago

    East Hartford, CT, United States RTX Full time

    Position Overview The Advanced Learning and Analytics Team, part of the AI Discipline, at RTX Research Center (RTRC) is looking for a highly motivated machine learning research engineer to push the state of art in machine learning for aerospace and defense applications. The team researches and develops machine learning, computer vision, reinforcement...

  • Research Engineer

    2 weeks ago

    Sunnyvale, United States META Full time

    Summary: Reality Labs is seeking a Research Engineer to join our Large Language Model (LLM) Research team for the device driven AI Assistant effort. We conduct focused research and engineering to build state-of-the-art LLMs to fit on-device and on-server use cases. We are looking for strong research engineers who have a background in generative AI and NLP,...

  • Research Engineer, Machine Learning

    4 days ago

    Boston, MA, United States Robotics Prcocess Automation, LLC Full time

    Job Overview Job ID: J36993 Specialized Area: Machine learning Job Title: Research Engineer, Machine Learning Location: To Be Discussed Later Duration: 11 Months Domain Exposure: Work Authorization Client: To Be Discussed Later Employment Type: W-2 (Consultant must be on our company payroll. C2C is not allowed) Avigilon’s Boston Development team is looking...

  • Senior Machine Learning Software Engineer

    3 days ago

    Sunnyvale, CA, United States Robert Bosch Group Full time

    Senior Machine Learning Software Engineer Full-time The Bosch Research and Technology Center North America, with offices in Sunnyvale, Pittsburgh, and Cambridge, is part of the global Bosch Group, a company with over 70 billion Euro in revenue, 400,000 employees worldwide, a very diverse product portfolio, and a history spanning over 125 years. The Research...

  • Machine Learning Applied Research Scientist

    2 days ago

    Cupertino, CA, United States Apple Inc. Full time

    Machine Learning Applied Research Scientist Our team of applied ML scientists and engineers works to enhance the experience and productivity of software developers at Apple and in the Apple developer ecosystem. Our team trains state-of-the-art ML models and applies them in products to solve real-world problems. We’re looking for talented and enthusiastic...

  • Machine Learning Research Engineer

    4 days ago

    Redmond, WA, United States Microsoft Full time

    Overview The Microsoft Research AI Frontiers group in Redmond is looking for a highly-qualified Machine Learning Research Engineer to build state-of-the-art tools for evaluating and understanding foundation models, with a focus on real-world uses of Artificial Intelligence (AI) and Machine Learning (ML). Our team conducts influential research published at...

  • Machine Learning Engineer

    3 days ago

    San Jose, CA, United States HireIO, Inc. Full time

    The main job directions include: Exploring and developing large-scale language models and optimizing enterprise applications to the extreme; Data construction, instruction tuning, preference alignment, and model optimization; Implementation of relevant applications, including content generation, reasoning, code generation, etc.; Collaborating with...

  • Sr Machine Learning Applied Research Scientist

    3 days ago

    Cupertino, CA, United States Apple Inc. Full time

    Sr Machine Learning Applied Research Scientist Our team of applied ML scientists and engineers works to enhance the experience and productivity of software developers at Apple and in the Apple developer ecosystem. Our team trains state-of-the-art ML models and applies them in products to solve real-world problems. We’re looking for talented and...

  • Research Engineer, AI/Machine Learning

    4 days ago

    Mountain View, CA, United States WeAreTechWomen Full time

    Minimum qualifications: Bachelor’s degree or equivalent practical experience. 2 years of experience with software development in one or more programming languages, and with data structures or algorithms. 2 years of experience with machine learning algorithms and tools (e.g. TensorFlow), artificial intelligence, deep learning or natural language processing....

  • AIML - ML Research Engineer, Forecasting Foundation Models

    3 days ago

    Cupertino, CA, United States Apple Inc. Full time

    AIML - ML Research Engineer, Forecasting Foundation Models We are a group of innovative researchers and engineers dedicated to fundamentally increase Apple’s business success across Finance, Sales, and Operations with Deep Learning technologies and innovations. We build foundation models to forecast critical business and financial metrics that drive...

  • Research Engineer, Machine Learning

    4 days ago

    Boston, MA, United States AI Technologies LLC. Full time

    W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed. Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/third-party recruiters. Job Overview Job ID: J36993 Specialized Area: Machine Learning Job Title: Research Engineer, Machine...

  • Machine Learning Engineer

    3 days ago

    Sunnyvale, CA, United States CurieTech, Inc. Full time

    CurieTech Inc. Machine Learning Engineer Sunnyvale, CA · Full time As a Machine Learning Engineer, you will work on designing, developing, and implementing machine learning models and algorithms. This includes developing techniques to augment Large Language Models such as GPT-4 and BARD with retrieval techniques and tools, as well as fine-tuning those...

  • Machine Learning Engineer

    3 days ago

    Cambridge, MA, United States Toyota Research Institute Full time

    At Toyota Research Institute (TRI), we’re on a mission to improve the quality of human life. We’re developing new tools and capabilities to amplify the human experience. To lead this transformative shift in mobility, we’ve built a world-class team in Energy & Materials, Human-Centered AI, Human Interactive Driving, and Robotics. The Mission Make...

  • Machine Learning Algorithm and Software Engineer

    3 days ago

    Sunnyvale, CA, United States Apple Full time

    Machine Learning Algorithm and Software Engineer Location: Sunnyvale, California, United States Field: Machine Learning and AI Our team delivers algorithms that power Apple Vision Pro's Eyesight, Persona, and other cutting-edge technologies. In this position, you will be part of our extraordinary team of Computer Graphics, Computer Vision, and Deep...