Research Scientist, Machine Learning and Eye Tracking

4 weeks ago


Redmond, United States Meta Platforms, Inc. Full time

Reality Labs Research (RLR) brings together a world-class, cross-disciplinary R&D team to develop the next generation of AR and VR technologies. Come work alongside a world leading team of scientists and engineers to create the technology that makes AR and VR pervasive and universal. Our research focuses on developing comprehensive solutions to complex eye tracking problems, including both algorithms and hardware for AR and VR systems. We are currently seeking researchers with experience in machine learning for computer vision applications, to help build eye tracking models that leverage multiple sensing modalities and that are personalized for best performance on every user of the system.

Research Scientist, Machine Learning and Eye Tracking Responsibilities

* Research and develop novel machine learning and computer vision based methods for eye tracking in AR/VR form factors.



Work with large-scale eye tracking data sets to build models that work across the diversity of the entire human population.

Combine data driven and 3D model based methods to deliver robust performance independent of device fit.

Incorporate data from multiple sensor modalities to build robust, efficient models.

Quantify the robustness and accuracy of these models using statistical analysis of the data.

Optimize models to deliver robust, always-on eye tracking in power-constrained platforms.

Categorize failures and mine the data for difficult edge cases, and use this to improve the worst-case performance of eye tracking algorithms.

Help to develop simulation and ground truth data collection tools that reduce the amount of data needed to deliver robust models.

Collaborate with other research scientists, hardware and software engineers to develop innovative machine learning techniques for eye tracking use-cases.

Minimum Qualifications

* PhD degree in computer science, machine learning, or equivalent experience in a related field.



Experience building and shipping CV, ML, or optimization systems that are proven to be robust in real world use cases.

Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.

5+ years experience in machine learning for computer vision applications.

3+ years of programming experience in Python and experience with ML frameworks such as PyTorch.

Preferred Qualifications

* Experience with large-scale machine learning techniques like semi-supervised learning, weakly-supervised learning and online adaptation of ML models.



Experience building personalized models for Eye Tracking or other human tracking tasks such as body, face or hand tracking.

Experience delivering robust data-driven models incorporating multiple sensor modalities at different data rates.

Understanding of sensor and optics principles that impact computer vision applications, including MTF, quantum efficiency, refraction, reflectance, etc.

Experience with transformers for vision applications.

Proven track record in publishing papers in machine learning and/or computer vision conferences including CVPR, ICCV, ISMAR, ECCV, NeurIPS, AAAI, ICLR.

Locations

About Meta

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.

Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to accommodations-ext@fb.com.

$177,000/year to $251,000/year + bonus + equity + benefits

Individual pay is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base salary, Meta offers benefits. Learn more about benefits at Meta.



  • Redmond, United States META Full time

    Meta's Reality Labs Research (RL-R) brings together a world-class team of researchers, developers, and engineers to create the future of augmented and virtual reality (AR/VR). The eye tracking team within RL-R is working on research to enable eye tracking for everyone everywhere, which is key to enabling many groundbreaking experiences. In this role, you...


  • Redmond, United States Meta Platforms, Inc. Full time

    At Meta's Reality Labs Research, our goal is to make world-class consumer virtual, augmented, and mixed reality experiences. Come work alongside industry-leading scientists and engineers to create the technology that makes VR and AR pervasive and universal. Join the adventure of a lifetime as we make science fiction real and change the world. We are a...

  • Software Engineer

    3 weeks ago


    Redmond, United States Meta Inc Full time

    Meta's Reality Labs Research (RL-R) brings together a world-class team of researchers, developers, and engineers to create the future of augmented and virtual reality (AR/VR). The eye tracking team within RL-R is working on research to enable eye tracking for everyone everywhere, which is key to enabling many groundbreaking experiences. In this role, you...


  • Redmond, United States Meta Platforms, Inc. Full time

    Reality Labs (RL) focuses on delivering Meta's vision through Virtual Reality (VR) and Augmented Reality (AR). The compute performance and power efficiency requirements of Virtual and Augmented Reality require custom silicon. Reality Labs Silicon team is driving the state of the art forward with breakthrough work in computer vision, machine learning, mixed...


  • Redmond, United States Meta Platforms, Inc. Full time

    Reality Labs (RL) focuses on delivering Meta's vision through Virtual Reality (VR) and Augmented Reality (AR). The compute performance and power efficiency requirements of Virtual and Augmented Reality require custom silicon. Reality Labs Silicon team is driving the state of the art forward with breakthrough work in computer vision, machine learning, mixed...


  • Redmond, United States Meta Platforms, Inc. Full time

    At Meta's Reality Labs Research, our goal is to make world-class consumer virtual, augmented, and mixed reality experiences. Come work alongside industry-leading scientists and engineers to create the technology that makes VR and AR pervasive and universal. Join the adventure of a lifetime as we make science fiction real and change the world. We are a...


  • Redmond, United States Meta Platforms, Inc. Full time

    At Meta's Reality Labs Research, our goal is to make world-class consumer virtual, augmented, and mixed reality experiences. Come work alongside industry-leading scientists and engineers to create the technology that makes VR and AR pervasive and universal. Join the adventure of a lifetime as we make science fiction real and change the world. We are a...

  • Research Scientist

    4 weeks ago


    Redmond, United States Meta Platforms, Inc. Full time

    Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens...

  • Research Scientist

    2 weeks ago


    Redmond, United States Meta Platforms, Inc. Full time

    Meta Platforms, Inc. (Meta), formerly known as Facebook Inc., builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens...


  • Redmond, United States Centific Full time

    Company DescriptionCentific is a leading technology company based in the Greater Seattle Area. We specialize in zero distance innovation for GenAI creators and industries, providing expert engineering platforms and curated multimodal, multilingual data. Our team of over 150 PhDs, data scientists, AI practitioners, and engineers work together to empower our...


  • Redmond, United States Centific Full time

    Company DescriptionCentific is a leading technology company based in the Greater Seattle Area. We specialize in zero distance innovation for GenAI creators and industries, providing expert engineering platforms and curated multimodal, multilingual data. Our team of over 150 PhDs, data scientists, AI practitioners, and engineers work together to empower our...


  • Redmond, United States Centific Full time

    Company DescriptionCentific is a leading technology company based in the Greater Seattle Area. We specialize in zero distance innovation for GenAI creators and industries, providing expert engineering platforms and curated multimodal, multilingual data. Our team of over 150 PhDs, data scientists, AI practitioners, and engineers work together to empower our...


  • Redmond, United States Centific Full time

    Company DescriptionCentific is a leading technology company based in the Greater Seattle Area. We specialize in zero distance innovation for GenAI creators and industries, providing expert engineering platforms and curated multimodal, multilingual data. Our team of over 150 PhDs, data scientists, AI practitioners, and engineers work together to empower our...


  • Redmond, United States Meta Platforms, Inc. Full time

    At Meta's Reality Labs Research, our goal is to make world-class consumer virtual, augmented, and mixed reality experiences. Come work alongside industry-leading scientists and engineers to create the technology that makes VR and AR pervasive and universal. Join the adventure of a lifetime as we make science fiction real and change the world. We are...


  • Redmond, United States Meta Platforms, Inc. Full time

    At Meta's Reality Labs Research, our goal is to make world-class consumer virtual, augmented, and mixed reality experiences. Come work alongside industry-leading scientists and engineers to create the technology that makes VR and AR pervasive and universal. Join the adventure of a lifetime as we make science fiction real and change the world. We are...

  • Research Chemist

    3 weeks ago


    Redmond, Washington, United States Facebook Full time

    At Meta's Reality Labs Research, our goal is to make world-class consumer virtual, augmented, and mixed reality experiences. Come work alongside industry-leading scientists and engineers to create the technology that makes VR and AR pervasive and universal. Join the adventure of a lifetime as we make science fiction real and change the world. As a Research...


  • Redmond, United States Thetalkingmachines Full time

    Send me a weekly email with the latest jobs. E-mail Job Type Full Time Redmond, WA Digital thieves are getting more sophisticated and harder to detect and stop and our customers are looking up to us to protect their accounts, subscriptions, data, and services from compromise - whether in their own data centers, Microsoft’s cloud environments, or other...


  • Redmond, United States Crystal Equation Full time

    Machine Learning Data Analysis Tooling Software Engineer IV Summary: Our mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different type of company that connects billions of people around the world, gives them ways to express what matters most to them, and...


  • Redmond, United States Meta Platforms, Inc. Full time

    Vision science and visual computing is at the center of our research, as it informs our work in displays, optics, rendering pipeline, and practically everything in the AR/VR system. As a Research Scientist in the Applied Perception Science team for Reality Labs Meta, you will be tackling the scientific challenges that define cutting-edge augmented & virtual...


  • Redmond, United States Meta Platforms, Inc. Full time

    Vision science and visual computing is at the center of our research, as it informs our work in displays, optics, rendering pipeline, and practically everything in the AR/VR system. As a Research Scientist in the Applied Perception Science team for Reality Labs Meta, you will be tackling the scientific challenges that define cutting-edge augmented & virtual...