Research Scientist Intern, Vision Language Model

3 days ago


Redmond WA United States Facebook Full time

Summary:

Reality Labs Research is looking for an intern to help us develop the next generation assistance systems that guide the users in contextual and adaptive future AR/VR systems. In particular, we are seeking candidates who have experience with either of the following: vision language model, LLM interpretability, multimodal LLM. Work with researchers to help enable their work across the following research disciplines:

  1. Improving the performance of VLM in product-related scenarios
  2. Building white-box mechanisms to better evaluate the capabilities of VLMs

Our internships are twelve (12) to twenty-four (24) weeks long and we have various start dates throughout the year. Some projects may require a minimum of 16 consecutive weeks.

Required Skills:

Research Scientist Intern, Vision Language Model (PhD) Responsibilities:

  1. Develop, implement, and evaluate methods for improving the performance/interpretability of VLMs.
  2. Make use of Meta’s large infrastructure to scale and speed up experimentation.
  3. Write modular research code that can be reused in other contexts.
  4. Collaborate with other researchers.
  5. Work towards taking on big problems and deliver clear, compelling, and creative solutions to solve them at scale.
  6. The work should result in publishable research to appear in a top-tier ML or CV conference (e.g., NeurIPS, ICLR, CVPR, ECCV).

Minimum Qualifications:

  1. Currently has or is in the process of pursuing a PhD in machine learning, computer vision, speech processing, applied statistics, computational neuroscience, or relevant technical field.
  2. Excellent research skills involving defining problems, exploring solutions, and analyzing and presenting results.
  3. Proficiency in python and machine learning libraries (pytorch, numpy, scikit-learn, scipy, pandas, matplotlib, etc.).
  4. Deep understanding of vision-language models, supported by quality first-authored publications in related domains.
  5. Interpersonal skills: cross-group collaboration and cross-culture collaboration.
  6. Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment.

Preferred Qualifications:

  1. Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as NeurIPS, ICML, ICLR, CHI, UIST, IMWUT, CVPR, ICCV, ECCV, AAAI, ICRA, SIGGRAPH, ETRA, or similar.
  2. Experience with VLM/LLM training/fine-tuning.
  3. Experience on solving traditional CV problems, including but not limited to hand/body pose estimation, object detection, image classification/segmentation, image/video understanding, etc.
  4. Experience working and communicating cross functionally in a team environment.
  5. Intent to return to degree program after the completion of the internship/co-op.
  6. Availability for minimum 16 consecutive week internship.

Public Compensation:

$7,800/month to $11,293/month + benefits

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at .

#J-18808-Ljbffr

  • Redmond, WA, United States Facebook Full time

    Summary: Meta is seeking a Research Scientist to join our Llama Large Language Model (LLM) Research team. We are looking for recognized experts in VLLMs, with experience in areas like vision encoders, data filtering/curation for pre and post-training, RLHF, responsible AI, and model controllability. The ideal candidate will have an interest in producing and...


  • Redmond, Washington, United States META Full time

    About the RoleWe are seeking a highly skilled Research Scientist Intern to join our team at META. As a Research Scientist Intern, you will be working at the intersection of basic and applied science to advance the field of immersive visual technologies.Our team is responsible for developing cutting-edge AR/VR technologies that push the boundaries of...


  • Redmond, Washington, United States META Full time

    Meta Research Scientist Intern AudioWe are seeking a talented Research Scientist Intern to join our Audio team at Meta. This role is an exciting opportunity to contribute to the development of cutting-edge audio and speech processing algorithms.About the Role:Develop novel audio and speech processing algorithms using machine learning and signal processing...


  • Redmond, WA, United States Facebook Full time

    Summary: Meta was built to help people connect and share, and over the last decade our tools have played a critical part in changing how people around the world communicate with one another. With over a billion people using the service and more than fifty offices around the globe, a career at Meta offers countless ways to make an impact in a fast growing...


  • Seattle, WA, United States Facebook Full time

    Summary: Meta was built to help people connect and share, and over the last decade our tools have played a critical part in changing how people around the world communicate with one another. With over a billion people using the service and more than fifty offices around the globe, a career at Meta offers countless ways to make an impact in a fast growing...

  • Research Scientist

    1 month ago


    Redmond, WA, United States BCforward Full time

    BCForward is currently seeking a highly motivated Research Scientist IV Onsite opportunity in Redmond WA!Position Title: Research Scientist IVLocation: Redmond WA (Onsite)Anticipated Start Date: 11/11/2024.Please note this is the target date and is subject to change. BCForward will send official notice ahead of a confirmed start date.Expected Duration: 12+...


  • Seattle, WA, United States Facebook Full time

    Summary: At GenAI, we’re developing cutting-edge AI technologies that will define the future of content creation, productivity, and social media. We are looking for a creative, skilled, and motivated Research Scientist to join our media foundation modeling team in advancing the state-of-the-art of image and video foundation models. You will work with...


  • San Francisco, CA, United States Autodesk, Inc. Full time

    Intern, Research Scientist Job Requisition ID # 24WD82925 Position Overview Autodesk Research is looking for an intern to impact the future of digital design and manufacturing, utilizing machine learning skills to help realize the future of designing and making things. In this role you will undertake a project to develop new product design tools and...


  • Redmond, Washington, United States META Full time

    Meta Internship OpportunityWe are seeking a talented AI researcher to join our team at Meta, where you will work on developing the next generation of assistance systems for augmented reality. This is an exciting opportunity to contribute to cutting-edge research and innovation.About the RoleThis internship will focus on improving the performance and...


  • Seattle, WA, United States Amazon Full time

    Sr. Language Data Scientist, Alexa International Tech Job ID: 2799518 | Amazon.com Services LLC Alexa International Tech (AIT) team is looking for a passionate, talented, and inventive sr language data Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative...


  • Seattle, WA, United States Amazon Full time

    Sr. Language Data Scientist, Alexa International Tech Job ID: 2799518 | Amazon.com Services LLC Alexa International Tech (AIT) team is looking for a passionate, talented, and inventive Sr. Language Data Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative...


  • Seattle, WA, United States Amazon Full time

    Sr. Language Data Scientist, Alexa International Tech Job ID: 2797940 | Amazon.com Services LLC Alexa International Tech (AIT) team is looking for a passionate, talented, and inventive Sr language Data Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative...


  • Redmond, WA, United States Facebook Full time

    Summary: Meta Reality Labs is looking for exceptional interns to help create the next generation of eye tracking for virtual and augmented reality. Our research focuses on true solutions to complex tracking problems, delivering novel technologies and algorithms fundamental to future VR and AR systems. You’ll have the unique opportunity to work with...

  • Research Scientist

    1 month ago


    Redmond, United States BCforward Full time

    BCForward is currently seeking a highly motivated Research Scientist IV Onsite opportunity in Redmond WA!Position Title: Research Scientist IVLocation: Redmond WA (Onsite)Anticipated Start Date: 11/11/2024.Please note this is the target date and is subject to change. BCForward will send official notice ahead of a confirmed start date.Expected Duration: 12+...


  • Redmond, United States META Full time

    Research Scientist Intern, Sensors and Systems Computational Photography (PhD) Apply to this job Location pin icon Redmond, WA Apply to this job Meta Reality Labs Research is looking for upcoming scientists and researchers with great interest in designing, modeling, and prototyping advanced vision systems for real-time, low-power, always-on processing....


  • Seattle, WA, United States Amazon Full time

    Sr. Language Data Scientist, Alexa International Tech Job ID: 2799518 | Amazon.com Services LLC Alexa International Tech (AIT) team is looking for a passionate, talented, and inventive Sr. Language Data Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative...


  • Seattle, WA, United States Amazon Full time

    Sr. Language Data Scientist, Alexa International Tech Job ID: 2797940 | Amazon.com Services LLC Alexa International Tech (AIT) team is looking for a passionate, talented, and inventive Sr language Data Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative...


  • Redmond, WA, United States Facebook Full time

    Summary: Meta was built to help people connect and share, and over the last decade our tools have played a critical part in changing how people around the world communicate with one another. With over a billion people using the service and more than fifty offices around the globe, a career at Meta offers countless ways to make an impact in a fast growing...


  • Seattle, WA, United States Amazon Full time

    Sr. Language Data Scientist, Alexa International Tech Job ID: 2797940 | Amazon.com Services LLC Alexa International Tech (AIT) team is looking for a passionate, talented, and inventive Sr Language Data Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative...


  • Redmond, WA, United States Facebook Full time

    Summary: Meta Reality Labs Research is seeking a highly motivated and skilled research intern to join our team in developing cutting-edge technologies for AR glasses and VR headsets. Our mission is to apply machine learning methods to problems in AR/VR input and interaction, with a focus on collaboration with domain experts. As a research intern, you will...