Member of Technical Staff: Research Scientist, Pre-Training

2 months ago


San Francisco, United States essential AI Full time
Job DescriptionJob Description

Essential AI’s mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today. We believe that building delightful end-user experiences requires innovating across the stack - from the UX all the way down to models that achieve the best user value per FLOP.

We believe that a small, focused team of motivated individuals can create outsized breakthroughs. We are building a world-class multi-disciplinary team who are excited to solve hard real-world AI problems. We are well-capitalized and supported by March Capital and Thrive Capital, with participation from AMD, Franklin Venture Partners, Google, KB Investment, NVIDIA.

The Role

The Research Scientist, Pre-Training will play a pivotal role in advancing our foundation models to advance the science at large and the unique challenges and requirements of our customers. You will be responsible for frontier algorithms and conducting research experiments to improve the pre-training process, with the goal of creating more capable, robust, and efficient models. You will also explore ways to scale up pre-training to larger datasets and model sizes, while maintaining efficiency and performance.

What you’ll be working on
  • You will lead or be a core contributor to our research bets that advance the the real-world capabilities of our models.

  • You will collaborate closely with our data and product teams to close the loop between research and product, identify capability gaps and evaluate progress.

  • Lead long-term research initiatives focused on pre-training models for enterprises. Work closely with research engineers to prototype, understand, implement and deploy novel techniques to improve the capabilities of our models.

  • Develop novel algorithms and methodologies for pre-training models ensuring scalability, efficiency, and effectiveness.

  • Design, develop, and optimize machine learning models and prototypes, ensuring high performance, scalability, and robustness.

  • Stay abreast of the latest advancements in pre-training techniques incorporating relevant findings into research projects and product development efforts

What we are looking for
  • Research experience with a focus on pre-training and building large language models using frameworks such as Megatron, DeepSpeed, MaxText, etc.

  • You have strong ML fundamentals and first principles thinking that guides your approach to research.

  • You have experience of coming up with new methods or improving existing techniques in ML or related fields

  • Experience with improving and curating data used during pre-training. For example, curating and selecting data sources to maximize learning of our models

  • Proficiency in programming languages commonly used in machine learning research such as Python

  • Strong problem solving, analytical, communication, and collaboration skills.

  • You enjoy building things from the ground up in a fast-paced, collaborative environment.

We encourage you to apply for this position even if you don’t check all of the above requirements but want to spend time pushing on these techniques.

We are based in-person in SF and fully onsite 5 days a week. We offer relocation assistance to new employees.



  • San Francisco, United States essential AI Full time

    Job DescriptionJob DescriptionAbout UsEssential AI’s mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today. We believe that building delightful end-user experiences requires innovating across the stack - from the UX all the way down to models that achieve the...


  • San Francisco, California, United States essential AI Full time

    Become a Key Contributor to AI AdvancementsEssential AI is dedicated to transforming the synergy between humans and technology, unlocking remarkable possibilities. Our focus is on expanding the horizons of technology, encompassing everything from user experience design to advanced AI methodologies.We are in search of a skilled Research Scientist specializing...


  • San Francisco, United States essential AI Full time

    Job DescriptionJob DescriptionEssential AI’s mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today. We believe that building delightful end-user experiences requires innovating across the stack - from the UX all the way down to models that achieve the best user...


  • San Francisco, United States essential AI Full time

    Job DescriptionJob DescriptionAbout UsEssential AI’s mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today. We believe that building delightful end-user experiences requires innovating across the stack - from the UX all the way down to models that achieve the...


  • San Francisco, California, United States city of San Elizario Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Scientist to join our Inflammation Research team in San Elizario. As a key member of our team, you will be responsible for designing and executing experiments to explore and understand the pharmacology of drug targets, generating and communicating pharmacology and preclinical data to...


  • San Francisco, United States DALLAS VA RESEARCH CORPORATION Full time

    Meta is seeking Research Scientists to join our AI Research and Development organizations. The ideal candidate will have industry experience working on Language related topics and the ability to apply relevant AI and machine learning techniques to build intelligent rich language systems that improve Meta's products and experiences. Candidates should have an...


  • San Francisco, United States DALLAS VA RESEARCH CORPORATION Full time

    Meta is seeking Research Scientists to join our AI Research and Development organizations. The ideal candidate will have industry experience working on Language related topics and the ability to apply relevant AI and machine learning techniques to build intelligent rich language systems that improve Meta's products and experiences. Candidates should have an...


  • San Francisco, California, United States essential AI Full time

    Position OverviewAt Essential AI, our goal is to enhance the synergy between humans and technology, unlocking collaborative capabilities that surpass current limitations. We believe that creating exceptional user experiences necessitates innovation across all levels—from user experience to the underlying models that deliver optimal user value.We are...


  • San Francisco, California, United States University of California Full time

    Job Title: Pre-Clinical Research Scientist: Hematopoietic Stem Cell EngineeringAbout the Role:We are seeking a highly skilled Pre-Clinical Research Scientist to join our team at the University of California. The successful candidate will be responsible for conducting pre-clinical research in transplant medicine, focusing on genetic engineering techniques to...


  • San Francisco, United States essential AI Full time

    Job DescriptionJob DescriptionEssential AI’s mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today. We believe that building delightful end-user experiences requires innovating across the stack - from the UX all the way down to models that achieve the best user...


  • San Diego, United States RPM ReSearch Full time

    Job DescriptionJob DescriptionJob Title: Veterinary Research ScientistPrimary Responsibilities:This position requires a broad knowledge of the anatomy and physiology of small and large animals to help develop and support in vivo models to screen therapeutics and devices being developed for various disorders. Experience with surgical, dosing and sampling...


  • San Diego, United States RPM ReSearch Full time

    Job DescriptionJob DescriptionResearch Scientist/Study Director OcularDescription: We are seeking to find an accomplished Ocular Scientist with requirements of a broad knowledge of Ocular anatomy, physiology, and biochemistry to help develop and support in vivo models to screen small molecule, cell/gene therapy, as well as large molecule therapeutics and...

  • Research Scientist

    6 days ago


    San Francisco, California, United States University of California , San Francisco Full time

    Job SummaryWe are seeking a highly skilled Research Scientist to join our team at the University of California, San Francisco, and UCSF Benioff Children's Hospitals. The successful candidate will be responsible for conducting independent and creative research activities of high quality and significance in the Department of Pediatrics.Key...

  • Research Scientist

    1 day ago


    San Francisco, California, United States University of California , San Francisco Full time

    Job SummaryWe are seeking a highly skilled Research Scientist to join our team at the University of California, San Francisco. The successful candidate will be responsible for conducting independent and creative research activities of high quality and significance in the Department of Pediatrics.Key ResponsibilitiesDevelop and conduct research projects in...


  • San Francisco, California, United States Databricks Full time

    About the RoleWe are seeking a highly skilled Research Scientist to join our Mosaic AI Team at Databricks. As a Research Scientist, you will be responsible for advancing the scientific frontier in deep learning and creating new techniques that go beyond the state of the art.Key ResponsibilitiesStay up-to-date with the latest developments in deep learning and...


  • San Antonio, Texas, United States Southwest Research Institute Full time

    Position Overview: Laboratory Research ScientistThe Laboratory Research Scientist will be responsible for leading and managing various testing initiatives within our research facility. This role involves meticulous planning, execution, and oversight of experimental procedures.Project Leadership: Organize and oversee testing projects, ensuring timely...


  • San Francisco, California, United States Databricks Full time

    Company OverviewFounded in late 2020 by a dedicated group of machine learning experts, Mosaic AI empowers organizations to develop cutting-edge AI models tailored to their specific data. We believe that a company's AI models are as valuable as any other core intellectual property, and we are committed to making high-quality AI models accessible to all....

  • Research Scientist

    6 days ago


    San Antonio, Texas, United States Southwest Research Institute Full time

    About the RoleWe are seeking a highly skilled Research Scientist to join our team at Southwest Research Institute. As a key member of our Neuromorphic Computing and Cognitive AI research group, you will play a critical role in driving strategies and implementations of our AI solutions to meet our customers' expectations.Key ResponsibilitiesContribute to the...


  • San Francisco, California, United States Databricks Full time

    Company OverviewEstablished in late 2020 by a dedicated group of machine learning experts, Mosaic AI empowers organizations to develop cutting-edge AI models tailored to their unique datasets. From a business standpoint, Mosaic AI believes that a company's AI models hold equal value to any other core intellectual property, advocating for the accessibility of...


  • San Francisco, California, United States Databricks Full time

    Company OverviewEstablished in late 2020 by a dedicated group of machine learning experts, Mosaic AI empowers organizations to develop cutting-edge AI models tailored to their unique datasets. From a business standpoint, Mosaic AI believes that a company's AI models are as crucial as any other intellectual property, advocating for the accessibility of...