Senior ML Research Scientist

3 weeks ago


San Francisco, United States Rungalileo Full time

Galileo is a late-stage Series A business, founded in 2021 by Engineering Leaders from Google AI and Uber AI. The founders spent over 10 years building cutting edge Machine Learning systems at Google, Uber, and Apple, and founded the company from the battle scars around building some of the biggest ML Platforms on the planet. The big lesson learnt was that a Machine Learning model is only as good as the data you give it.

In the era of Generative AI and LLMs, the tools that Data Scientists use to do evaluations of Language Models and Applications includes ad-hoc python scripts, Jupyter Notebooks, and Excel sheets. This calls for new tools in the LLM development stack to mitigate data errors and biases, investigate regions of LLM underperformance, and help create high quality LLM based applications quickly via robust evaluation and experimentation tooling.

At Galileo, we are building a next generation Large Language Model (LLM) evaluation and experimentation platform to address this problem.

With dozens of paying enterprise customers across the enterprise and high growth startups, Galileo is creating the "LLM Evaluation" market. Backed by tier 1 investors such as Battery Ventures and Walden Catalyst and over $23M in funding, Galileo is poised to build an enduring business centered around the core ingredient of machine learning – the data.

Role Description

We are looking for a Senior Machine Learning Research Scientist to join our team of top ML researchers and work with them in formulating advanced techniques and algorithms to aid a user in creating better datasets for ML.

Main Responsibilities
  1. Work with top Machine Learning researchers in creating advanced ML algorithms in Large Language Modeling.
  2. Build advanced ML algorithms around Language Models, in particular techniques to better surface errors and biases in modern day LLMs.
  3. Collaborate with engineering and product management to understand use cases.
  4. Read and research the latest LLM evaluation literature and apply them to Galileo's product offerings.
  5. Work with Platform Engineering and Frontend teams, to ensure efficient computation times and robust delivery of robust ML algorithms from research to solve for the user's needs.
  6. Mentor other team members.
Minimum Qualifications
  1. 5+ years of experience in ML Research, exploring new model architectures and ML algorithms from scratch.
  2. Strong experience with Pytorch, TensorFlow, Keras, or other Deep Learning frameworks.
  3. Strong Experience with Generative or Seq-2-Seq Models.
  4. Strong understanding of data quality metrics, and advanced evaluation techniques in Machine Learning.
  5. Strong Python programming skills. Write efficient, clean, and scalable code.
  6. Strong communication skills, ability to understand complex technical concepts.
  7. Strong Research report writing skills.
  8. Strong ML problem-solving skills, ability to do independent experiments (a self-starter mindset), but also collaborate in a team environment.

If you are passionate about Machine Learning and have experience in being a Tech Lead in an ML team, this is a great opportunity for you. You will get to work on a groundbreaking product poised to revolutionize the way companies approach LLM Evaluations. Join our team at Galileo and help us build the future of Evaluations in Generative AI.

Why Galileo

Join a seasoned founding team that has previously led product and engineering teams from 0 to $100M+ in revenue and from 0 to 1B+ users globally.

We obsess over our team’s culture driven by inclusivity, empathy, and curiosity.

We invest in our team’s development and happiness because our employees are the keys to our success and ensuring happy customers – towards that end, we offer:

#J-18808-Ljbffr

  • San Francisco, United States NLP PEOPLE Full time

    Meta is seeking a Research Scientist to join our Instagram Core ML team. This team is an applied research organization focused on improving the quality of IG recommendation models through AI.Advances in AI are key to our mission, spanning some of the most pressing research challenges of our generation across such areas as artificial intelligence, machine...

  • Senior Data Scientist

    3 weeks ago


    San Francisco, United States Capital One Full time

    Center 2 (19050), United States of America, McLean, VirginiaSenior Data Scientist - Emerging MLData is at the center of everything we do. As a startup, we disrupted the credit card industry by individually personalizing every credit card offer using statistical modeling and the relational database, cutting edge technology in 1988! Fast-forward a few years,...


  • San Francisco, United States Capital One National Association Full time

    Center 2 (19050), United States of America, McLean, VirginiaSenior Data Scientist - Emerging MLData is at the center of everything we do. As a startup, we disrupted the credit card industry by individually personalizing every credit card offer using statistical modeling and the relational database, cutting edge technology in 1988! Fast-forward a few years,...


  • San Francisco, United States Unreal Gigs Full time

    Company Overview: Welcome to the forefront of artificial intelligence and machine learning innovation! Our company is dedicated to leveraging the power of data science to drive transformative change and solve complex problems across industries. We're committed to developing cutting-edge AI and ML solutions that push the boundaries of what's possible. Join us...


  • San Francisco, United States Strativ Group Full time

    Senior Machine Learning Engineer - ML InfraWe are currently partnered with a well-backed AI Safety startup who are on a mission to improve humanity's understanding of complex AI models and improve the safety and reliability of AI on a global scale. The Founding team consists of experienced, successful entrepreneurs and pioneering leaders from some of the...


  • san francisco, United States Strativ Group Full time

    Senior Machine Learning Engineer - ML InfraWe are currently partnered with a well-backed AI Safety startup who are on a mission to improve humanity's understanding of complex AI models and improve the safety and reliability of AI on a global scale. The Founding team consists of experienced, successful entrepreneurs and pioneering leaders from some of the...


  • san francisco, United States Strativ Group Full time

    Senior Machine Learning Engineer - ML InfraWe are currently partnered with a well-backed AI Safety startup who are on a mission to improve humanity's understanding of complex AI models and improve the safety and reliability of AI on a global scale. The Founding team consists of experienced, successful entrepreneurs and pioneering leaders from some of the...


  • San Francisco, United States Strativ Group Full time

    Senior Machine Learning Engineer - ML InfraWe are currently partnered with a well-backed AI Safety startup who are on a mission to improve humanity's understanding of complex AI models and improve the safety and reliability of AI on a global scale. The Founding team consists of experienced, successful entrepreneurs and pioneering leaders from some of the...


  • san francisco, United States NDC Tek Full time

    Senior NLP Research Scientist - San Francisco Bay AreaNDC Tek are currently looking for Senior NLP Research Scientist's based in the Bay Area for a company who are innovating in the field of speech-to-text solutions. They have created an industry-leading tool with the mission to make conversation more valuable.If you or someone you know is looking for a new...


  • san francisco, United States NDC Tek Full time

    Senior NLP Research Scientist - San Francisco Bay AreaNDC Tek are currently looking for Senior NLP Research Scientist's based in the Bay Area for a company who are innovating in the field of speech-to-text solutions. They have created an industry-leading tool with the mission to make conversation more valuable.If you or someone you know is looking for a new...


  • San Francisco, United States Capital One Full time

    Center 2 (19050), United States of America, McLean, VirginiaPrincipal Data Scientist - Emerging MLData is at the center of everything we do. As a startup, we disrupted the credit card industry by individually personalizing every credit card offer using statistical modeling and the relational database, cutting edge technology in 1988! Fast-forward a few...

  • Research Scientist

    3 weeks ago


    San Francisco, United States Nexus Full time

    We're looking for a skilled Research Scientist to join our team, where you'll play a crucial role in powering a new verifiable Internet. We’re accepting applicants for all levels of seniority. As a Research Scientist, you'll be a member of the Science Team and conduct research on fields related to developing verifiable computation, e.g., zero-knowledge...

  • Research Scientist

    2 weeks ago


    san francisco, United States Strativ Group Full time

    Research Scientist - Robot LearningAre you ready to take cutting-edge AI research from the lab to the living room? Our customer is revolutionizing home automation with a multi-purpose household robot designed to handle real, everyday tasks. We're looking for a talented ML/Research Engineer who’s passionate about turning research into robust, scalable...

  • Research Scientist

    2 weeks ago


    San Francisco, United States Strativ Group Full time

    Research Scientist - Robot LearningAre you ready to take cutting-edge AI research from the lab to the living room? Our customer is revolutionizing home automation with a multi-purpose household robot designed to handle real, everyday tasks. We're looking for a talented ML/Research Engineer who’s passionate about turning research into robust, scalable...

  • Research Scientist

    2 weeks ago


    san francisco, United States Strativ Group Full time

    Research Scientist - Robot LearningAre you ready to take cutting-edge AI research from the lab to the living room? Our customer is revolutionizing home automation with a multi-purpose household robot designed to handle real, everyday tasks. We're looking for a talented ML/Research Engineer who’s passionate about turning research into robust, scalable...

  • Research Scientist

    1 month ago


    San Francisco, California, United States Evolutionary Scale Full time

    About UsAt EvolutionaryScale, our mission is to harness the power of artificial intelligence to unlock the complexities of biology for the benefit of human health and society. We push the boundaries of what AI can achieve in biological discovery through open, safe, and responsible research.Job SummaryWe are seeking a highly motivated Research Scientist to...

  • Senior Data Scientist

    1 month ago


    san antonio, United States Synergy Consulting Group, Inc. Full time

    Position SummaryWe are seeking a highly skilled and experienced Senior Data Scientist with a specialization in AI/ML Engineering to join our dynamic Data Science and AI team. In this role, you will be instrumental in transforming data into actionable insights and innovative solutions that drive our business strategy forward. You will leverage advanced...

  • Senior Data Scientist

    2 months ago


    San Antonio, United States Synergy Consulting Group, Inc. Full time

    Position SummaryWe are seeking a highly skilled and experienced Senior Data Scientist with a specialization in AI/ML Engineering to join our dynamic Data Science and AI team. In this role, you will be instrumental in transforming data into actionable insights and innovative solutions that drive our business strategy forward. You will leverage advanced...

  • Research Scientist

    1 month ago


    San Francisco, California, United States Anyscale Full time

    About AnyscaleAnyscale is a leading company in the field of distributed computing, aiming to democratize access to scalable machine learning. We're commercializing the popular open-source project Ray, creating an ecosystem of libraries for scalable machine learning. Our mission is to make distributed computing accessible to software developers of all skill...


  • San Francisco, United States Anthropic Limited Full time

    We’re building a team that will research and mitigate extreme risks from future models. This team will intensively red-team models to test the most significant risks they might be capable of in areas such as biosecurity, cybersecurity risks, or autonomy. We believe that clear demonstrations can significantly advance technical research and mitigations, as...