Research Scientist, Human-AI Interaction

4 weeks ago


San Francisco, California, United States OpenAI Full time

About the Team

At OpenAI, our Human Data Team is dedicated to creating custom data solutions that drive groundbreaking research. Our work enhances and evaluates our flagship models and products, such as ChatGPT, GPT-4, and Sora, while contributing to safety initiatives through collaboration with our Preparedness and Safety Systems teams.

We work with AI trainers to gather specialized data for training and evaluating our models across various modalities, including video, audio, text, and tool actions. Our goal is to develop scalable methods, tools, and platforms to generate and evaluate high-quality data from both synthetic sources and human experts in diverse fields.

About the Role

In this role, you will work closely with research teams to design and evaluate new methods for collecting high-quality human data. You will use your knowledge of human cognition and data quality to co-design experiments, write instructions, and assess the efficacy of our data collections.

This role involves collaborating with engineering and operations teams to implement changes and iteratively improve how we run human data campaigns. You will also partner with data labelers and vendors to evolve training and feedback mechanisms.

Key Responsibilities:

  • Collaborate with researchers to understand, predict, and design tasks and quality rubrics to collect great human data.
  • Engage with data labelers and vendors to evolve training and feedback mechanisms.
  • Create hiring assessments and brainstorm acquisition strategies for high-skill data labelers.
  • Design and conduct experiments to assess the impact of interventions on human data quality.
  • Come up with creative strategies for collecting and assessing high-quality data.
  • Generate golden datasets and evaluation techniques.
  • Work on multiple projects with tight timelines.

Requirements:

  • Background in cognitive science, computational linguistics, human-computer interaction.
  • Ability to tackle big questions in an ambiguous and fast-paced environment.
  • Experience in the intersection of research and operational execution.


  • San Francisco, California, United States Scale AI, Inc. Full time

    Scale AI, Inc. is a leading provider of training and evaluation data and end-to-end solutions for the ML lifecycle. Our Generative AI team conducts research on models, supervision, and algorithms that advance frontier models for our applied-ML teams and the broader AI community.In this role, you will work closely with our Generative AI product team focused...


  • San Francisco, California, United States Scale AI Full time

    Job SummaryScale AI is seeking a highly technical Machine Learning Research Scientist to design next generation data pipelines and supervision strategies in close collaboration with our customers to accelerate progress in Generative AI. As a Strategic Partnerships Lead, you will work closely with researchers from top foundation model labs to shape the...

  • Research Scientist

    1 month ago


    San Francisco, California, United States Deepgram Full time

    About DeepgramDeepgram is a pioneering AI company dedicated to revolutionizing human-machine interaction through natural language. Our mission is to empower developers with the fastest and most powerful voice AI platform, accessible via a single API call.The OpportunityWe're seeking a talented Research Scientist to join our team and contribute to the...

  • Product Designer

    4 weeks ago


    San Francisco, California, United States Recruiting from Scratch Full time

    About Recruiting from ScratchWe're a talent firm that focuses on placing the best candidates for our clients. Our team is 100% remote and works with teams across North America, South America, and Europe to help them hire.About the RoleWe're looking for an experienced Product Designer to help craft the future of human-AI interactions. As a Product Designer,...


  • San Francisco, California, United States OpenAI Full time

    About the RoleWe are seeking a highly skilled research scientist to join our team at OpenAI. As a research scientist, you will be responsible for training and optimizing state-of-the-art language models using cutting-edge techniques and data.Key Responsibilities:Develop and implement new training protocols for large language modelsCollaborate with...


  • San Francisco, California, United States Databricks Full time

    About the RoleWe are seeking a highly skilled Research Scientist to join our Mosaic AI Team at Databricks. As a key member of our team, you will be responsible for advancing the scientific frontier in deep learning and creating new techniques that go beyond the state of the art. You will work collaboratively with a diverse team of researchers and engineers...

  • Research Scientist

    1 month ago


    San Francisco, California, United States Evolutionary Scale Full time

    About UsAt EvolutionaryScale, our mission is to harness the power of artificial intelligence to unlock the complexities of biology for the benefit of human health and society. We push the boundaries of what AI can achieve in biological discovery through open, safe, and responsible research.Job SummaryWe are seeking a highly motivated Research Scientist to...

  • AI Research Scientist

    1 month ago


    San Francisco, California, United States Sentient Full time

    About SentientWe're pioneering the decentralized artificial general intelligence (AGI) frontier, breaking free from the constraints of centralized AI models. Our cutting-edge platform is designed to democratize AI development, empowering communities to collaboratively train and control AI models in a truly open and accessible ecosystem.Fueled by our...


  • San Francisco, California, United States Capital One Full time

    About the RoleThe AI Foundations team at Capital One is at the forefront of driving innovation in AI. Our work spans the entire research lifecycle, from collaborating with academia to building production systems. We work closely with product, technology, and business leaders to bring our vision for AI to life.Key ResponsibilitiesPartner with academia and...


  • San Francisco, California, United States Perplexity AI Full time

    Converse with the FutureWe're seeking a seasoned AI Research Engineer to spearhead the development of our conversational answer engine.Your mission is to design and implement cutting-edge AI systems that cater to the ever-evolving needs of our users. You'll be responsible forContinuously pushing the boundaries of AI-driven conversational...


  • San Francisco, California, United States Amazon Full time

    Job Title: Principal Applied ScientistAmazon is seeking a highly skilled Principal Applied Scientist to join our Responsible AI team. As a key member of this team, you will contribute to the development of new solutions and science best practices in Responsible AI.About the RoleThis is a unique opportunity to work on cutting-edge AI research and development,...

  • Research Scientist

    1 month ago


    San Francisco, California, United States TBWA\Chiat\Day Full time

    Unlock the Future of RoboticsWe are seeking a talented Research Scientist to join our team at Skild AI, where we are pushing the boundaries of artificial intelligence and robotics. As a key member of our research team, you will play a crucial role in developing the next generation of techniques to advance the capabilities of our robotic systems.Key...

  • AI Researcher

    4 weeks ago


    San Francisco, California, United States Waabi Full time

    Research Engineer at WaabiAbout WaabiWaabi is an AI company building the next generation of self-driving technology. We're passionate about using AI to make transportation safer and more efficient.As a Research Engineer at Waabi, you'll be at the forefront of advancing and deploying artificial intelligence algorithms for our self-driving vehicles.You'll work...


  • San Francisco, California, United States Recruiting from Scratch Full time

    About the Role:As a research scientist with Recruiting from Scratch, you will develop novel techniques to explain and understand the behavior of AI models. This work will focus on improving model mapping, a technique that converts transformers into more interpretable representations.This role requires individuals who can design and execute experiments to...


  • San Francisco, California, United States Integrity Careers LLC Full time

    Job OverviewA cutting-edge AI research lab in San Francisco is seeking three skilled Machine Learning Research Engineers to contribute to their innovative projects. With a team of 15 members and over $20 million in funding, this is an excellent opportunity for engineers passionate about machine learning to work on pioneering projects in a dynamic...


  • San Francisco, California, United States Anthropic Limited Full time

    About the RoleWe are seeking a highly skilled Research Scientist to join our team at Anthropic Limited. The successful candidate will be responsible for conducting research and developing novel evaluations to accurately assess the biosecurity implications of our large language models.The ideal candidate will have a strong background in biology, computational...

  • AI Researcher

    4 weeks ago


    San Francisco, California, United States Imbue, Inc. Full time

    **Key Responsibilities:We are seeking a highly accomplished machine learning researcher to join our team at Imbue, Inc.Your primary focus will be on investigating the fundamental questions of intelligence, knowledge, and understanding to develop software with human-level intelligence.You will collaborate with our research engineers, external researchers, and...


  • San Francisco, California, United States Tavus Full time

    About TavusTavus is a pioneering company at the forefront of AI generative video technology. Our cutting-edge models empower developers and product teams to create innovative applications, from text-to-video with AI avatars to real-time interactions.We are a Series A startup backed by top investors, including Sequoia, Y Combinator, and Scale VC, and we're...

  • Product Designer

    4 weeks ago


    San Francisco, California, United States Mithrl Full time

    We are a fast-growing startup in the heart of San Francisco, revolutionizing the way scientists interact with AI-driven tools. Our mission is to empower scientists to focus on scientific breakthroughs by creating user-centric technologies that simplify complex workflows.The Product Designer role is a pivotal part of our journey, requiring a creative and...


  • San Francisco, California, United States Amazon Full time

    Principal Applied Scientist, AGI FoundationsAs a key member of the Amazon AI team, you will play a critical role in driving the development of Generative AI (GenAI) technologies that can handle Amazon-scale use cases and have a significant impact on our customers' experiences.Key ResponsibilitiesDefine key research directions and adopt or invent new machine...