Research Scientist, Human-AI Interaction
2 weeks ago
OpenAI's Human Data Team creates custom data solutions driving groundbreaking research. Our work enhances and evaluates our flagship models and products like ChatGPT, GPT-4, and Sora, and contributes to safety initiatives through collaboration with our Preparedness and Safety Systems teams.
We work with AI trainers to gather specialized data for training and evaluating our models across modalities such as video, audio, text, and tool actions. Our goal is to develop scalable methods, tools, and platforms to generate and evaluate high-quality data from both synthetic sources and human experts in various fields, including mathematics, sciences, creative writing, programming, art, and safety. We leverage OpenAI models to improve and streamline our data collection and quality processes.
About the Role
In this role, you will work side by side with research teams to iteratively design and evaluate new methods for collecting high quality human data. You’ll use your knowledge of human cognition and data quality to co-design experiments, write instructions and assess the efficacy of our data collections. In parallel, you’ll partner with engineering and operations to implement changes and iteratively improve how we run human data campaigns.
This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.
In this role that’s the first of its kind, you will:
- Collaborate closely with researchers to understand, predict, and design tasks and quality rubrics to collect great human data.
- Engage with data labelers and vendors to evolve training and feedback mechanisms.
- Create hiring assessments and brainstorm acquisition strategies for high skill data labelers.
- Design and conduct experiments to assess the impact of interventions on human data quality.
- Come up with creative strategies for collecting and assessing high-quality data.
- Generate golden datasets and evaluation techniques.
- Work on multiple projects with tight timelines.
- Do whatever needs to be done to make our models better.
You might thrive in this role if you:
- Have a background in cognitive science, computational linguistics, human-computer interaction.
- Enjoy tackling big questions in an ambiguous and fast paced environment.
- Love being at the intersection of research and operational execution.
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status.
For US Based Candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
#J-18808-Ljbffr-
Research Scientist, Human-AI Interaction
4 weeks ago
San Francisco, California, United States OpenAI Full timeAbout the TeamAt OpenAI, our Human Data Team is dedicated to creating custom data solutions that drive groundbreaking research. Our work enhances and evaluates our flagship models and products, such as ChatGPT, GPT-4, and Sora, while contributing to safety initiatives through collaboration with our Preparedness and Safety Systems teams.We work with AI...
-
Research Scientist
7 days ago
San Francisco, United States techire ai Full timeDo you want to join a research team working on cutting-edge foundational multimodal models?You’ll be an experienced Researcher / Scientist who wants to shape the future of multimodal generative AI. You’ll need to have worked on complex AI models and have relevant research publications in either:Vision generation - video, image, 3D, LVMsAudio generation -...
-
Advanced AI Research Scientist
2 weeks ago
San Francisco, California, United States Scale AI, Inc. Full timeScale AI, Inc. is a leading provider of training and evaluation data and end-to-end solutions for the ML lifecycle. Our Generative AI team conducts research on models, supervision, and algorithms that advance frontier models for our applied-ML teams and the broader AI community.In this role, you will work closely with our Generative AI product team focused...
-
Machine Learning Research Scientist
1 month ago
San Francisco, California, United States Scale AI Full timeJob SummaryScale AI is seeking a highly technical Machine Learning Research Scientist to design next generation data pipelines and supervision strategies in close collaboration with our customers to accelerate progress in Generative AI. As a Strategic Partnerships Lead, you will work closely with researchers from top foundation model labs to shape the...
-
Lead AI Research Scientist
7 days ago
San Francisco, United States ZipRecruiter Full timeCompany Overview: Welcome to the forefront of AI research and innovation! At our company, we're dedicated to pushing the boundaries of artificial intelligence to solve complex problems and drive transformative change. Our mission is to advance the state-of-the-art in AI through cutting-edge research and development. Join us and be part of a dynamic team...
-
Research Scientist
2 weeks ago
San Francisco, United States OpenAI Full timeBy applying to this role, you will be considered for Research Scientist roles across all teams at OpenAI.About the RoleAs a Research Scientist here, you will develop innovative machine learning techniques and advance the research agenda of the team you work on, while also collaborating with peers across the organization. We are looking for people who want to...
-
AI Research Scientist
3 weeks ago
San Francisco, United States Unreal Gigs Full timeAre you passionate about advancing the field of artificial intelligence and working on groundbreaking research that pushes the boundaries of what’s possible? Do you thrive on solving complex challenges and developing new AI techniques that can revolutionize industries? If you’re excited about the opportunity to explore uncharted territories in AI and...
-
AI Research Scientist
2 months ago
San Francisco, United States Unreal Gigs Full timeAre you passionate about advancing the field of artificial intelligence and working on groundbreaking research that pushes the boundaries of what’s possible? Do you thrive on solving complex challenges and developing new AI techniques that can revolutionize industries? If you’re excited about the opportunity to explore uncharted territories in AI and...
-
Lead Applied Research Scientist
2 weeks ago
San Francisco, United States Salesforce Full timeJob Category: Software Engineering About Salesforce: We’re Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too — driving your performance...
-
Lead Applied Research Scientist
3 weeks ago
San Francisco, United States salesforce Full timeTo get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job CategorySoftware EngineeringJob DetailsAbout SalesforceWe’re Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across...
-
San Francisco, United States Scale AI, Inc. Full timeScale's Generative AI ML team conducts research on models, supervision, and algorithms that advance frontier models for Scale's applied-ML teams and the broader AI community. Scale is uniquely positioned at the heart of the field of AI as an indispensable provider of training and evaluation data and end-to-end solutions for the ML lifecycle. You will work...
-
Research Scientist, AI Model Optimization
1 month ago
San Francisco, California, United States OpenAI Full timeAbout the RoleWe are seeking a highly skilled research scientist to join our team at OpenAI. As a research scientist, you will be responsible for training and optimizing state-of-the-art language models using cutting-edge techniques and data.Key Responsibilities:Develop and implement new training protocols for large language modelsCollaborate with...
-
Staff AI Research Scientist San Francisco
1 month ago
San Francisco, California, United States Databricks Full timeAbout the RoleWe are seeking a highly skilled Research Scientist to join our Mosaic AI Team at Databricks. As a key member of our team, you will be responsible for advancing the scientific frontier in deep learning and creating new techniques that go beyond the state of the art. You will work collaboratively with a diverse team of researchers and engineers...
-
Research Scientist
1 month ago
San Francisco, California, United States Evolutionary Scale Full timeAbout UsAt EvolutionaryScale, our mission is to harness the power of artificial intelligence to unlock the complexities of biology for the benefit of human health and society. We push the boundaries of what AI can achieve in biological discovery through open, safe, and responsible research.Job SummaryWe are seeking a highly motivated Research Scientist to...
-
Machine Learning Research Scientist
3 weeks ago
San Francisco, United States Scale AI, Inc. Full timeScale works with the industry's leading foundation model labs to provide high quality data and accelerate progress in machine learning research. As a Machine Learning Research Engineer, you will design next generation data pipelines and supervision strategies in close collaboration with our customers to accelerate progress in Generative AI. The ideal...
-
AI Research Scientist
1 month ago
San Francisco, California, United States Sentient Full timeAbout SentientWe're pioneering the decentralized artificial general intelligence (AGI) frontier, breaking free from the constraints of centralized AI models. Our cutting-edge platform is designed to democratize AI development, empowering communities to collaboratively train and control AI models in a truly open and accessible ecosystem.Fueled by our...
-
AI User Experience
6 days ago
San Francisco, United States ZipRecruiter Full timeJob DescriptionAre you passionate about creating intuitive, human-centered experiences that make artificial intelligence accessible and enjoyable? Do you thrive on designing seamless interfaces that help users interact with AI systems effortlessly and intelligently? If you’re excited about merging AI innovation with thoughtful UX design to create products...
-
AI Research Engineer
3 weeks ago
San Francisco, United States Perplexity AI Full timeJob DescriptionJob DescriptionPerplexity is seeking experienced AI Research Engineers and Scientists to continue to improve our in house Online LLMs, the Sonar models. Your job is to take advantage of our rich query/answer dataset to continue to scale our Sonar model performance and provide the SOTA Online LLM experience to our...
-
Research Scientist, Scaling Laws
2 weeks ago
San Francisco, United States OpenAI Full timeResearch Scientist, Scaling Laws (Foundations)The Scaling Laws group within Architecture works to advance our foundational understanding of our deep learning stack. We study the algorithmic scaling behavior across architecture, optimization, and data. This work underpins OpenAI's ability to carry out other research through predictive scaling laws, correct...
-
Head of AI Research
3 weeks ago
San Francisco, United States Rungalileo Full timeAt Galileo, our mission is to make AI safe and available to all. Our roots lie in leading the creation of some of the world’s most widespread AI applications from Apple’s Siri to Google Speech. We believe that AI builders need well-crafted tools to create trustworthy and high-quality generative AI applications that will change how we work and live. In a...
