Human Data Specialist: Crafting High-Quality AI Training Data

6 days ago


San Francisco, California, United States OpenAI Full time
Company Overview
OpenAI is a pioneering AI research and deployment company dedicated to ensuring that artificial intelligence benefits humanity. Our mission is to safely deploy AI systems through our products, focusing on human needs and safety.

About the Role
In this unique role, you will collaborate with research teams to design and evaluate methods for collecting high-quality human data. You'll use your knowledge of human cognition and data quality to co-design experiments, write instructions, and assess data collection efficacy. This involves partnering with engineering and operations teams to implement changes and improve human data campaigns.

Key Responsibilities
  • Collaborate closely with researchers to understand tasks, predict outcomes, and design quality rubrics for collecting great human data.
  • Engage with data labelers and vendors to evolve training and feedback mechanisms.
  • Create hiring assessments and brainstorm strategies for acquiring high-skill data labelers.
  • Design and conduct experiments to assess the impact of interventions on human data quality.
  • Come up with creative strategies for collecting and assessing high-quality data.
  • Generate golden datasets and evaluation techniques.
  • Work on multiple projects with tight timelines.

About OpenAI
We value diverse perspectives, voices, and experiences that form the spectrum of humanity. We are an equal opportunity employer and do not discriminate based on race, religion, national origin, gender, sexual orientation, age, veteran status, disability, or any other protected status.

Salary and Benefits
This position is based in San Francisco, CA, with a hybrid work model allowing for 3 days in the office per week. We offer relocation assistance to new employees. The estimated salary for this role is $120,000 - $180,000 annually, depending on experience.

  • San Francisco, California, United States Magic AI Full time

    Job OverviewMagic AI is a cutting-edge technology company focused on building safe Artificial General Intelligence (AGI) to accelerate humanity's progress on the world's most important problems.Salary Range:$100K - $550K per year, with equity and benefits included in total compensation.About the RoleWe're seeking a highly skilled AI Data Engineer to join our...


  • San Francisco, California, United States Scale AI Full time

    About Scale AIAt Scale AI, our mission is to accelerate the development of AI applications. With 8 years of experience as the leading AI data foundry, we've helped fuel exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. Our recent Series F round has enabled us to accelerate the abundance of frontier data,...


  • San Francisco, California, United States Magic AI Full time

    Company OverviewMagic AI is a cutting-edge technology company dedicated to building safe Artificial General Intelligence (AGI) that accelerates humanity's progress on the world's most important problems.We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than...


  • San Francisco, California, United States Braintrust Data Full time

    About Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...


  • San Francisco, California, United States Scale AI, Inc. Full time

    About Scale AIScale AI, Inc. is accelerating the development of AI applications and leading the way in data quality. Our mission is to empower businesses by providing top-notch AI solutions.We are looking for a skilled Senior Software Engineer to join our team and contribute to the creation of high-quality data products. The ideal candidate will have a track...


  • San Francisco, California, United States Scale AI, Inc. Full time

    Senior Fullstack Software Engineer Role at Scale AI, Inc.About the OpportunityWe are seeking a skilled Senior Fullstack Software Engineer to join our team at Scale AI, Inc. in San Francisco or New York City. As a key member of our data quality team, you will be responsible for building systems that monitor and flag quality issues with large-scale data...


  • San Francisco, California, United States Scale AI, Inc. Full time

    About Scale AI, Inc.We are at the forefront of powering AI and LLMs across multiple industries. Our thesis is that to build exceptional LLMs you need exceptional human beings to train them. Humans are essential in providing the best training data for these models, and Scale operates the largest network of humans in the world to provide this training data.The...

  • Data Engineer

    6 days ago


    San Francisco, California, United States Scale AI, Inc. Full time

    Scale AI, Inc.We're seeking an experienced Data Engineer to lead our AI research and development efforts in Generative AI. As a Machine Learning Research Engineer, you will design next-generation data pipelines and supervision strategies in collaboration with our customers to accelerate progress in machine learning research.You will:Collaborate closely with...


  • San Francisco, California, United States Perplexity AI Full time

    Perplexity AI is a leading innovator in conversational AI technology.SalaryThe estimated annual salary for this role is $240,000, reflecting the company's commitment to attracting top talent and rewarding expertise.Job DescriptionWe're seeking an experienced Data Science Specialist to join our team and play a key role in optimizing our conversational AI...


  • San Francisco, California, United States Magic AI Full time

    Job DescriptionMagic AI's mission is to create safe artificial intelligence that accelerates humanity's progress on the world's most pressing problems.We believe the most promising path to safe AI lies in automating research and code generation to improve models and solve alignment more reliably than humans alone. Our approach combines frontier-scale...


  • San Francisco, California, United States Spice AI Full time

    About the Role:We are seeking a highly skilled Data Innovation Evangelist to join our team at Spice AI. As a key member of our organization, you will be responsible for leading and executing our developer relations and product marketing strategy.Key Responsibilities:Becoming a technical advocate for Spice.ai OSS and the Spice.ai data and AI platformLeading...


  • San Ramon, California, United States CXApp, Inc Full time

    CXAPP, Inc. is seeking a skilled AI and Data Quality Assurance Specialist to join our team. The ideal candidate will have a strong understanding of AI concepts, algorithms, and machine learning models, as well as proven experience in testing AI and data-driven solutions.**Key Responsibilities:**• Develop test plans and test cases specifically designed for...

  • Data Engineer

    6 days ago


    San Francisco, California, United States Scale AI, Inc. Full time

    About Scale AI, Inc.We accelerate the development of AI applications at Scale AI. Our mission is to pave the road to Artificial General Intelligence (AGI) through frontier data abundance. We offer deep capabilities and offerings for public and private evaluations, building on our prior model evaluation work with enterprise customers and governments.About...

  • Data Scientist

    6 days ago


    San Francisco, California, United States Medqor Llc. Full time

    Job SummaryWe are seeking a skilled Data Scientist to join our team at Medqor LLC. as a Human Impact Specialist.This is a challenging and rewarding role that requires expertise in analyzing the effects of artificial intelligence (AI) systems on human behavior and mental health.The ideal candidate will have a strong background in machine learning, data...


  • San Francisco, California, United States Pano AI Full time

    About the RolePano AI is a leader in wildfire early detection, leveraging IoT, AI, satellites, and SaaS software to deliver actionable intelligence to customers. As a Cloud Data Engineer, you will be part of the data platform pod that develops and deploys data ingestion and processing systems.You will develop pipelines to ingest, process, and publish large...


  • San Francisco, California, United States Perplexity AI Full time

    We are seeking an experienced Data Inference Specialist to join our team at Perplexity AI.OverviewAt Perplexity AI, we've achieved tremendous growth and adoption since launching the world's first fully functional conversational answer engine. Our AI-powered search assistant has amassed 10 million monthly active users, with mobile apps installed over 1...


  • San Francisco, California, United States ZipRecruiter Full time

    Job SummaryThis is an exciting opportunity for a skilled AI Healthcare Data Specialist to join our team at ZipRecruiter. In this role, you will be working with healthcare data, leveraging your expertise in LLMs and Python to drive business growth.About the RoleWe are seeking a highly motivated individual with a strong background in healthcare data analysis...


  • San Francisco, California, United States Scale AI, Inc. Full time

    About Scale AI, Inc.At Scale AI, Inc., our mission is to accelerate the development of AI applications. For years, Scale has been the leading AI data foundry, helping fuel advancements in AI, including generative AI, defense applications, and autonomous vehicles. With recent investments, we're accelerating the abundance of frontier data to pave the road to...


  • San Francisco, California, United States Windfall Data, Inc. Full time

    Windfall Data, Inc. is seeking a seasoned data professional to play a pivotal role in developing and scaling our foundational predictive models.This is a highly impactful position where you will influence the core of our data product offerings and collaborate with cross-functional teams to maintain the highest standards of model performance.We're on a...


  • San Francisco, California, United States Amazon Data Services, Inc. Full time

    About Amazon Data Services, Inc.At Amazon Data Services, Inc., we're passionate about delivering exceptional customer experiences. As the world's most comprehensive and broadly adopted cloud platform, we're committed to innovation and excellence in all that we do.We're seeking a highly skilled Data Center Operations Specialist to join our team. In this...