Research Engineer, Data Processing

6 days ago


San Francisco, United States OpenAI Full time
About the Team

At OpenAI, we strongly believe in the importance of data and have seen repeatedly how large of an impact focusing on data quality can yield across all of our projects. The Data Processing team brings this focus to our flagship GPT models, owning the pipelines for turning raw data into the high quality, diverse, and multimodal datasets used to train our largest models. We work closely with teams focused on data acquisition, data quality, and multimodal data throughout Research. Most recently, in collaboration with these groups, we were responsible for building the dataset used to pre-train OpenAI's newest multimodal model GPT-4o.

In addition to building new datasets, we collaborate on data research and acquisition with teams in Research and Multimodal to explore ways to get more out of data, including questions around efficiency, efficacy, and diversity. We also own and continuously improve the infrastructure used across several teams to prepare data for training models small and large.

About the Role

As a Research Engineer here, you will be responsible for building AI systems that can perform previously impossible tasks or achieve unprecedented levels of performance. We're looking for people with solid engineering skills who are comfortable working with large distributed systems and strive to write quality, well tested code.

The most outstanding deep learning results are increasingly attained at a massive scale, and these results require engineers who are comfortable working in large distributed systems. We expect engineering to play a key role in most major advances in AI of the future.

In this role, you will:
  • Build and own data pipelines operating on internet-scale data spanning the text, image, and audio modalities
  • Collaborate with many teams within Foundations and across Research to incorporate our latest and greatest research into pre-training datasets
  • Research new methods for improving our datasets alongside researchers within Foundations
You might thrive in this role if you:
  • Enjoy working at the cutting-edge of large language model research
  • Have experience running complicated processing on very large datasets
  • Are comfortable working in a fast-paced, dynamic environment - research can evolve quite rapidly


About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status.

OpenAI Affirmative Action and Equal Employment Opportunity Policy Statement

For US Based Candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

  • San Francisco, United States OpenAI Full time

    Research Engineer, Data Processing (Foundations)At OpenAI, we strongly believe in the importance of data and have seen repeatedly how large of an impact focusing on data quality can yield across all of our projects. The Data Processing team brings this focus to our flagship GPT models, owning the pipelines for turning raw data into the high quality, diverse,...


  • San Francisco, California, United States Braintrust Data Full time

    About Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...


  • San Francisco, United States OpenAI Full time

    Research Engineer, Human DataOpenAI | San FranciscoAbout the teamOpenAI's Human Data Team creates custom data solutions driving groundbreaking research. Our work enhances and evaluates our flagship models and products like ChatGPT, GPT-4o, and Sora, and contributes to safety initiatives through collaboration with our Preparedness and Safety Systems teams.We...


  • San Francisco, United States OpenAI Full time

    About the team OpenAI's Human Data Team creates custom data solutions driving groundbreaking research. Our work enhances and evaluates our flagship models and products like ChatGPT, GPT-4o, and Sora, and contributes to safety initiatives through collaboration with our Preparedness and Safety Systems teams. We work with AI trainers to gather specialized data...

  • Data Engineer

    5 days ago


    San Francisco, California, United States Scale AI, Inc. Full time

    Scale AI, Inc.We're seeking an experienced Data Engineer to lead our AI research and development efforts in Generative AI. As a Machine Learning Research Engineer, you will design next-generation data pipelines and supervision strategies in collaboration with our customers to accelerate progress in machine learning research.You will:Collaborate closely with...


  • San Francisco, California, United States Databricks Full time

    At Databricks, our mission is to empower users to make data-driven decisions. We are seeking a Data Research Strategist to join our team.About the RoleWe are looking for an expert researcher who can develop business-level strategy and vision in close collaboration with other disciplines. The ideal candidate will have experience in user research, mixed...

  • Research Scientist

    3 weeks ago


    San Francisco, United States ZipRecruiter Full time

    Job Description Are you passionate about using data to push the boundaries of knowledge and create innovative solutions? Do you excel in researching new methodologies, algorithms, and models that unlock data's potential? If you’re ready to shape the future of data science and lead cutting-edge research, our client has the perfect role for you. We’re...


  • San Francisco, California, United States Uncountable Inc Full time

    We're revolutionizing industrial research and development at Uncountable Inc, a technology startup that's pushing the boundaries of what's possible. As a Data Engineer, you'll play a critical role in helping us achieve our goal of accelerating the development of new chemicals and materials.What You'll DoWe're looking for a skilled Data Engineer to join our...

  • Data Analyst

    3 weeks ago


    San Francisco, California, United States Bitwise Investments Full time

    Crypto Research Expert OpportunityWe are seeking a highly skilled Data Analyst to join our Research team at Bitwise Investments. As a crypto research expert, you will play a crucial role in building and spearheading the team's data pipelines, infrastructure, and strategy.Job SummaryThe ideal candidate will have 5+ years of experience in research,...


  • San Francisco, California, United States Pendulum Full time

    About PendulumPendulum is pioneering a revolution in human health by understanding, restoring, and enhancing the microbiome. Our mission is to improve physical and mental well-being through groundbreaking research and innovative technologies. Studies have shown that our microbiome is linked to various aspects of health, including metabolism, diabetes,...


  • San Francisco, California, United States Software Guidance & Assistance, Inc. (SGA, Inc.) Full time

    About Software Guidance & Assistance, Inc.Software Guidance & Assistance, Inc. (SGA, Inc.) is a women-owned business that provides technology and resource solutions to tackle big IT problems with a personal approach. Our mission is to stand out by solving complex challenges through a boutique service.About the JobWe are seeking a highly motivated Data...


  • San Francisco, United States Data Masked Full time

    Experienced Data Scientist Machine Learning - Identity Verification We believe that the way people interact with their finances will drastically improve in the next few years. Were dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of...


  • San Francisco, United States Data Masked Full time

    Experienced Data Scientist Machine Learning - Identity Verification We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions...


  • San Francisco, California, United States Future House USA Full time

    About FutureHouseFutureHouse is a non-profit AI-for-science lab that uses AI to automate research in biology and other complex sciences. We are backed by Eric Schmidt, and our mission is to build AI systems that can scale scientific research and accelerate breakthrough discoveries.We are seeking talented AI Research Engineers with experience designing and...


  • San Francisco, California, United States Zing Data, Inc. Full time

    Drive Data-Driven Growth">We are seeking an experienced Senior Product Designer to lead the design of our data-driven products. As a key member of our team, you will play a crucial role in shaping the user experience and driving business growth through innovative product design.">About the Role">">Design and develop new features: Collaborate with...


  • San Antonio, United States Southwest Research Institute Full time

    Who We Are:We are a multidisciplinary team of engineers who collaboratively solve client driven problems primarily related to the human musculoskeletal system. We combine advanced experimental and computational methods applied to challenging problems to improve human health, performance, and safety.Objectives of this Role:Join our team to conduct innovative...


  • San Antonio, United States Southwest Research Institute Full time

    Who We Are:We are a multidisciplinary team of engineers who collaboratively solve client driven problems primarily related to the human musculoskeletal system. We combine advanced experimental and computational methods applied to challenging problems to improve human health, performance, and safety.Objectives of this Role:Join our team to conduct innovative...


  • San Francisco, United States OpenAI Full time

    The Applied team works across research, engineering, product, and design to bring OpenAI’s technology to consumers and businesses. We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. Safety is more important to us than unfettered growth. About the role: We're seeking a...

  • Cloud Engineer

    4 weeks ago


    San Francisco, United States Cornerstone Research Full time

    Overview CLOUD ENGINEER (HYBRID, ANY US OFFICE) If you are a technical professional looking for an opportunity to showcase your exceptional cloud expertise, then we would like to meet with you! The Cloud Engineer designs, deploys, manages, and supports cloud solutions running on AWS, Azure, and Google cloud platforms. Working with various functions in the IT...

  • Data Engineering Lead

    2 weeks ago


    San Francisco, United States LexisNexis Risk Solutions Full time

    JOB DESCRIPTION:Lead small teams in the development and execution of automated operations for large or multiple diverse projects to successfully and consistently enable delivery of high-quality services on time, on budget, and to specification, reacting quickly to changes in priorities or circumstances to meet business needs.Serve as resource manager for...