Research Engineer, Human-AI Interaction

1 month ago


San Francisco CA, United States Genai Works Full time

About the Team

The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to the real world to benefit the society and is at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency.

The Human-AI Interaction (HAI) team is responsible for pursuing effective and efficient use of human expertise for safety, policy, cultural, and social topics via novel approaches to Human-AI collaboration. Our goal is to ensure the model is aligned with human values by studying when to provide human feedback and how to do so efficiently and effectively with the model’s assistance.

About the Role

As one of the founding Research Engineers within the Human-AI Interaction team, you will play a crucial role in pioneering methodologies and implementing systems to integrate human feedback into AI models and systems. You will have an opportunity for shaping the team vision, work on the cutting edge of AI research, and collaborate closely with cross-functional teams to improve the safety, fairness, and transparency of AI systems via leveraging human expertise.

This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.

In this role, you will:

  • Experiment with novel methods for model-assisted instruction, rules, policy development, and prompt engineering.

  • Design and implement systems for collecting and integrating high-quality human feedback into AI systems.

  • Explore ways to use various forms of human feedback that can best benefit model training.

  • Design model safety behavior evaluation practice with human data.

  • Study ways of human-AI collaboration for challenging tasks, including tasks on ambiguous or controversial topics, AI in sensitive or regulated domains, etc.

  • Contribute to the development of tooling and workflow for offline iteration and feedback integration.

You might thrive in this role if you:

  • Are excited about OpenAI’s mission of building safe, universally beneficial AGI and are aligned with OpenAI’s charter

  • Have strong belief in & passion for the value of human feedback for development safe AI for real-world use.

  • Bring 3+ years of experience in the field of AI safety, especially in areas like RLHF, human-AI collaboration, human feedback collection.

  • Hold a Ph.D. or other degree in computer science, machine learning, or a related field.

  • Have an in-depth understanding of deep learning research and/or strong engineering skills.

  • Stay goal-oriented instead of method-oriented, and are not afraid of tedious but high-value work when needed.

  • Are a team player who enjoys collaborative work environments.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.

We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status.

For US Based Candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link .

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

#J-18808-Ljbffr

  • San Francisco, United States Snorkel AI, Inc. Full time

    We are looking for a Director of Engineering to lead our AI Platform team. Our AI Platform team builds innovative software systems to power the Snorkel Flow platform. This includes services to train and serve generative AI and machine learning models using novel data-centric techniques, libraries to support AI workflows for a variety of data modalities and...

  • AI Research Engineer

    3 weeks ago


    San Francisco, United States Cadre Full time

    Sr. AI Research EngineerExperience as a senior contributor at a high performing company Past work with large-scale ML systems, GPUs, kubernetes, pytorch Generative AI, diffusion, transformers expertise is a plus, especially in audio and music Aptitude for taking research advancements and turning them into real product solutions Knowledge of technological...


  • San Francisco, United States Hire Digital Full time

    Job DescriptionJob DescriptionOutlier is a forward-thinking software development company that pushes artificial intelligence's boundaries. As a part of their ongoing projects, Outlier is building a cloud-based contact centre powered by artificial intelligence (AI). This innovative contact centre platform seamlessly integrates with customer relationship...


  • San Francisco, United States Connectly Full time

    At Connectly we are building revolutionary conversational commerce experiences. Unlike traditional shopping where you have to download an app, or sign up on a website, we allow customers to engage and transact directly within the thread. By choosing Connectly you will join a VC-backed series A startup on a growth trajectory, work with our world-class team,...


  • San Francisco, United States Connectly Full time

    At Connectly we are building revolutionary conversational commerce experiences. Unlike traditional shopping where you have to download an app, or sign up on a website, we allow customers to engage and transact directly within the thread. By choosing Connectly you will join a VC-backed series A startup on a growth trajectory, work with our world-class team,...


  • San Francisco, United States essential AI Full time

    Job DescriptionJob DescriptionEssential AI’s mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today. We believe that building delightful end-user experiences requires innovating across the stack - from the UX all the way down to models that achieve the best user...


  • San Francisco, United States Essential AI Full time

    Essential AI's mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today. We believe that building delightful end-user experiences requires innovating across the stack - from the UX all the way down to models that achieve the best user value per FLOP. We believe that...

  • AI Engineer

    5 hours ago


    San Francisco, United States Cohere Full time

    Who are we? Cohere is focused on building and deploying large language model (LLM) AI into enterprises in a safe and responsible way that drives human productivity, and creates magical new ways to interact with technology and real business value. We’re a team of highly motivated and experienced engineers, innovators, and disruptors looking to change the...

  • AI Engineer

    1 month ago


    San Francisco, United States Cynch AI Full time

    Come Revolutionize Accounting with AI  We're a seed-stage AI startup led by a founding team of AI startup veterans on a mission to revolutionize the accounting industry. We're seeking an exceptional AI Engineer to help turn our vision into reality. We are combining reasoning, machine learning, and generative AI to augment and democratize the expertise...

  • AI Engineer

    1 month ago


    San Francisco, United States Cynch AI Full time

    Job DescriptionJob DescriptionCome Revolutionize Accounting with AI We're a seed-stage AI startup led by a founding team of AI startup veterans on a mission to revolutionize the accounting industry. We're seeking an exceptional AI Engineer to help turn our vision into reality. We are combining reasoning, machine learning, and generative AI to...


  • San Francisco, United States essential AI Full time

    Essential AI's mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today. We believe that building delightful end-user experiences requires innovating across the stack - from the UX all the way down to models that achieve the best user value per FLOP. We believe that...


  • San Francisco, United States Essential AI Full time

    Essential AI's mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today. We believe that building delightful end-user experiences requires innovating across the stack - from the UX all the way down to models that achieve the best user value per FLOP. We believe that...

  • AI Engineer

    10 hours ago


    San Francisco, United States Writer Corporation Full time

    ✍🏽 About Writer AI your people will love. That's our vision, and it contains multitudes :-) AI your people will love. We're filling a big need for generative AI built ground-up for the needs of enterprises and embraced by their teams. As generative AI became a board-level initiative almost overnight for most enterprises, our market matured dramatically...


  • San Francisco, United States OpenAI Full time

    About the team OpenAI's mission is to ensure that artificial general intelligence benefits all of humanity. OpenAI's Collective Alignment Team works on technical approaches to ensure that AGI is shaped democratically. We plan to do so by implementing a system for collecting and encoding public input on model behavior into our systems. While OpenAI has...


  • San Francisco, United States OpenAI Full time

    About the team OpenAI's mission is to ensure that artificial general intelligence benefits all of humanity. OpenAI's Collective Alignment Team works on technical approaches to ensure that AGI is shaped democratically. We plan to do so by implementing a system for collecting and encoding public input on model behavior into our systems. While OpenAI has...

  • AI Research Scientist

    1 month ago


    San Francisco, California, United States Cognizant Technology Solutions Full time

    Cognizant AI LabsCognizant works with an incredible diversity of organizations across the globe, using AI to improve decision-making, robustness, forecasting, and growth at every level of operation. Within Cognizant, Cognizant AI Labs serves as the center of excellence for pioneering AI research. The team works to develop novel approaches to solve both...

  • AI Research Scientist

    3 weeks ago


    San Francisco, California, United States Cognizant Technology Solutions Full time

    Cognizant AI LabsCognizant works with an incredible diversity of organizations across the globe, using AI to improve decision-making, robustness, forecasting, and growth at every level of operation. Within Cognizant, Cognizant AI Labs serves as the center of excellence for pioneering AI research. The team works to develop novel approaches to solve both...

  • AI Research Scientist

    4 weeks ago


    San Francisco, California, United States Cognizant Technology Solutions Full time

    Cognizant AI LabsCognizant works with an incredible diversity of organizations across the globe, using AI to improve decision-making, robustness, forecasting, and growth at every level of operation. Within Cognizant, Cognizant AI Labs serves as the center of excellence for pioneering AI research. The team works to develop novel approaches to solve both...

  • Compiler Engineer

    2 weeks ago


    San Francisco, United States Untether AI Full time

    ***Please note: While our engineering HQ is in Toronto, this is a remote opportunity and we welcome applicants from anywhere in North America.*** Untether AI is building the world’s highest performance pure-digital AI inference startup. We’re a rapidly growing Toronto-based startup, with employees across Canada and the US, building next generation...

  • Software Engineer

    22 hours ago


    San Francisco, United States Distyl AI Full time

    Distyl AI develops production-grade AI systems to power core operational workflows for the Fortune 500. Working in partnership with OpenAI, Distyl brings deep enterprise AI expertise and software to develop production-grade AI systems that deliver rapid time-to-value for our customers.Led by proven leaders from top companies like Palantir and Apple, the...