Research Scientist, AI Security

1 week ago


San Francisco, California, United States OpenAI Full time
About the Team

The Safety Systems team at OpenAI is responsible for ensuring the safe deployment of our AI models to benefit society. We are at the forefront of OpenAI's mission to build and deploy safe AGI, driving our commitment to AI safety and fostering a culture of trust and transparency.

We are facing emergent challenges in the security and privacy domains specific to large language models, and we seek to learn from deployment and distribute the benefits of AI while ensuring responsible and safe use.

About the Role

We are seeking strong research engineers to pioneer methodologies and implement systems to reduce risks of AI security and privacy research challenges during model deployment.

You will have the opportunity to shape the vision of this problem domain, work on the cutting edge of AI research, and collaborate closely with cross-functional teams to improve AI security and privacy protection of our models and systems.

Key Responsibilities
  • Design, implement, and evaluate novel methods to protect AI models and systems from threats such as data extraction and model inversion attacks.
  • Collaborate with the Post Training team to integrate privacy-preserving techniques into AI model development.
  • Lead efforts in researching and implementing solutions to mitigate risks proactively associated with data poisoning, membership inference attacks, and more.
  • Work closely with cross-functional teams to establish security and privacy best practices and guidelines for model deployment.
Requirements
  • Strong motivation by OpenAI's mission of building safe, universally beneficial AGI and alignment with OpenAI's charter.
  • Hold a Ph.D. or other degree in computer science, AI, machine learning, or a related field.
  • 3+ years of experience in the field of AI security and privacy research for deep learning models, especially in areas like membership inference, privacy-preserving ML, and adversarial attacks.
  • Deep understanding of deep learning research and/or strong engineering skills, particularly proficient in programming languages such as Python and machine learning frameworks like PyTorch (preferred) or TensorFlow.
  • Goal-oriented instead of method-oriented, and not afraid of tedious but high-value work when needed.
  • Team player who enjoys collaborative work environments.
About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products.

We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability, or any other legally protected status.


  • AI Research Scientist

    2 weeks ago


    San Francisco, California, United States Playground AI Full time

    About the RoleWe are seeking a highly skilled AI Research Engineer to join our team at Playground AI. As a key member of our engineering team, you will be responsible for implementing cutting-edge research papers and exploring new ideas in the field of AI.Key ResponsibilitiesImplement research papers in Python and PyTorchWork on distributed systems for...


  • San Francisco, California, United States Kiva AI Full time

    About Kiva AIKiva AI is a pioneering startup in the field of artificial intelligence, dedicated to creating scalable solutions that push the boundaries of AI applications. Our mission is to revolutionize data labeling, collection, and curation through our AI marketplace, leveraging cutting-edge technologies like AI and Web3 infrastructure.The RoleWe are...

  • AI Research Scientist

    4 weeks ago


    San Francisco, California, United States Twelve Labs Full time

    Position OverviewTwelve Labs is on the lookout for a skilled AI Research Scientist to spearhead our initiatives in video embedding and retrieval, multimodal language models, and intelligent agents. As a pivotal member of our research team, you will work closely with the team lead to identify and implement AI research projects with diligence and foresight....

  • AI Research Scientist

    1 month ago


    San Francisco, California, United States Twelve Labs Full time

    Position OverviewTwelve Labs is on the lookout for a skilled AI Research Scientist to spearhead our innovative research initiatives in video representation and retrieval, multimodal language processing, and intelligent systems. As a pivotal member of our research team, you will work in close collaboration with the team leader to identify and implement AI...


  • San Francisco, California, United States Waabi Full time

    Job Title: PhD Research ScientistWaabi is seeking a highly motivated and talented PhD Research Scientist to join our team of multidisciplinary researchers and engineers. As a PhD Research Scientist, you will be part of a team using an AI-first approach to enable safe self-driving at scale.Key Responsibilities:Lead or contribute to an AI research project,...


  • San Francisco, California, United States Genai Works Full time

    About the TeamThe Genai Works Safety Systems team is responsible for ensuring the safe deployment of our AI models to benefit society.We are at the forefront of our mission to build and deploy safe Artificial General Intelligence (AGI), driving our commitment to AI safety and fostering a culture of trust and transparency.As we deploy cutting-edge AI models...


  • San Francisco, California, United States Amazon Full time

    About the RoleWe are seeking a highly skilled and experienced Senior AI Research Scientist to join our team at Amazon. As a key member of our organization, you will be responsible for driving innovation and excellence in the field of Artificial Intelligence (AI) and Machine Learning (ML).Key ResponsibilitiesConduct in-depth research and analysis of technical...

  • AI Research Scientist

    3 weeks ago


    San Francisco, California, United States Indiana Biosciences Research Institute Full time

    About the RoleWe are seeking a highly skilled Research Scientist to join our team at the Indiana Biosciences Research Institute. As a Research Scientist, you will play a key role in advancing the science and technology of intelligent machines, working on research projects, strategies, and problems of moderate to high complexity and scope.Key...


  • San Francisco, California, United States Unreal Gigs Full time

    Job OverviewUnreal Gigs is seeking a highly skilled AI Research Scientist to join our team. As an AI Research Scientist, you will be responsible for conducting groundbreaking research in AI domains such as deep learning, NLP, or computer vision. Your work will not only push the boundaries of what machines can learn but also shape the future of our society...


  • San Francisco, California, United States Waabi Full time

    Research Scientist InternshipWaabi is an AI company revolutionizing self-driving technology. We're seeking a highly motivated PhD Research Scientist Intern to contribute to our cutting-edge research projects.Key Responsibilities:Collaborate with our multidisciplinary team to develop novel algorithms for Autonomous Vehicles.Design, implement, and optimize AI...


  • San Francisco, California, United States Genai Works Full time

    About the Team**Mission-Driven Team**The Genai Works Safety Systems team is responsible for developing and implementing cutting-edge safety solutions to ensure our AI models are deployed safely and responsibly. We are at the forefront of Genai Works' mission to build and deploy safe artificial general intelligence (AGI), driving our commitment to AI safety...

  • AI Research Scientist

    4 weeks ago


    San Francisco, California, United States Twelve Labs Full time

    Position OverviewTwelve Labs is in search of a skilled AI Research Scientist to spearhead our initiatives in video representation and retrieval, multimodal language processing, and intelligent systems. As a pivotal member of our research team, you will work closely with the team leader to identify and implement AI research projects with a sense of...


  • San Francisco, California, United States Waabi Full time

    Research Scientist Internship at WaabiWaabi is an AI company building the next generation of self-driving technology. We are seeking a highly motivated and talented Research Scientist Intern to join our team.Key Responsibilities:Contribute to an AI research project, developing new algorithms for Autonomous Vehicle (AV) and pushing the frontiers of the...


  • San Francisco, California, United States Waabi Full time

    About WaabiWaabi is a pioneering AI company that is revolutionizing the field of self-driving technology. Founded by AI visionary Raquel Urtasun, Waabi is committed to developing the next generation of safe and efficient self-driving systems.Our team of world-class researchers and engineers is working tirelessly to push the boundaries of AI and machine...

  • Research Scientist

    4 weeks ago


    San Francisco, California, United States Databricks Inc. Full time

    About the RoleWe are seeking a highly skilled Research Scientist to join our Mosaic AI Team at Databricks Inc. in San Francisco, California. As a Research Scientist, you will be responsible for advancing the scientific frontier in deep learning and creating new techniques that go beyond the state of the art.Key ResponsibilitiesStay up-to-date with the latest...


  • San Francisco, California, United States Alldus Full time

    About AlldusAlldus is a pioneering company at the forefront of Automation AI, revolutionizing the way repetitive tasks are identified and automated. Our cutting-edge platform leverages a foundational model to understand user behavior, predict, and automate mundane tasks without requiring any coding input. This AI-driven approach evolves continuously through...


  • San Francisco, California, United States OpenAI Full time

    About the TeamThe Applied Research team is focused on pushing the boundaries of AI capabilities and exploring how computing might evolve to benefit humanity.About the RoleAs a Research Engineer on this team, you will collaborate with top research scientists and design talent to advance model capabilities and drive innovation.This role is ideal for...


  • San Francisco, California, United States Strativ Group Full time

    Senior Research ScientistWe are seeking a highly skilled Senior Research Scientist to join our team at Strativ Group. As a pioneering mind in machine learning, you will be working on cutting-edge biological research projects, leveraging your expertise in generative AI and deep learning to drive innovation.About the RoleThis is an exceptional opportunity to...


  • San Francisco, California, United States Twelve Labs Full time

    Position OverviewTwelve Labs is on the lookout for a skilled AI Research Scientist dedicated to advancing our initiatives in video representation and retrieval, multimodal language processing, and intelligent systems. As a pivotal member of our research team, you will work closely with the team leader to identify and implement AI research projects with...


  • San Francisco, California, United States Perplexity AI Full time

    Job OpportunityWe are seeking a highly skilled Research Engineer to contribute to the development of our large-scale language models. As a key member of our team, you will play a crucial role in shaping the future of AI-powered search and conversational interfaces.Key Responsibilities:Design and implement large-scale data pipelines to feed billions of tokens...