Research Engineer, AI Security

3 weeks ago


San Francisco CA, United States OpenAI Full time

The Safety Systems team is responsible for various safety work to ensure our best models can be safely deployed to benefit society. As the cutting edge AI models get deployed to the real world at fast speed, we are facing emergent challenges in the security and privacy domains that are specific to large language models. More research and learning from practical deployment is needed to develop principled solutions for problems, including but not limited to, model inversion or data extraction prevention, knowledge unlearning, anti-regurgitation, fine-tuning safety, privacy-aware data flywheel and protection against data poisoning.
We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely.
We are seeking strong research engineers for pioneering methodologies and implementing systems to reduce risks of various AI security and privacy research challenges during model deployment. You will have an opportunity to shape the vision of this problem domain, work on the cutting edge of AI research, and collaborate closely with cross-functional teams to improve AI security and privacy protection of our models and systems.
We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.
Design, implement, and evaluate novel methods to protect AI models and systems from threats such as data extraction and model inversion attacks.

Collaborate with the Post Training team to integrate privacy-preserving techniques into AI model development.
Lead efforts in researching and implementing solutions to mitigate risks proactively associated with data poisoning, membership inference attacks and more.
Work closely with cross-functional teams to establish security and privacy best practices and guidelines for model deployment.

Are strongly motivated by OpenAI's mission of building safe, universally beneficial AGI and are aligned with OpenAI's charter
D. or other degree in computer science, AI, machine learning, or a related field.
Have 3+ years of experience in the field of AI security and privacy research for deep learning models, especially in areas like membership inference, privacy-preserving ML, adversarial attacks.
Have an in-depth understanding of deep learning research and/or strong engineering skills, particularly proficient in programming languages such as Python and machine learning frameworks like PyTorch (preferred) or TensorFlow.
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status.
We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.
OpenAI Global Applicant Privacy Policy
At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
#



  • San Francisco, United States Snorkel AI, Inc. Full time

    We are looking for a Director of Engineering to lead our AI Platform team. Our AI Platform team builds innovative software systems to power the Snorkel Flow platform. This includes services to train and serve generative AI and machine learning models using novel data-centric techniques, libraries to support AI workflows for a variety of data modalities and...

  • AI Research Engineer

    2 weeks ago


    San Francisco, United States Cadre Full time

    Sr. AI Research EngineerExperience as a senior contributor at a high performing company Past work with large-scale ML systems, GPUs, kubernetes, pytorch Generative AI, diffusion, transformers expertise is a plus, especially in audio and music Aptitude for taking research advancements and turning them into real product solutions Knowledge of technological...

  • AI Research Engineer

    10 hours ago


    San Francisco, United States Connectly Full time

    At Connectly we are building revolutionary conversational commerce experiences. Unlike traditional shopping where you have to download an app, or sign up on a website, we allow customers to engage and transact directly within the thread. By choosing Connectly you will join a VC-backed series A startup on a growth trajectory, work with our world-class team,...

  • AI Engineer

    2 weeks ago


    San Francisco, United States Cynch AI Full time

    Come Revolutionize Accounting with AI   We're a seed-stage AI startup led by a founding team of AI startup veterans on a mission to revolutionize the accounting industry. We're seeking an exceptional AI Engineer to help turn our vision into reality. We are combining reasoning, machine learning, and generative AI to augment and democratize the expertise...

  • AI Engineer

    3 weeks ago


    San Francisco, United States Cynch AI Full time

    Come Revolutionize Accounting with AI  We're a seed-stage AI startup led by a founding team of AI startup veterans on a mission to revolutionize the accounting industry. We're seeking an exceptional AI Engineer to help turn our vision into reality. We are combining reasoning, machine learning, and generative AI to augment and democratize the expertise...

  • AI Engineer

    3 weeks ago


    San Francisco, United States Cynch AI Full time

    Job DescriptionJob DescriptionCome Revolutionize Accounting with AI We're a seed-stage AI startup led by a founding team of AI startup veterans on a mission to revolutionize the accounting industry. We're seeking an exceptional AI Engineer to help turn our vision into reality. We are combining reasoning, machine learning, and generative AI to...


  • San Francisco, CA, United States OpenAI Full time

    About the TeamSecurity is at the foundation of OpenAI’s mission to ensure that artificial general intelligence benefits all of humanity.  The Security team protects OpenAI’s technology, people, and products. We are technical in what we build but are operational in how we do our work, and are committed to supporting all products and research at OpenAI....


  • San Francisco, California, United States Cognizant Technology Solutions Full time

    Cognizant AI LabsCognizant works with an incredible diversity of organizations across the globe, using AI to improve decision-making, robustness, forecasting, and growth at every level of operation. Within Cognizant, Cognizant AI Labs serves as the center of excellence for pioneering AI research. The team works to develop novel approaches to solve both...

  • AI Research Scientist

    3 weeks ago


    San Francisco, California, United States Cognizant Technology Solutions Full time

    Cognizant AI LabsCognizant works with an incredible diversity of organizations across the globe, using AI to improve decision-making, robustness, forecasting, and growth at every level of operation. Within Cognizant, Cognizant AI Labs serves as the center of excellence for pioneering AI research. The team works to develop novel approaches to solve both...

  • AI Research Scientist

    4 weeks ago


    San Francisco, California, United States Cognizant Technology Solutions Full time

    Cognizant AI LabsCognizant works with an incredible diversity of organizations across the globe, using AI to improve decision-making, robustness, forecasting, and growth at every level of operation. Within Cognizant, Cognizant AI Labs serves as the center of excellence for pioneering AI research. The team works to develop novel approaches to solve both...


  • San Francisco, CA, United States OpenAI Full time

    About the TeamSecurity is at the foundation of OpenAI’s mission to ensure that artificial general intelligence benefits all of humanity.  The Security team protects OpenAI’s technology, people, and products. We are technical in what we build but are operational in how we do our work, and are committed to supporting all products and research at OpenAI....


  • San Francisco, United States essential AI Full time

    Job DescriptionJob DescriptionEssential AI’s mission is to deepen the partnership between humans and computers, unlocking collaborative capabilities that far exceed what could be achieved today. We believe that building delightful end-user experiences requires innovating across the stack - from the UX all the way down to models that achieve the best user...


  • San Francisco, United States Chima Inc Full time

    Chima is seeking highly skilled Engineers to join our team. As an AI Application Engineer, you will be responsible for designing, developing, and deploying cutting-edge AI models to solve enteprises' biggest problems. Role and responsibilities: Design and develop advanced generative models that drive specific business applications. Take ownership of certain...


  • San Francisco, CA, United States OpenAI Full time

    About the TeamSecurity is at the foundation of OpenAI’s mission to ensure that artificial general intelligence benefits all of humanity.  The Security team protects OpenAI’s technology, people, and products. We are technical in what we build but are operational in how we do our work, and are committed to supporting all products and research at OpenAI....


  • San Francisco, California, United States DeepNight Full time

    DeepNight is a seed-stage startup that leverages the latest advancements in AI to push the boundaries in computational imaging at the edge.We are seeking a talented Applied AI Research Scientist specializing in computational imaging to join our team. You will be responsible for conducting innovative research and developing advanced algorithms at the...

  • Compiler Engineer

    3 days ago


    San Francisco, United States Untether AI Full time

    ***Please note: While our engineering HQ is in Toronto, this is a remote opportunity and we welcome applicants from anywhere in North America.*** Untether AI is building the world’s highest performance pure-digital AI inference startup. We’re a rapidly growing Toronto-based startup, with employees across Canada and the US, building next generation...

  • AI Engineer

    3 weeks ago


    San Francisco, California, United States Cynch AI Full time

    Come Revolutionize Accounting with AI   We're a seed-stage AI startup led by a founding team of AI startup veterans on a mission to revolutionize the accounting industry. We're seeking an exceptional AI Engineer to help turn our vision into reality. We are combining reasoning, machine learning, and generative AI to augment and democratize the...

  • AI/ML Research

    1 month ago


    San Francisco, California, United States HashedTokens Full time

    This is for somebody who like working on a AI/ML Research and build tools for the open source community. There is a potential to publish a research paper as part of this work. Good understanding of AI/ML concepts Ability to use ML/AI frameworks like tensorflow, pytorch, ivy, keras, etcExpertise in building Models from scratch and able to read / implement...


  • San Francisco, CA, United States Adept AI Labs Full time

    Adept is working to advance a people-centric approach to AI that optimizes for what’s actually most useful for people and their work. You can see this approach in the technology we’re building: models that are trained to use software and take actions just as a person would.We’ve recently raised a $350M Series B led by General Catalyst and Spark, on top...


  • San Francisco, United States Linum Full time

    We’re looking for a founding AI Engineer to join our team to support our machine learning research and model training efforts. You will work in the core loop of implementing research papers, building datasets, training, and productizing. While most of the work will focus on these areas, we are a small team – and you will have to be flexible in picking up...