Research Engineer, Trust

2 weeks ago


San Francisco, United States Lionheart Ventures Full time
About the role:

We are looking for Research engineers to help design and build safety and oversight algorithms for our AI models and products. As a Trust and Safety Research Engineer, you will work to design and train ML models based on research progress, which detect harmful user/model behaviors and help ensure society well-being. You will apply your research skills to uphold our principles of safety, transparency, and oversight while enforcing our terms of service and acceptable use policies.

What you will be working on:
  • Design, iterate and build ML models to detect unwanted or anomalous behaviors from both users and LLM models
  • Work with T&S ML engineers to review and iterate experiment ideations. Co-author the experiment success criteria and production deployment roadmaps.
  • Partner with T&S Policy and Enforcement cross-functionals to understand emerging and sustained abuse patterns from user prompts and behaviors. Include the insights into T&S research datasets.
  • Surface abuse patterns to sibling research teams in the company. Collaborate together to harden Anthropic’s LLMs at the pre/post training stages
  • Stay current with state-of-the-art research in AI and machine learning, and propose ways to apply these advancements to T&S systems
You may be a good fit if you:
  • Have 4+ years of experience in a research engineering or an applied research scientist position, preferably with a focus on trust and safety.
  • Have significant Python programming experience and machine learning experience
  • Have proficiency in building trustworthy and safe AI technology
  • Have strong communication skills and ability to explain complex technical concepts to non-technical stakeholders.
  • Care about the societal impacts and long-term implications of your work and are results oriented.
Strong candidates may also have experience with:
  • Have experience fine-tuning large language models with supervised learning or reinforcement learning
  • Have experience with machine learning frameworks like Scikit-Learn, Tensorflow, or Pytorch
  • Have experience authoring research papers in machine learning, NLP, or AI alignment or similar industry experience
  • Have developed evaluations for language models
#J-18808-Ljbffr

  • San Francisco, United States DALLAS VA RESEARCH CORPORATION Full time

    As a Research Engineer on the Reinforcement Learning Fundamentals team at Anthropic, the role involves advancing the capabilities and safety of large language models through fundamental AI research in reinforcement learning. The position involves developing reinforcement learning techniques, creating environments for models, and designing experiments to...


  • San Francisco, California, United States DALLAS VA RESEARCH CORPORATION Full time

    About the RoleWe are seeking a highly skilled Research Engineer to join our team at Dallas VA Research Corporation. As a Research Engineer, you will play a key role in advancing the state-of-the-art in large language models.Key ResponsibilitiesDesign and Develop Advanced Language Models: Design methods, tools, and infrastructure to push forward the state of...


  • San Francisco, United States DALLAS VA RESEARCH CORPORATION Full time

    Meta is seeking a Research Engineer to join our Large Language Model (LLM) Research team. We conduct focused research and engineering to build state-of-the-art LLMs, which we often open-source, like our team’s recent Llama 2. We are looking for strong engineers who have a background in generative AI and NLP, with experience in areas like language model...

  • RESEARCH ENGINEER

    3 days ago


    San Antonio, United States Southwest Research Institute Full time

    Who We Are:The Computational Lifing Software Section is a highly collaborative, multidisciplinary team dedicated to advancing aviation safety through the development and distribution of cutting-edge fracture mechanics-based software solutions. Our state-of-the-art software is trusted by major institutions globally to ensure the reliability and safety of...

  • RESEARCH ENGINEER

    3 days ago


    San Antonio, United States Southwest Research Institute Full time

    Who We Are:The Computational Lifing Software Section is a highly collaborative, multidisciplinary team dedicated to advancing aviation safety through the development and distribution of cutting-edge fracture mechanics-based software solutions. Our state-of-the-art software is trusted by major institutions globally to ensure the reliability and safety of...


  • San Antonio, Texas, United States Southwest Research Institute Full time

    Position Overview: As a Thermofluids Research Engineer, you will engage in both experimental and computational research to address intricate thermofluids challenges.About Us: At Southwest Research Institute, we are dedicated to advancing clean energy solutions and environmental protection. Our workplace thrives on mutual respect and collaboration, fostering...


  • San Francisco, California, United States OpenAI Full time

    Job Title: Software Developer - Trust and Safety Company: OpenAI Join OpenAI's Applied AI team, where our mission is to responsibly implement cutting-edge AI technologies. We are seeking a skilled software developer to enhance our trust and safety initiatives. About the Position: As a software developer on our team, you will be instrumental in designing and...


  • San Francisco, California, United States Trust A-tech Full time

    We are seeking a **Program Manager** to spearhead initiatives primarily aimed at synchronizing technical strategies and facilitating execution between our internal engineering divisions and key cloud partners.Our AI models are available on both our proprietary platforms and API, as well as on major cloud services.It is essential to ensure effective...


  • San Antonio, Texas, United States Southwest Research Institute Full time

    About the RoleThe Intelligent Systems Division at Southwest Research Institute is seeking a highly skilled Research Robotics Engineer to contribute to the development of advanced robotics capabilities and solutions for commercial and government clients.Key ResponsibilitiesDesign, build, and implement robotic and automation solutions utilizing mechanical,...

  • Research Engineer

    2 days ago


    San Antonio, Texas, United States Southwest Research Institute Full time

    **Job Summary**Southwest Research Institute is seeking a highly skilled Research Engineer to join our RF Engineering Section. As a member of our team, you will be responsible for designing and developing Electronic Warfare systems, including RF/antenna design, system/hardware design, and communications signal processing engineering.**Key...


  • San Antonio, Texas, United States Southwest Research Institute Full time

    Job SummarySouthwest Research Institute is seeking a highly skilled Research and Development Engineer to join our team. As a key member of our Strategic Aerospace Department, you will be responsible for designing, developing, testing, and supporting complex embedded avionics systems for new, sustainment, and modernization programs.Key ResponsibilitiesDesign...

  • Research Engineer

    2 days ago


    San Antonio, Texas, United States Southwest Research Institute Full time

    Job DescriptionJob Summary:We are seeking a highly skilled Research Engineer to join our Propulsion & Energy Machinery Section at Southwest Research Institute. As a Research Engineer, you will be responsible for conducting research and development in the fields of air-breathing and liquid propulsion.Key Responsibilities:Work in a team to support the...

  • Research Engineer

    2 days ago


    San Antonio, Texas, United States Southwest Research Institute Full time

    Job DescriptionJob Summary:We are seeking a highly skilled Research Engineer to join our Propulsion & Energy Machinery Section at Southwest Research Institute. As a Research Engineer, you will be responsible for conducting research and development in the fields of air-breathing and liquid propulsion.Key Responsibilities:Work in a team to support the...

  • Research Engineer

    2 days ago


    San Antonio, Texas, United States Southwest Research Institute Full time

    Job SummaryWe are seeking a highly skilled Research Engineer - Chemical/Process Engineer to join our team at Southwest Research Institute. The successful candidate will be responsible for supporting operations for pilot plants for process development, expanding our technical portfolio of offerings to clients, and leading operations training, procurement, and...


  • San Antonio, Texas, United States Southwest Research Institute Full time

    Position Overview:We are seeking a dedicated Research Software Engineer to join our innovative team at Southwest Research Institute. This role focuses on the development of sophisticated software solutions for various defense and intelligence applications, encompassing both terrestrial and maritime platforms.About Us:At Southwest Research Institute, we pride...


  • San Francisco, California, United States Notion Labs, Inc. Full time

    About Notion Labs, Inc.We're a leading software company on a mission to empower individuals, teams, and organizations to create tailored solutions for any problem or challenge. Our cutting-edge platform enables users to build, modify, and customize software to suit their needs.As a trusted partner to our customers, we prioritize the security and integrity of...


  • San Diego, California, United States SDSU Research Foundation Full time

    Job SummaryThe SDSU Research Foundation is seeking a highly motivated PhD researcher to join the Dynamic Systems and Intelligent Machines (DSIM) Lab at San Diego State University. This position is budgeted for $20.00 per hour and is non-negotiable.About the PositionWe are looking for a candidate with extensive experience in control and robotics, and a strong...

  • Research Engineer

    7 days ago


    San Antonio, Texas, United States Southwest Research Institute Full time

    About Our TeamThe Powertrain Engineering Engine Certification team at Southwest Research Institute supports various clean air initiatives that benefit mankind by providing engine development certification services for medium and heavy-duty engines for on-highway, nonroad, marine, and various other engine types.Key ObjectivesSupport global clean air...


  • San Antonio, Texas, United States Southwest Research Institute Full time

    About Our Team:At Southwest Research Institute, our Department of Space Instruments & Payloads is a multidisciplinary team of engineers, scientists, program managers, and technicians who design and develop instruments and avionics for a variety of space applications.Our space missions range from Lunar Lander applications to deep space exploration, requiring...


  • San Antonio, Texas, United States Southwest Research Institute Full time

    Position Overview:We are seeking a dedicated Research Engineer specializing in Particle Science & Technology. This role is pivotal in advancing our understanding of particle emissions from various sources, including engines, brakes, tires, and battery systems.About Us:At Southwest Research Institute, our Particle Science & Technology Section is committed to...