Software Engineer, Trust

23 hours ago


San Francisco CA United States Anthropic Limited Full time

About the role:

We are looking for software engineers to help build safety and oversight mechanisms for our AI systems. As a trust and safety software engineer, you will work to monitor models, prevent misuse, and ensure user well-being. This role will focus on building systems to detect unwanted model behaviors and prevent disallowed use of models. You will apply your technical skills to uphold our principles of safety, transparency, and oversight while enforcing our terms of service and acceptable use policies.

Responsibilities:
  • Develop monitoring systems to detect unwanted behaviors from our API partners and potentially take automated enforcement actions; surface these in internal dashboards to analysts for manual review
  • Build abuse detection mechanisms and infrastructure
  • Surface abuse patterns to our research teams to harden models at the training stage
  • Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale
  • Analyze user reports of inappropriate content or accounts
You may be a good fit if you:
  • Bachelor’s degree in Computer Science, Software Engineering or comparable experience
  • 3-10+ years of experience in a software engineering position, preferably with a focus on integrity, spam, fraud, or abuse detection.
  • Proficiency in SQL, Python, and data analysis tools.
  • Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders
Strong candidates may also:
  • Have experience building trust and safety mechanisms for AI/ML systems, such as fraud detection models or security monitoring tools or the infrastructure to support these systems at scale
  • Have experience with machine learning frameworks like Scikit-Learn, Tensorflow, or Pytorch, and experience building machine learning models
  • Have experience with prompt engineering, jailbreak attacks, and other adversarial inputs
  • Have worked closely with operational teams to build custom internal tooling

Deadline to apply: None. Applications will be reviewed on a rolling basis.

#J-18808-Ljbffr

  • San Francisco, CA, United States Trust A-tech Full time

    About Anthropic Anthropic is an AI safety and research company that’s working to build reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our customers and for society as a whole. Our interdisciplinary team has experience across ML, physics, policy, business and product. Responsibilities: Develop monitoring systems...


  • San Francisco, United States Trust A-tech Full time

    About Anthropic Anthropic is an AI safety and research company that’s working to build reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our customers and for society as a whole. Our interdisciplinary team has experience across ML, physics, policy, business and product. Responsibilities: Develop monitoring systems...


  • San Francisco, CA, United States Trust A-tech Full time

    TBD’s Risk and Trust team is on the mission to build world-class risk and trust management services to enable a truly open and decentralized financial ecosystem. We are looking for a skilled Machine Learning Engineer to help create and maintain our model development infrastructure. The ideal candidate will have a strong background in machine learning,...


  • San Francisco, California, United States Tbwa ChiatDay Inc Full time

    We are seeking a highly skilled Software Engineer to join our team at Checkr Trust. As a leader in the field, you will play a pivotal role in shaping the future of our company.About UsCheckr Trust is a pioneering force in the industry, dedicated to building safer communities through innovative solutions. With a strong focus on risk signals and user insights,...

  • Software Engineer

    2 days ago


    Los Angeles, CA, United States Software Resources Full time

    We are looking for Software Engineer for our client located in West Los Angeles/Century City area.This position is mostly REMOTE but you will be required to come into the West Los Angeles office 1 to 4 times a month. We could consider a completely remote candidate in another state if they meet our requirements. Duration : 6 to 12 months with the potential to...


  • San Jose, CA, United States Innominds Software Pvt. Ltd. Full time

    Engage in requirements gathering and design discussions for product development. Collaborate with stakeholders to define test objectives, assess testing scope, and formulate functional and non-functional test strategies, plans, and artifacts. Develop comprehensive test cases for new product requirements. Create and manage test epics, user stories, tickets,...


  • San Francisco, CA, United States hackerone Full time

    HackerOne is the global leader in human-powered security, harnessing the creativity of the world's largest community of security researchers with cutting-edge AI to protect your digital assets. The HackerOne Platform combines the expertise of our elite community and the most up-to-date vulnerability database to pinpoint critical security flaws across your...


  • San Francisco, California, United States Cloudflare, Inc. Full time

    About UsAt Cloudflare, we are on a mission to help build a better Internet. Our fast, reliable, and secure platforms have become critical infrastructure for our customers, from individual bloggers to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of...

  • Software Engineer

    7 days ago


    San Francisco, United States Sara Software Systems Full time

    bem Share this job San Francisco, CA, USA Full Time Role Highlights Computer Science Integrations Software Systems LLMs AI Tools, Libraries and Frameworks Description The company leverages LLMs to create a new interface between humans and systems to build robust and scalable software solutions. The role involves working directly with founders to...

  • Trust Administrator

    1 month ago


    Wilmington, DE, United States Commonwealth Trust Company Full time

    Administer trusts in accordance with terms created in trust, will, or court order. Coordinate with other departments to ensure the accurate flow of information. Provide oversight for compliance, both internally and externally.BACKGROUND & EXPERIENCE:• BA/BS from an accredited 4-year college or university• Additional certification (Paralegal certificate...


  • San Francisco, CA, United States Mixpanel, Inc. Full time

    We are actively recruiting for multiple Software Engineers across different levels for our org! About the Team The Monetization team is responsible for making obvious to users why they should buy Mixpanel. This team owns growth of our self-service revenue, and partners on improvement to sales-led process. We aim to make it simple and delightful to...


  • San Francisco, CA, United States salesforce.com, inc. Full time

    Engineering Excellence Director, Software Engineering To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category: Software Engineering About Salesforce: We're Salesforce, the Customer Company, inspiring the future of business with AI+ Data + CRM. Leading...


  • San Francisco, CA, United States Ganymede Full time

    Ganymede is building AWS for the sciences, with a mission of improving the world through better healthcare outcomes. We believe that the highest leverage approach to speed up science is through better software and data connectivity. As a Scientific Software Engineer (SSE), you'll work directly with scientists and engineers to understand their most important...

  • Software Engineer

    1 day ago


    San Francisco, CA, United States Itump Full time

    itump is seeking a talented Software Engineer to join our dynamic team and contribute to the development of high-quality software solutions. As a Software Engineer at itump, you will play a key role in designing, implementing, and maintaining software applications that meet the needs of our clients and exceed industry standards. Key Responsibilities: ...

  • Software Engineer

    2 weeks ago


    San Francisco, United States Informal Systems Inc. Full time

    Software Engineer, EVM SVM Infrastructure - Informal StakingFull TimeRemoteInformal SystemsInformal Systems was founded with a mission to foster trust in software and monetary systems. Our team spent years building state-of-the-art distributed systems and grappling with complexities and limitations. Despite securing billions of dollars in real-world value,...

  • Software Engineer

    3 weeks ago


    San Francisco, United States Informal Systems Inc. Full time

    Software Engineer, EVM SVM Infrastructure - Informal StakingFull TimeRemoteInformal SystemsInformal Systems was founded with a mission to foster trust in software and monetary systems. Our team spent years building state-of-the-art distributed systems and grappling with complexities and limitations. Despite securing billions of dollars in real-world value,...


  • Sunnyvale, CA, United States Software Aspekte Full time

    Fortinet is looking for a Senior Software Dev QA Engineer to assist CloudServices Team to Maintain and develop automated test scripts to validate all aspect of products based on variety of test cases. Provide end-to-end quality assurance solutions for cloud security products to the development, marketing, sales team etc. Bring cutting-edge cloud security...


  • San Francisco, CA, United States Nceinfotech Full time

    At TechCorp, we're more than just a technology company; we're pioneers committed to crafting groundbreaking software solutions that revolutionize industries and enhance lives. Our enthusiasm for technology fuels our drive to leverage software as a catalyst for positive change. Job Overview Are you a passionate software engineer eager to make an impact? Join...


  • Omaha, NE, United States Election Systems & Software Full time

    We support democracy.Our vision at Election Systems & Software (ES&S) is simple and unwavering — we provide products and services of exceptional quality and value to maintain voter confidence and enhance the voting experience. We accomplish this through continuous investments in research and development, resulting in regular product updates and security...


  • Omaha, NE, United States Election Systems & Software Full time

    We support democracy.The information below covers the role requirements, expected candidate experience, and accompanying qualifications.Our vision at Election Systems & Software (ES&S) is simple and unwavering — we provide products and services of exceptional quality and value to maintain voter confidence and enhance the voting experience. We accomplish...