Software Engineer, Trust

2 weeks ago


San Francisco, California, United States Trust A-tech Full time

About Anthropic

Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our customers and for society as a whole. Our interdisciplinary team has experience across ML, physics, policy, business and product.

Responsibilities:

  • Develop monitoring systems to detect unwanted behaviors from our API partners and potentially take automated enforcement actions; surface these in internal dashboards to analysts for manual review
  • Build abuse detection mechanisms
  • Surface abuse patterns to our research teams to harden models at the training stage
  • Build multi-layered defenses for real-time improvement of safety mechanisms
  • Analyze user reports of inappropriate content or accounts and build machine learning models to detect similar instances proactively

You may be a good fit if you:

  • Bachelor's degree in Computer Science, Software Engineering or comparable experience
  • 2-3 years of experience in a data analyst, data scientist, or software engineering position, preferably with a focus on security, spam, fraud, or abuse detection.
  • Proficiency in SQL, Python, and data analysis/data mining tools.
  • Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders

Strong candidates may also:

  • Have experience building trust and safety mechanisms for AI/ML systems, such as fraud detection models or security monitoring tools
  • Have experience with machine learning frameworks like Scikit-Learn, Tensorflow, or Pytorch
  • Have experience with prompt engineering, jailbreak attacks, and other adversarial inputs
  • Have worked closely with operational teams to build custom internal tooling
  • Have experience with full stack engineering to build internal tooling

Annual Salary

  • The expected salary range for this position is $300k - $450k USD.

Hybrid policy & US visa sponsorship: Currently, we expect all staff to be in our office at least 25% of the time. We do sponsor visas However, we aren't able to successfully sponsor visas for every role and every candidate; operations roles are especially difficult to support. But if we make you an offer, we will make every effort to get you into the United States, and we retain an immigration lawyer to help with this.

We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.

Compensation and Benefits*

Anthropic's compensation package consists of three elements: salary, equity, and benefits. We are committed to pay fairness and aim for these three elements collectively to be highly competitive with market rates.

Equity - On top of this position's salary (listed above), equity will be a major component of the total compensation. We aim to offer higher-than-average equity compensation for a company of our size, and communicate equity amounts at the time of offer issuance.

US Benefits - The following benefits are for our US-based employees:

  • Optional equity donation matching at a 3:1 ratio, up to 50% of your equity grant.
  • Comprehensive health, dental, and vision insurance for you and all your dependents.
  • 401(k) plan with 4% matching.
  • 21 weeks of paid parental leave.
  • Unlimited PTO – most staff take between 4-6 weeks each year, sometimes more
  • Stipends for education, home office improvements, commuting, and wellness.
  • Fertility benefits via Carrot.
  • Daily lunches and snacks in our office.
  • Relocation support for those moving to the Bay Area.

UK Benefits - The following benefits are for our UK-based employees:

  • Optional equity donation matching at a 3:1 ratio, up to 50% of your equity grant.
  • Private health, dental, and vision insurance for you and your dependents.
  • Pension contribution (matching 4% of your salary).
  • 21 weeks of paid parental leave.
  • Unlimited PTO – most staff take between 4-6 weeks each year, sometimes more
  • Health cash plan.
  • Life insurance and income protection.
  • Daily lunches and snacks in our office.

#J-18808-Ljbffr

  • San Francisco, California, United States Advent Software, Inc. Full time

    Associate Software Engineer page is loaded Associate Software Engineer Apply locations San Francisco, CA time type Full time posted on Posted 2 Days Ago job requisition id R16507 SS&C is a global provider of investment and financial services and software for the financial services and healthcare industries. Named to Fortune 1000 list as top U.S. company...


  • San Francisco, California, United States Block Full time

    Company DescriptionIt all started with an idea at Block in 2013. Initially built to take the pain out of peer-to-peer payments, Cash App has gone from a simple product with a single purpose to a dynamic ecosystem, developing unique financial products, including Afterpay/Clearpay, to provide a better way to send, spend, invest, borrow and save to our 47...


  • San Francisco, California, United States eGain Corporation Full time

    Hundreds of global brands trust eGain to automate customer engagement and empower employees in a digital-first world. Powered by knowledge and AI, our solution is top-rated by Gartner and Forrester.We dream big and sweat details. We are diverse, optimistic, and tenacious. We take pride in what we do but we don't take ourselves too seriously. If work is fun...

  • Software Engineer

    2 weeks ago


    San Francisco, California, United States Check Technologies Full time

    Check is leading a revolution in the payroll industry. Payroll is the backbone of the US economy, and yet it has not undergone significant innovation in decades. We invented the embedded payroll space to change that ( see: Check: Solving the $150 Billion Payroll Problem , Bank On It; Episode 438 ), both for the business owners who spend countless hours per...

  • Sr Software Engineer

    2 weeks ago


    San Francisco, California, United States Saxon Global Full time

    Job Description:Position: Senior Software Engineer (Backend focus) Want to work with a team that values trust, dignity, commitment, and doing the right thing? Look no further than Delta Dental! At Delta Dental, we hire not only for today but also for the future, aiming to inspire and motivate our employees towards their full potential. We are seeking a...


  • San Francisco, California, United States Coalesce Automation Full time

    The engineering team maintains the Coalesce Front-end application, our back-end, the Coalesce CLI tool (coa), our shared modules and the testing codebase. Given the nature of our application, an interest or understanding of Computer Science fundamentals, writing robust code and the ability to find simplicity in complex problems is key.Our stack is Typescript...


  • San Francisco, California, United States Coalesce Automation Full time

    The engineering team at Coalesce is responsible for maintaining the Front-end application, back-end, CLI tool, shared modules, and testing codebase. If you have a keen interest in Computer Science fundamentals, writing high-quality code, and simplifying complex issues, this role is for you. About the Company:Coalesce, founded in 2020, is on a mission to...


  • San Francisco, California, United States Palo Alto Networks Full time

    Principal Software Engineer - Join Our Cybersecurity Team at Palo Alto NetworksCompany DescriptionOur MissionAt Palo Alto Networks, our mission is to be the trusted cybersecurity partner that safeguards our digital way of life. We envision a world where each day is safer and more secure, driven by innovation and disruption in the cybersecurity landscape.Our...

  • Software Engineer

    2 weeks ago


    San Francisco, California, United States Nextdoor Full time

    #TeamNextdoorNextdoor is the neighborhood hub for trusted connections and the exchange of helpful information, goods, and services.Building connections in the real world is a universal human need. That truth, and the reality that neighborhoods are one of the most important and useful communities in our lives have been guiding principles for Nextdoor. Today,...

  • Software Engineer

    2 weeks ago


    San Francisco, California, United States Moody's Full time

    About the Job:At Moody's, our mission is to gather the brightest talents to transform current challenges into tomorrow's possibilities. We strive to foster an inclusive environment where all individuals are encouraged to express their true selves, share ideas, think outside the box, and engage with each other and customers in a meaningful manner. If you're...

  • Software Engineer

    4 weeks ago


    San Francisco, California, United States Nextdoor Full time

    #TeamNextdoorNextdoor is the neighborhood hub for trusted connections and the exchange of helpful information, goods, and services.Building connections in the real world is a universal human need. That truth, and the reality that neighborhoods are one of the most important and useful communities in our lives have been guiding principles for Nextdoor. Today,...


  • San Mateo, California, United States Coupa Software Full time

    Coupa Company and Senior Software Engineering in Test role: Coupa is a company focused on helping businesses operate more efficiently and grow faster through their innovative AI-driven platform that optimizes sourcing, purchasing, supply chains, and financial management for over 3,000 global organizations. As a Senior Software Engineering in Test at Coupa,...


  • San Francisco, California, United States Benchling Full time

    Biotechnology is rewriting life as we know it, from the medicines we take, to the crops we grow, the materials we wear, and the household goods that we rely on every day. But moving at the new speed of science requires better technology.Benchling's mission is to unlock the power of biotechnology. The world's most innovative biotech companies use Benchling's...


  • San Francisco, California, United States Block Full time

    Company DescriptionIt all started with an idea at Block in 2013. Initially built to take the pain out of peer-to-peer payments, Cash App has gone from a simple product with a single purpose to a dynamic ecosystem, developing unique financial products, including Afterpay/Clearpay, to provide a better way to send, spend, invest, borrow and save to our 47...


  • San Francisco, California, United States Block Inc Full time

    Company Description It all started with an idea at Block in 2013. Initially built to take the pain out of peer-to-peer payments, Cash App has gone from a simple product with a single purpose to a dynamic ecosystem, developing unique financial products, including Afterpay/Clearpay, to provide a better way to send, spend, invest, borrow and save to our 47...


  • San Francisco, California, United States ZoomInfo Full time

    At ZoomInfo, we encourage creativity, value innovation, demand teamwork, expect accountability and cherish results. We value your take charge, take initiative, get stuff done attitude and will help you unlock your growth potential. One great choice can change everything. Thrive with us at ZoomInfo. As a Senior Software Engineer at ZoomInfo, you will report...


  • San Francisco, California, United States Block Full time

    Company DescriptionIt all started with an idea at Block in 2013. Initially built to take the pain out of peer-to-peer payments, Cash App has gone from a simple product with a single purpose to a dynamic ecosystem, developing unique financial products, including Afterpay/Clearpay, to provide a better way to send, spend, invest, borrow and save to our 47...

  • Software Engineer

    2 weeks ago


    San Francisco, California, United States Equilibrium Energy Full time

    About our CompanyEquilibrium Energy is a well-funded, Series B clean energy startup backed by some of the most prominent institutional investors in climate. We are building a digital native power company operating at the intersection of grid variability, market volatility, economic optimization, commercial structuring, and risk management, across the...

  • Software Engineer

    4 weeks ago


    San Francisco, California, United States Equilibrium Energy Full time

    About our CompanyEquilibrium Energy is a well-funded, Series B clean energy startup backed by some of the most prominent institutional investors in climate. We are building a digital native power company operating at the intersection of grid variability, market volatility, economic optimization, commercial structuring, and risk management, across the...


  • San Francisco, California, United States JPMorganChase Full time

    Job Description We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at JPMorgan Chase within the Corporate & Investment Bank, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and...