Staff+ Software Engineer (Account Creation)

Join Anthropic, an AI safety and research company, as a Staff+ Software Engineer on the Safeguards team. In this role, you will build systems to monitor AI models, prevent misuse, and ensure user well-being. You will develop monitoring systems, build abuse detection mechanisms, and create multi-layered defenses for real-time safety improvements. Enjoy comprehensive benefits, a competitive salary, and the opportunity to work on impactful AI safety initiatives.

• Develop monitoring systems to detect unwanted behaviors from API partners and potentially take automated enforcement actions.
• Build abuse detection mechanisms and infrastructure, and surface abuse patterns to research teams to harden models.
• Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale.

• An ability to work across the stack
• Proficiency in Python and Typescript
• A Bachelor’s degree in Computer Science, Software Engineering or comparable experience
• Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders
• Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
• Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
• Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
• We encourage you to apply even if you do not believe you meet every single qualification
• 8+ years of experience in a software engineering position
• Have experience with integrity, spam, fraud, or abuse detection and mitigation
• Have experience building trust and safety detection mechanisms and intervention for AI/ML systems
• Have experience with prompt engineering, jailbreak attacks, and other adversarial inputs
• Have worked closely with operational teams to build custom internal tooling