The opportunity
As a Safeguards Enforcement Analyst focused on Conventional Weapons, your work spans detecting and mitigating attempts to misuse Anthropic's AI systems to facilitate real-world harm, specifically utilizing conventional weapons and dangerous technology. You will be responsible…
What you'll do
Design and architect automated enforcement systems and review workflows that: scale effectively while maintaining high accuracy
Develop and maintain evals that measure model performance on these policy: areas, surface regressions, and inform policy and model improvements
Partner with Engineering and Data Science to optimize detection and automated: enforcement systems for potential policy violations
Review flagged content to drive enforcement decisions and surface policy: gaps, with particular attention to novel or technically sophisticated misuse attempts + emerging tactics
Support the Safeguards policy design team by providing structured feedback on: policy gaps and enforcement ambiguities based on real enforcement scenarios
Develop and maintain enforcement guidelines and reviewer documentation that: enable accurate, consistent enforcement across a wide range of content
What they're looking for
- Subject matter expertise in conventional weapons and dangerous technology,: autonomous systems, or critical infrastructure protection
- Familiarity with relevant legal and regulatory frameworks governing dangerous: technology, conventional weapons, and critical infrastructure
- Experience developing evals or red-teaming AI systems, particularly for: harmful content or policy enforcement use cases
- Experience with threat actor profiling and threat intelligence frameworks (e.g., MITRE ATT&CK)
- Experience tracking threat actors, extremist networks, or misuse patterns: across surface, deep, and dark web environments
- Experience with large language models and an understanding of how AI: technology could provide meaningful uplift toward serious harm
- Proficiency in Python for data analysis and workflow automation
- Background in law enforcement, national security, defense, counterterrorism,: or a relevant regulatory environment
