Safeguards Enforcement Analyst, Safety Evaluations

About the role

Safeguards Enforcement Analyst, Safety Evaluations
At Anthropic, we aim to create reliable, interpretable, and steerable AI systems to ensure they are safe and beneficial. The Safeguards team enforces our policies, protects users, and ensures the platform is not misused. As a Safeguards Enforcement Analyst focusing on Safety Evaluations, you'll ensure our models meet safety and policy standards.

Responsibilities

• Support model launch readiness by running evaluations, monitoring and interpreting results, and surfacing regressions or unexpected behavior changes to relevant stakeholders
• Partner closely with policy and domain experts throughout the evaluation lifecycle — from identifying risks and scoping the right evaluation approach, to coordinating creation of new evals and ensuring existing ones remain current with evolving policies, threat vectors, and model capabilities
• Work with cross-functional stakeholders to help manage evaluation outcomes, including interpreting results and driving mitigations where needed
• Think strategically about eval quality to build processes and eval paradigms that keep evaluations unsaturated, high-signal, and insightful as models improve
• Build out processes and frameworks for creating product-specific evaluations as Anthropic's product surface area expands
• Help design and scope tooling improvements that accommodate evolving eval needs and expand self-serve eval creation and iteration for non-technical users
• Write and maintain rigorous documentation for evaluation creation, execution, and interpretation as the team builds out eval tooling and processes

Qualifications

• Experience in trust and safety, content operations, policy enforcement, or a related operational role at a technology company
• Comfortable navigating ambiguity and managing multiple concurrent workstreams across different domain areas
• Strong program management instincts, creating structure around complex, multi-stakeholder efforts by tracking timelines, dependencies, and deliverables
• Technical toolkit proficiency, including adoption of internal tools and AI-assisted workflows
• Ability to communicate clearly and concisely, both in writing and cross-functionally