Safeguards Enforcement Analyst, Safety Evaluations

About the role

Safeguards Enforcement Analyst, Safety Evaluations
At Anthropic, we aim to create reliable, interpretable, and steerable AI systems to ensure they are safe and beneficial. The Safeguards team enforces our policies, protects users, and ensures our platform is not misused. As a Safeguards Enforcement Analyst focusing on Safety Evaluations, you'll play a crucial role in ensuring our models meet safety and policy standards.

Responsibilities

• Support model launch readiness by running evaluations, monitoring and interpreting results, and surfacing regressions or unexpected behavior changes to relevant stakeholders
• Partner closely with policy and domain experts throughout the evaluation lifecycle — from identifying risks and scoping the right evaluation approach, to coordinating creation of new evals and ensuring existing ones remain current with evolving policies, threat vectors, and model capabilities
• Work with cross-functional stakeholders to help manage evaluation outcomes, including interpreting results and driving mitigations where needed
• Think strategically about eval quality to build processes and eval paradigms that keep evaluations unsaturated, high-signal, and insightful as models improve
• Build out processes and frameworks for creating product-specific evaluations as Anthropic's product surface area expands
• Help design and scope tooling improvements that accommodate evolving eval needs and expand self-serve eval creation and iteration for non-technical users
• Write and maintain rigorous documentation for evaluation creation, execution, and interpretation as the team builds out eval tooling and processes

Qualifications

• Experience in trust and safety, content operations, policy enforcement, or a related operational role at a technology company
• Comfortable navigating ambiguity and managing multiple concurrent workstreams across different domain areas
• Ability to communicate clearly and concisely, both in writing and cross-functionally

Preferred Qualifications

• Experience operating under tight, high-stakes timelines
• Experience coordinating across engineering, policy, and product teams
• Experience building and maintaining SOPs, runbooks, and operational documentation
• Proficiency with data tools (SQL, dashboards, spreadsheets)
• Experience working with sensitive content areas

Compensation

The annual compensation range for this role is $230,000 - $270,000 USD.

Location

We currently expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.