Research Engineer, Cybersecurity RL (Reinforcement Learning)

About the role

We're hiring for the Cybersecurity RL team within Horizons. As a Research Engineer, you'll help to safely advance the capabilities of our models in secure coding, vulnerability remediation, and other areas of defensive cybersecurity. This role blends research and engineering, requiring you to both develop novel approaches and realize them in code. Your work will include designing and implementing RL environments, conducting experiments and evaluations, delivering your work into production training runs, and collaborating with other researchers, engineers, and cybersecurity specialists across and outside Anthropic.

Responsibilities

• Design and implement RL environments for cybersecurity applications
• Conduct experiments and evaluations to assess model performance
• Collaborate with other researchers, engineers, and cybersecurity specialists
• Develop and refine novel approaches to training safe AI models in cybersecurity contexts

Requirements

• Experience in cybersecurity research
• Experience with machine learning
• Strong software engineering skills
• Ability to balance research exploration with engineering implementation
• Passion for AI's potential and commitment to developing safe and beneficial systems
• Professional experience in security engineering, fuzzing, detection and response, or other applied defensive work
• Experience participating in or building CTF competitions and cyber ranges
• Academic research experience in cybersecurity
• Familiarity with RL techniques and environments
• Familiarity with LLM training methodologies

Qualifications

• Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
• Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
• Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position

Benefits

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Lovely office space for collaboration

Pay

The annual compensation range for this role is $300,000—$405,000 USD.

Schedule

Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Visa Sponsorship

We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

How We're Different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills. The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.

Guidance on Candidates' AI Usage

Learn about our policy for using AI in our application process.