Research Engineer, Domain Scaling

About the role

The Domain Scaling team aims to make Claude world-class at real-world knowledge work in domains like finance, healthcare, and legal. This role combines executing on applied research and data sourcing to improve our models.

Responsibilities

• Own the data strategy for knowledge work verticals end-to-end, from task sourcing through RL training
• Manage technical relationships with external data vendors, including evaluation of data quality and reward design
• Collaborate with domain experts to design data pipelines and evaluations
• Explore novel ways of creating RL environments for high value tasks
• Develop and improve QA frameworks to catch reward hacking and ensure env quality
• Run generalization experiments to measure how data strategy changes improve model capabilities
• Partner with other RL research teams and product teams to translate capability goals into training environments and evaluations

Requirements

• Experience with fine-tuning large language models for specific domains or real-world use cases
• Experience with reinforcement learning, reward design, or training data curation for LLMs
• Comfortable managing technical vendor relationships and iterating quickly on feedback
• Strong cross-functional collaboration skills
• Passion for making AI more useful and accessible across different industries
• Excitement for a role that includes a combination of applied research and hands-on data work

Qualifications

• Strong communication skills
• Experience training production ML systems
• Experience designing evals or benchmarks for LLMs
• Domain expertise in a vertical where we would like to make our models more useful
• Experience working with external vendors or technical partners

Skills

• Experience with large language models
• Reinforcement learning and reward design
• Data curation for LLMs
• Data strategy and management
• Collaboration and partnership management
• Generalization and experimentation
• ML system training

Benefits

Annual compensation range: $350,000—$850,000 USD

Pay

Annual Salary: $350,000—$850,000 USD

Schedule

Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Visa Sponsorship

We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

How We're Different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. We value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time.

Guidance on Candidates' AI Usage

Learn about our policy for using AI in our application process.