Research Engineer, Domain Scaling

About the role

The Domain Scaling team aims to make Claude world-class at real-world knowledge work in domains like finance, healthcare, and legal. This role combines executing on applied research and data sourcing to improve our models.

Responsibilities

• Own the data strategy for knowledge work verticals end-to-end, from task sourcing through RL training
• Manage technical relationships with external data vendors, including evaluation of data quality and reward design
• Collaborate with domain experts to design data pipelines and evaluations
• Explore novel ways of creating RL environments for high value tasks
• Develop and improve QA frameworks to catch reward hacking and ensure env quality
• Run generalization experiments to measure how data strategy changes improve model capabilities
• Partner with other RL research teams and product teams to translate capability goals into training envs and evals

Requirements

• Experience with fine-tuning large language models for specific domains or real-world use cases
• Experience with reinforcement learning, reward design, or training data curation for LLMs
• Comfortable managing technical vendor relationships and iterating quickly on feedback
• Strong cross-functional collaboration skills
• Passion for making AI more useful and accessible across different industries
• Excitement about a role that includes a combination of applied research and hands-on data work

Qualifications

• Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
• Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
• Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position

Benefits

• Annual compensation range: $350,000—$850,000 USD
• Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
• Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

Pay

The annual compensation range for this role is listed below. For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

Schedule

We currently expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Skills

• Experience with fine-tuning large language models for specific domains or real-world use cases
• Experience with reinforcement learning, reward design, or training data curation for LLMs
• Experience managing technical vendor relationships and iterating quickly on feedback
• Strong cross-functional collaboration skills
• Passion for making AI more useful and accessible across different industries
• Passion for a role that includes a combination of applied research and hands-on data work

Benefits

• Competitive compensation
• Generous vacation and parental leave
• Flexible working hours
• A lovely office space for collaboration