Full-Stack Software Engineer, Reinforcement Learning

About the role

As a Full-Stack Software Engineer in RL, you'll build the platforms, tools, and interfaces that power environment creation, data collection, and training observability. The quality of Claude's next generation depends on the quality of the data we train it on — and the systems you build are what make that data possible.

Responsibilities

• Build and extend web platforms for RL environment creation, management, and quality review — including environment configuration, versioning, and validation workflows
• Develop vendor-facing interfaces and tooling that let external partners create, submit, and iterate on training environments with minimal friction
• Design and implement platforms for human data collection at scale, including labeling workflows, quality assurance systems, and feedback mechanisms that surface reward signal integrity issues early
• Create evaluation dashboards and observability UIs that give researchers real-time insight into environment quality, training run health, and reward hacking
• Develop backend services and APIs that connect environment authoring tools, data collection systems, and RL training infrastructure
• Develop and expand scalable code data generation pipelines, producing diverse programming tasks with robust reward signals across languages and difficulty levels
• Build and expand onboarding automation and documentation tooling so new vendors and internal users ramp up in hours, not weeks
• Partner closely with RL researchers, data operations, and vendor management to translate ambiguous requirements into well-scoped, well-designed products

Requirements

You don't need a background in ML research. What matters is that you can take an ambiguous, high-stakes problem and ship a polished, reliable product against it, fast. This team moves very quickly. Claude writes a lot of the code we commit, which means the bottleneck isn't typing — it's judgment, taste, and the ability to react to what researchers need next.

Qualifications

• Strong software engineering fundamentals and real full-stack range — you're comfortable owning a surface from database schema to frontend
• Proficient in Python and a modern web stack (React, TypeScript, or similar)
• A track record of shipping systems that solved a hard problem, not just shipped on time — e.g. you built the thing that made your team 10x faster, or the internal tool nobody thought was possible
• Operate with high agency: you identify what needs to be done and drive it forward without waiting for a ticket
• Care about UX and can build interfaces that are intuitive for both technical researchers and non-technical labelers
• Communicate clearly with researchers, operations teams, and engineers, and can turn vague asks into well-scoped work
• Thrive in a fast-moving environment where priorities shift, Claude is your pair programmer, and the next problem is often one nobody has solved before
• Care about Anthropic's mission to build safe, beneficial AI and want your work to contribute directly to it

Skills

• Broad software engineering skills
• Python programming
• Modern web technologies (React, TypeScript, etc.)
• Cloud infrastructure (GCP or AWS)
• Docker and CI/CD pipelines
• Async Python (Trio, asyncio)
• Data collection and labeling
• Evaluation and observability tooling
• Vendor management and onboarding automation

Benefits

The annual compensation range for this role is listed below. For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

• Annual Salary $300,000—$405,000 USD

Pay

Annual Salary $300,000—$405,000 USD

Schedule

Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Benefits

• Competitive compensation
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Lovely office space

Equal Opportunity Employer

We are an equal opportunity employer and consider applicants for all positions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other characteristic protected by law.