Jobs · Engineering · California

Research Engineer, Knowledge Foundations

Anthropic · San Francisco, CA · 2 wk ago
HybridEngineering$350k–$850k/yrFull-time

About the role

The Knowledge Work team builds the training environments and evaluations that make Claude effective at real-world professional workflows — searching, analyzing, and creating across the tools and documents knowledge workers use every day. As that work scales, the systems behind it need to be as rigorous as the research itself. As a Research Engineer on Knowledge, you'll design and run experiments that improve how Claude searches, retrieves, and reasons over information at scale.

Responsibilities

  • Design, build, and iterate on training environments and data pipelines that improve Claude's ability to reason over knowledge-intensive tasks
  • Run experiments end-to-end: form a hypothesis, build the infrastructure, train models, analyze results, and decide what to try next
  • Develop evaluations that meaningfully capture progress on search, retrieval, and reasoning quality
  • Identify failure modes in current model behavior and translate them into concrete training signals
  • Collaborate closely with researchers across RL Data, post-training, and product teams to align on priorities and ship improvements
  • Contribute to shared infrastructure and tooling that compounds the team's velocity over time
  • Own a clean, canonical set of evaluation tools and processes for Knowledge Work capabilities, including the process used for model releases
  • Build and automate observability, dashboards, and operational tooling for our training environments and evaluation systems, with an emphasis on high signal-to-noise: a small set of trusted metrics and alerts rather than sprawling instrumentation

Qualifications

  • A highly experienced Python engineer who ships reliable, well-instrumented code that teammates trust in production
  • Experience designing, running, and analyzing ML experiments
  • Ability to work across the stack — from data pipelines to model training to evaluation
  • 5+ years of experience operating ML or distributed systems at scale
  • Comfort working with ambiguity and choosing the most impactful problem to tackle next
  • Clear written and verbal communication, especially when collaborating across time zones
  • Find genuine satisfaction and impact in making existing critical systems dependable

Preferred Qualifications

  • Hands-on experience training, fine-tuning, or doing RL on large language models
  • Experience building evaluations for LLMs, particularly in open-ended or knowledge-intensive domains
  • Prior work in a research-heavy environment such as a frontier AI lab, quant research firm, or domain-focused AI startup
  • Published research on LLMs, RL, retrieval, or related areas
  • Experience with distributed training systems

Similar jobs