Jobs · Engineering · Washington

Member of Technical Staff - Research & Post-training

Preference Model · Seattle, WA · 1 mo ago
On-siteEngineering$200k–$350k/yrFull-time

About the role

The role is a blend of research and engineering, focusing on pushing the frontier of self-directed learning in large language models.

Responsibilities

  • Train and evaluate models on proprietary RL environments to validate data quality, surface gaps in task coverage, and close the feedback loop between environment design and model capability.
  • Arcitect and optimize RL training infrastructure, including training abstractions and distributed experiment management, using frameworks like Verl, OpenRLHF, or similar.
  • Scale systems to handle increasingly complex research workflows.
  • Design, implement, and test training environments, evaluations, and methodologies for RL agents.
  • Profile and optimize training runs end-to-end, from data loading through reward computation, to maximize experiment throughput and shorten the research iteration cycle.

Requirements

  • Experience running end-to-end LLM post-training pipelines
  • Proficiency in Python and PyTorch or JAX
  • Experience with at least one modern RL training framework
  • Experience building and operating ML infrastructure at scale

Qualifications

  • Strong opinions (loosely held) about how to structure RL training code for reproducibility and fast iteration
  • Balance research exploration with engineering rigor
  • Strong systems design and communication skills

Skills

  • Evaluate model outputs and build reward or evaluation signals
  • Stay current on post-training research and translate papers into running code
  • Adaptability combined with exceptional communication and collaboration skills

Benefits

  • Competitive cash and equity compensation
  • Ownership and autonomy in a fast-moving startup environment
  • Opportunity to work with top machine learning engineers
  • Health, vision, dental, benefits
  • 401K match
  • Lunch provided everyday onsite
  • Weekly snack orders
  • Visa sponsorship & relocation support available

Pay

$200K - $350K

Schedule

Full-time

Similar jobs