Member of Technical Staff - Research & Post-training
Preference Model · Seattle, WA · 1 mo ago
On-siteEngineering$200k–$350k/yrFull-time
About the role
The role is a blend of research and engineering, focusing on pushing the frontier of self-directed learning in large language models.
Responsibilities
- Train and evaluate models on proprietary RL environments to validate data quality, surface gaps in task coverage, and close the feedback loop between environment design and model capability.
- Arcitect and optimize RL training infrastructure, including training abstractions and distributed experiment management, using frameworks like Verl, OpenRLHF, or similar.
- Scale systems to handle increasingly complex research workflows.
- Design, implement, and test training environments, evaluations, and methodologies for RL agents.
- Profile and optimize training runs end-to-end, from data loading through reward computation, to maximize experiment throughput and shorten the research iteration cycle.
Requirements
- Experience running end-to-end LLM post-training pipelines
- Proficiency in Python and PyTorch or JAX
- Experience with at least one modern RL training framework
- Experience building and operating ML infrastructure at scale
Qualifications
- Strong opinions (loosely held) about how to structure RL training code for reproducibility and fast iteration
- Balance research exploration with engineering rigor
- Strong systems design and communication skills
Skills
- Evaluate model outputs and build reward or evaluation signals
- Stay current on post-training research and translate papers into running code
- Adaptability combined with exceptional communication and collaboration skills
Benefits
- Competitive cash and equity compensation
- Ownership and autonomy in a fast-moving startup environment
- Opportunity to work with top machine learning engineers
- Health, vision, dental, benefits
- 401K match
- Lunch provided everyday onsite
- Weekly snack orders
- Visa sponsorship & relocation support available
Pay
$200K - $350K
Schedule
Full-time