Research Scientist

About The Role

As a Research Scientist at idler, you'll own measuring and improving how models learn from our tasks. You'll draw on your own experience and collaborate with frontier researchers to validate our data quality, identify where improvements are needed, and create new datasets.

To succeed, you'll need to have extensive experience doing this work in production at a frontier lab.

• Work with our customers — researchers at frontier labs — to design novel post-training recipes and data quality measurement techniques
• Design and run our in-house post-training stack to measure model lift on our tasks
• Develop new data products based on datasets and experts available to us
• Work with procurement to ensure external data we acquire is suitable for refinement
• Create scalable systems for ingesting & evaluating data we are considering buying

What We’re Looking For

• 1+ years of experience doing RL in production at a frontier lab
• Track record of post-training an LLM end to end
• Desire to drive the research roadmap and implementation on a fast-moving team
• Deep curiosity about how machines learn from data and how to extract the maximum learning signal from our tasks

Tech Stack

• TypeScript
• React
• NodeJS
• Postgres
• Redis
• Vercel
• Cursor

Details

• In-person in San Francisco
• Competitive salary + meaningful equity
• Free meals in office
• Healthcare, 401(k), 15 days of PTO per year
• Relocation assistance
• Small, ambitious team