Research Engineer - Midtraining

About the Role

We're training frontier models to develop deep scientific knowledge and reasoning for scientific discovery. As a Midtraining Research Engineer, you'll take base models and improve their scientific reasoning: curating and generating data, building evals, and running large-scale training experiments. Your work will also lay the groundwork for our pre-training efforts down the line.

Responsibilities

• Identify, process, and curate novel sources of scientific data for large-scale model training.
• Generate high-quality synthetic data to fill gaps in scientific knowledge and reasoning.
• Build evaluations that correlate with downstream scientific task performance, working closely with RL researchers, physicists, and chemists.
• Develop and apply techniques such as self-distillation and on-policy distillation to improve model capability.
• Design and run large-scale training experiments, partnering with supercompute engineers to scale efficiently across thousands of GPUs.
• Build tools for yourself and the team to investigate how data choices shape model intelligence.

Requirements

• Experience training LLMs on curated mixes of trillions of tokens.
• Experience on a dedicated evals team supporting a large production training run.
• Hands-on use of self-distillation, on-policy distillation, or similar methods in a real training pipeline.
• Experience with scaling laws and compute-optimal hyperparameters.
• Comfort working across data, evals, and training infrastructure.

Nice to Have

• Experience optimizing throughput and reliability for large-scale distributed training runs.
• A background in AI for science or training on specialized domain data (e.g., protein, materials, or other scientific datasets).
• Experience creating evals or synthetic data for non-verifiable tasks and tracking performance over live runs.

Qualifications

Minimum education: Bachelor's degree or similar experience

Location

Menlo Park, CA (Soon: San Francisco, too)

Pay

$250,000–$350,000 + equity

Visa Sponsorship

Yes, we sponsor visas and will do everything we can to assist in this process.