Research Engineer, Synthetic Data

About the role

We are building infrastructure to create RL training data and evaluations for frontier AI agents, and a marketplace to sell this data to frontier labs through the HUD marketplace. Our platform serves Fortune 500 companies, startups, and other organizations.

Responsibilities

• Work with subject-matter experts to create synthetic tasks for training AI agents across various professional and technical domains.
• Design synthetic task generation methods that produce diverse, realistic, and learnable tasks.
• Build systems and tooling to mutate, validate, and improve synthetic tasks.
• Analyze model and agent performance on synthetic tasks to understand what the tasks are teaching and where they fail.
• Develop metrics to quantify and understand synthetic task diversity, realism, learnability, etc.

Requirements

• Proficiency in Python, Docker, and Linux environments.
• Experience with synthetic data research methods.
• Built synthetic data pipelines end-to-end without a fully prescribed roadmap.
• Experience working on environments, evals, and benchmarks.
• Strong communication skills for remote collaboration across time zones.

Qualifications

• Strong understanding of what “good synthetic data” means and its limitations.
• Detail-oriented and able to spot subtle inconsistencies or edge cases in synthetic data.
• Able to reason from first principles about task design, scoring, and failure modes.
• Thrives in unstructured problem spaces.
• Early-stage startup experience with ability to work independently in fast-paced environments.

Skills

• Technical aptitude and learning potential over years of experience.
• Motivated candidates are encouraged to apply even if they don't meet all criteria.

Team & Company Details

• Team Size: ~15 people currently, mostly full-time in-person, but some remote.
• Our team includes 4 International Olympiad medalists (IOI, ILO, IPhO), serial AI startup founders, and researchers with publications at ICLR, NeurIPS, etc.
• Company stage: We have 8 figures in funding and high revenue growth. We're scaling profitably and quickly to meet very strong demand.

Logistics

• Employment: Full-time.
• Location: On-site only, for now. You can join the team in the San Francisco Bay Area or Singapore offices.
• Visa Sponsorship: We provide support for relocation and visas for strong full-time candidates to the US or Singapore.

Timeline

• Applications are rolling.
• The process is 2 technical interviews and a 2-3 day work trial.

What we offer

• Competitive compensation.
• 100% covered top-of-the-line medical, dental, and vision from Blue Shield of CA (US employees).
• Lunch and dinner when you’re in the office.
• Company-wide holiday break (Christmas Eve to New Year’s Day) on top of PTO and paid holidays.
• Other perks including an Equinox membership, 401k, and commuter benefits (US employees).
• Unlimited* access to tokens for ChatGPT, Claude Code, Cursor, etc.

Contact

If you have any questions or would like to apply, please contact us at [[email removed]](mailto:[email removed]) or elsewhere.