Jobs · Engineering · California

Forward Deployed Engineer - LLM Post-training

Reflection · San Francisco, CA · 2 wk ago
On-siteEngineeringFull-time

About the role

The Applied AI team at Our Mission Reflection is dedicated to adapting open-weight models for specific customer domains, tasks, and constraints. This role involves fine-tuning models, building evaluation infrastructure, preparing training data, and supporting deployments.

Responsibilities

  • Fine-tune Reflection's open-weight models for customer-specific use cases: prepare datasets, configure training runs (SFT, preference optimization, reinforcement fine-tuning), and iterate based on evals.
  • Build and maintain evaluation infrastructure: design eval suites, curate test sets, establish baselines, and measure whether fine-tuned models actually improve on the tasks customers care about.
  • Prepare training data from raw customer inputs: inspect data quality, clean and format datasets, identify adversarial or noisy samples, and build reproducible data pipelines.
  • Debug and diagnose training and inference issues: interpret loss curves, catch data quality problems, and identify when training dynamics indicate something is wrong.
  • Support end-to-end deployments of fine-tuned models across hybrid environments (public cloud, VPC, and on-premises), helping ensure inference performance and reliability in production.
  • Contribute to evolving playbooks, evaluation benchmarks, and best practices as part of a growing fine-tuning and evals practice.

Requirements

  • Applied ML experience with hands-on fine-tuning of language models.
  • Familiarity with SFT, DPO, RLHF, or similar techniques.
  • Understanding of evaluation methodology: how to design evals, interpret training graphs, and tell whether a model is actually better or just overfitting to the benchmark.
  • Comfort with training infrastructure: GPUs, compute management, debugging common training failures.
  • Strong software engineering fundamentals (Python): write clean, reproducible code.
  • Experience with data pipelines and version control for datasets and experiments.
  • 3+ years of engineering experience with meaningful exposure to applied ML or ML engineering (e.g., MLE, Applied Scientist, Data Scientist who shipped models to production, or ML-focused SWE).
  • Demonstrated ability and interest to work in customer-facing environments, understanding user needs and translating domain requirements into training strategies.
  • Self-starter with high agency and ownership, excelling in fast-paced startup environments where playbooks are still being written.

Qualifications

Top-tier compensation: Salary and equity structured to recognize and retain our talent globally.

Stock options: Everyone who joins and contributes to Reflection's success gets to share in the upside through stock options.

Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance.

Meals: Lunch and dinner are provided in the office daily.

Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys.

Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K.

Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable.

Team building: We have regular off-sites, happy hours, and team celebrations.

Similar jobs

LLM Training Engineer

SciforiumSan Francisco, CA· 2 wk ago
Engineering$155k–$220k/yrapply on jobs.ashbyhq.com