Jobs · Engineering · California

Research Engineer

ChatGPT Jobs · San Francisco, CA · 1 mo ago
EngineeringFull-time

About the role

We are hiring a Research Engineer to help scale the quality assurance (QA) systems behind training data generated through our infrastructure. This role sits at the intersection of data quality, tooling, and applied ML operations. You will build the standards, pipelines, and feedback loops that ensure datasets are reliable, consistent, and ready for training and evaluation.

Key Responsibilities

  • Define and enforce quality standards for training datasets used for RL training and evaluation.
  • Build tooling and workflows to audit supplier-generated datasets, including sampling strategies, validation pipelines (rule-based and model-assisted), and feedback loops.
  • Evaluate and implement human-in-the-loop review workflows to improve quality and efficiency.
  • Partner with external data suppliers to debug quality issues, provide actionable feedback, and improve their data generation processes.
  • Integrate QA learnings into internal tools and supplier portals to reduce anomalies, inconsistencies, and edge cases over time.
  • Track QA outcomes and continuously improve processes, metrics, and documentation.

Requirements

  • Proficiency with Python and experience working in Linux environments.
  • Experience with Docker and reproducible development/deployment workflows.
  • Experience working with large-scale datasets (validation, transformation, or analysis).
  • Strong problem-solving skills and evidence of rapid learning in technical environments.
  • Able to operate independently and deliver results in an early-stage, fast-moving setting.
  • Clear written and verbal communication skills (including collaborating across time zones).

Nice to Have

  • Experience building data validation pipelines and/or human-in-the-loop review systems.
  • Familiarity with common training-data failure modes and techniques to detect subtle inconsistencies.
  • Comfort designing QA metrics, experiments, and processes—not just executing predefined checks.
  • Familiarity with modern AI tooling and LLM capabilities.

Similar jobs

Research Engineer

GreptileSan Francisco, CA· 4 days ago
Engineering$30/hrapply on greptile.com

Research Engineer

SesameSan Francisco Bay Area· 3 wk ago
Engineeringapply on jobs.ashbyhq.com

Research Engineer

SesameBellevue, WA· 5 days ago
Engineering$190k–$320k/yrapply on jobs.ashbyhq.com

Research Engineer

FANUC America CorporationUnion City, CA· 4 wk ago
Engineering$123k–$207k/yrapply on myjobs.adp.com

Research Engineer

Matic RobotsMenlo Park, CA· 8 mo ago
Engineering$140k–$220k/yrapply on jobs.ashbyhq.com

Research Engineer

Product PulseSan Francisco, CA· 1 wk ago
Engineering$30/hrapply on easyapply.jobs