Jobs · Information Technology · New York

Forward Deployed ML Engineer

Triomics · New York, NY · 4 days ago
HybridInformation Technology$170k–$190k/yrFull-time

Responsibilities

  • Design and build agentic extraction pipelines that process 500+ page patient charts (clinical notes, pathology reports, imaging reports, genomic panels) and output structured JSON per customer data dictionaries
  • Own accuracy end-to-end: define evaluation datasets, run precision/recall analysis per variable, identify failure modes, and improve through agent architecture changes, prompt engineering, fine-tuning, or rule-based post-processing
  • Go deep into the clinical source data - read the actual patient charts, understand how oncologists document, learn why certain data points are ambiguous and use that understanding to improve extraction
  • Coordinate with customer data science and clinical teams to clarify dictionary definitions, review output quality, and close accuracy gaps
  • Coordinate with internal engineering and infrastructure teams to deploy, scale, and monitor pipelines in production
  • Deliver on customer timelines - this means intense sprint periods around customer deliveries followed by iteration and improvement cycles

Requirements

  • 2+ years building ML/AI systems in production
  • Built and deployed AI agents or multi-step LLM pipelines (not just single-call wrappers) - you should have a clear point of view on agent architectures, tool use, orchestration frameworks, and where they break down
  • Strong Python - pipeline code, data processing, infrastructure glue, not just model training scripts
  • PRACTICAL LLM experience: prompt engineering, fine-tuning, RAG, evaluation design
  • Built evaluation frameworks for LLM based document extraction tasks (precision, recall, per-class analysis, error taxonomy)
  • Willingness to become a domain expert in oncology data - this role requires going deep into clinical documentation, not just treating it as generic text
  • Comfortable owning customer-facing communication alongside technical delivery - you'll talk to customer data science teams, clinical teams, and internal engineering regularly
  • Can operate in high-intensity delivery sprints and manage your own time across multiple workstreams

Compensation

Compensation Range: $170K - $190K

Similar jobs