AI Engineer — Applied AI
About the role
We're looking for an AI Engineer to enhance the performance and efficiency of our clinical data platform. This role involves improving interactions with large language models (LLMs), building evaluation suites, and designing experiments to isolate the effects of changes throughout the platform.
Responsibilities
- Establish software programming paradigms for interactions with LLMs in various scenarios
- Build a test bench to understand the performance of different LLMs
- Work with clinical experts to encode domain knowledge and set quality standards
- Create evaluation suites to measure accuracy, completeness, consistency, latency, and cost
- Design controlled experiments to isolate the effects of changes throughout the platform
- Improve model interactions through prompting, structured outputs, tool use, context management, and workflow composition
- Build datasets and internal tools for evaluation, regression testing, and rapid iteration
Requirements
- 5+ years of experience in applied machine learning, AI engineering, data science, or adjacent software engineering roles
- Excellent Python and SQL skills
- Hands-on experience building production applications with LLMs
- Experience designing experiments and interpreting noisy, multidimensional results
- Familiarity with LLM evaluation, retrieval-augmented generation, agentic workflows, or MLOps
- Strong software-engineering fundamentals and the ability to ship reliable production code
- Intellectual curiosity, sound judgment, and taste
Qualifications
- Bonus points for knowledge of statistical inference, experimental design, or human-in-the-loop evaluation
- Experience building evaluation platforms, experiment tooling, or model-observability systems
- Familiarity with information retrieval, search, ranking, entity resolution, or knowledge systems
- Experience with clinical data, medical terminology, or other healthcare data
- Familiarity with HIPAA, de-identification, or quality controls for high-stakes data
- Experience in an early-stage startup or small, fast-moving technical team
Skills
- Knowledge of statistical inference, experimental design, or human-in-the-loop evaluation
- Experience with information retrieval, search, ranking, entity resolution, or knowledge systems
- Experience with clinical data, medical terminology, or other healthcare data
- Familiarity with HIPAA, de-identification, or quality controls for high-stakes data
Benefits
The base salary for this role will be determined during the interview process and will vary based on multiple factors, including but not limited to prior experience, relevant expertise, current business needs, and market conditions. The expected base salary for the role will generally be between $175,000 to $250,000 per year, with meaningful equity. The final salary offered may be outside this range based on individual circumstances and business and market conditions.
Pay
The base salary for this role will be determined during the interview process and will vary based on multiple factors, including but not limited to prior experience, relevant expertise, current business needs, and market conditions. The expected base salary for the role will generally be between $175,000 to $250,000 per year, with meaningful equity. The final salary offered may be outside this range based on individual circumstances and business and market conditions.
Schedule
This role is remote-eligible. Preference will be given to candidates able to come to work in NYC.
Benefits
Includes health insurance, retirement plans, and paid time off.
Company
Savant is a company based in NYC that transforms how healthcare and life sciences organizations unlock the value trapped in unstructured medical data. We combine cutting-edge large language models (LLMs) with domain-specific quality controls to convert free-text clinical records into structured, analysis-ready data. Savant is backed by Roivant (NASDAQ: ROIV).