Senior AI Engineer

Ellipsis Health is hiring a Senior AI Engineer to lead the development of agentic AI systems, from research and architecture through production deployment. The role focuses on building and evaluating LLM-powered clinical applications, optimizing training data, and collaborating with clinical, product, and engineering teams to ensure safe, reliable healthcare AI. Responsibilities Technical Leadership & Vision: Act as the technical authority for the Agentic AI roadmap, steering engineering pods from initial research prototyping through to production scaleAdvanced Agentic Architecture: Design, build, and optimize scalable systems and orchestration pipelines capable of deep multi-step reasoning, dynamic memory allocation, long-context evaluation, and high-fidelity tool utilizationResearch-to-Production Translation: Bridge the gap between frontier machine learning research and enterprise software design. Implement and adapt state-of-the-art techniques in post-training fine-tuning, preference alignment, and automated prompt optimizationRigorous Evaluation & Benchmarking: Architect and maintain multi-dimensional quantitative evaluation frameworks and continuous testing infrastructure. Implement state-of-the-art LLM-as-a-judge rubrics, and statistical tracking to evaluate agent capabilities and guarantee zero-regression product updatesData Mix Optimization: Develop and scale automated data curation pipelines to extract, filter, and structure user feedback signals, execution logs, and expert labels into ultra-high-quality training datasets for model fine-tuningCross-Functional & Clinical Collaboration: Work closely within a highly matrixed, collaborative organization alongside clinical experts, product managers, and software engineers to ensure AI platforms operate safely and ground outputs in validated healthcare protocolsMentorship & Engineering Excellence: Foster a culture of technical rigor by setting high coding standards, leading design reviews, standardizing tooling, and mentoring other ML and software engineers across the team