Senior AI Engineer

About the role

DV Trading LLC is a proprietary trading firm that has rapidly scaled in the financial services sector. We are seeking a Senior AI Engineer to build and operate a centralized AI function, focusing on fine-tuning models and managing inference infrastructure to enhance our AI capabilities.

Responsibilities

• Build and operate a model gateway routing inference across open and closed models with cost, latency, and quality tracking
• Design and run distillation pipelines: use frontier model outputs to generate training data for task-specific open models
• Fine-tune and evaluate open-weight models (Llama, Qwen, Mistral, or similar) for DV-specific tasks
• Deploy and maintain on-prem inference infrastructure (vLLM, TGI, or equivalent) on Kubernetes
• Build model evaluation frameworks for quality, cost, latency, and regression
• Define criteria and tooling for model selection: when open models are production-ready vs. when to use closed APIs
• Partner with the agent engineering team to ensure the model layer meets agent workload