Senior AI Engineer
Jobverse.io · Chicago, IL · Yesterday
EngineeringFull-time
DV Trading LLC is a proprietary trading firm that has rapidly scaled in the financial services sector. They are seeking a Senior AI Engineer to build and operate a centralized AI function, focusing on fine-tuning models and managing inference infrastructure to enhance their AI capabilities. Responsibilities Build and operate a model gateway routing inference across open and closed models with cost, latency, and quality trackingDesign and run distillation pipelines: use frontier model outputs to generate training data for task-specific open modelsFine-tune and evaluate open-weight models (Llama, Qwen, Mistral, or similar) for DV-specific tasksDeploy and maintain on-prem inference infrastructure (vLLM, TGI, or equivalent) on KubernetesBuild model evaluation frameworks for quality, cost, latency, and regressionDefine criteria and tooling for model selection: when open models are production-ready vs. when to use closed APIsPartner with the agent engineering team to ensure the model layer meets agent workload