Principal Software Engineer

We're hiring on behalf of a Haystack partner! The Role Tackle complex technical challenges in delivering machine learning at enterprise scale. Design, build, and evolve reliable, secure, and cost-efficient platform capabilities for model packaging, serving, observability, and lifecycle management. Take a hands-on role in improving shared services, CI/CD workflows, and infrastructure patterns. Investigate performance and scalability issues, optimizing GPU utilization, throughput, and resource efficiency across ML workloads. Set platform strategy and standards for ML packaging, deployment, serving, and observability. Partner with Data Scientists to package, scale, and operationalize models, defining APIs, guardrails, and automation. What You'll Need Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related discipline. 8+ years building and operating production platforms and services at scale. Deep software engineering expertise in Python and distributed systems. Experience with cloud platform leadership (AWS) including S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS. Proven experience with DevOps and CI/CD at scale, containerization (Docker), and Infrastructure as Code (CloudFormation, Terraform/OpenTofu). ML enablement in production, including model packaging, deployment strategies, inference routing, traffic management, and performance tuning. What's On Offer Opportunity to work on enterprise-scale AI/ML platforms. Influence platform strategy and technical direction. Collaborative environment with Data Scientists and other engineers. Comprehensive benefits package including health care, retirement, and educational assistance. Apply via Haystack today!