Principal Software Engineer
Haystack · Boston, KY · Today
HybridFull-time
Tech Stack
- Python
- Distributed Systems
- Cloud Platform Leadership (AWS)
- DevOps
- Containerization (Docker)
- Infrastructure as Code (CloudFormation, Terraform/OpenTofu)
- Machine Learning Enablement in Production
Responsibilities
- Design, build, and evolve reliable, secure, and cost-efficient platform capabilities for model packaging, serving, observability, and lifecycle management.
- Take a hands-on role in improving shared services, CI/CD workflows, and infrastructure patterns.
- Investigate performance and scalability issues, optimizing GPU utilization, throughput, and resource efficiency across ML workloads.
- Set platform strategy and standards for ML packaging, deployment, serving, and observability.
- Packaging, scaling, and operationalizing models with Data Scientists, defining APIs, guardrails, and automation.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related discipline.
- 8+ years building and operating production platforms and services at scale.
- Deep software engineering expertise in Python and distributed systems.
- Experience with cloud platform leadership (AWS) including S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS.
- Proven experience with DevOps and CI/CD at scale, containerization (Docker), and Infrastructure as Code (CloudFormation, Terraform/OpenTofu).
- ML enablement in production, including model packaging, deployment strategies, inference routing, traffic management, and performance tuning.
Qualifications
- Hands-on experience with machine learning and deep learning frameworks.
- Strong problem-solving skills and ability to work independently and collaboratively.
- Excellent communication and collaboration skills with cross-functional teams.
Benefits
- Comprehensive benefits package including health care, retirement, and educational assistance.