Principal Software Engineer
Haystack · Dallas, TX · 3 wk ago
HybridEngineeringFull-time
About the role
Tackle complex technical challenges in delivering machine learning at enterprise scale. Design, build, and evolve reliable, secure, and cost-efficient platform capabilities. Work hands-on across enterprise repositories, improving shared services, CI/CD workflows, and infrastructure patterns. Conduct deep technical investigation of performance and scalability issues. Set platform strategy and standards for ML packaging, deployment, serving, and observability. Partner with Data Scientists to package, scale, and operationalize models.
Responsibilities
- Design, build, and evolve reliable, secure, and cost-efficient platform capabilities
- Work hands-on across enterprise repositories, improving shared services, CI/CD workflows, and infrastructure patterns
- Conduct deep technical investigation of performance and scalability issues
- Set platform strategy and standards for ML packaging, deployment, serving, and observability
- Partner with Data Scientists to package, scale, and operationalize models
Requirements
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, or related discipline; 8+ years building and operating production platforms
- Deep software engineering expertise in Python and distributed systems, with a track record of building production-grade services, libraries, and internal platforms
- Linux fluency and scripting are required
- Hands-on cloud platform leadership (AWS) with S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS
- Experience with DevOps and CI/CD at scale, owning standards for automated build/test/deploy (e.g., Jenkins, Git-based workflows), containerization (Docker), release governance, and multi-environment promotion for ML-enabled workloads
- Infrastructure as Code (CloudFormation, Terraform/OpenTofu) and platform reliability engineering for ML serving and data/feature pipelines
Qualifications
Competitive base salary with potential for bonus or other variable compensation
Comprehensive health care coverage and emotional well-being support
Market-leading retirement and generous paid time off