Principal Software Engineer

Tech Stack

• Python
• Distributed Systems
• AWS (S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, SNS/SQS)
• DevOps
• Containerization (Docker)
• Infrastructure as Code (CloudFormation, Terraform/OpenTofu)
• Model Packaging
• Deployment Strategies
• Inference Routing
• Performance Tuning

Responsibilities

Design, build, and evolve reliable, secure, and cost-efficient platform capabilities for model packaging, serving, observability, and lifecycle management.

Take a hands-on role in improving shared services, CI/CD workflows, and infrastructure patterns.

Investigate performance and scalability issues, optimizing GPU utilization, throughput, and resource efficiency across ML workloads.

Set platform strategy and standards for ML packaging, deployment, serving, and observability.

Partner with Data Scientists to package, scale, and operationalize models, defining APIs, guardrails, and automation.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related discipline.
• 8+ years building and operating production platforms and services at scale.
• Deep software engineering expertise in Python and distributed systems.
• Experience with cloud platform leadership (AWS) including S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS.
• Proven experience with DevOps and CI/CD at scale, containerization (Docker), and Infrastructure as Code (CloudFormation, Terraform/OpenTofu).
• ML enablement in production, including model packaging, deployment strategies, inference routing, traffic management, and performance tuning.

Qualifications

• Hands-on experience with machine learning and deep learning frameworks.
• Strong problem-solving skills and ability to work independently and collaboratively.
• Excellent communication and collaboration skills with cross-functional teams.

Benefits

• Comprehensive benefits package including health care, retirement, and educational assistance.

Pay

TBD

Schedule

TBD

Skills

• Machine Learning
• Deep Learning
• Cloud Platforms (AWS)
• DevOps
• CI/CD
• Containerization
• Infrastructure as Code