Staff AI Platform Engineer, Infrastructure Services
Ladders · United States · 2 mo ago
RemoteRemoteEngineering$156k–$215k/yrFull-time
Location: Remote - US based candidates only, no visa sponsorship available
Responsibilities
- Architect, harden, and scale the Kong AI Gateway platform
- Drive incident response and reliability for gateway issues
- Design across the platform incorporating CI/CD and GitOps
- Evaluate and roll out AI developer tools and make build-vs-buy recommendations
- Define architecture and standards while mentoring team members
- Work with cross-functional teams to meet gateway demands
- Operate self-hosted model serving infrastructure and optimize resources
- Build observability into usage and costs of API-based and self-hosted models
Qualifications
- 8+ years in platform, infrastructure, or DevOps engineering with production ownership
- Hands-on experience with API gateway technologies (Kong, Envoy, etc.)
- Strong knowledge of Kubernetes and GitOps across diverse environments
- Solid CI/CD skills, particularly in Jenkins and GitHub Actions
- Experience with artifact management systems and source control platforms
- Familiarity with infrastructure-as-code (Terraform) and cloud platforms
- Experience with deploying self-hosted LLM inference stacks and GPU infrastructure
- Track record of technical leadership and cross-team collaboration
Pay
$156,000 – $215,000 annually
Benefits
- Restricted Stock Units (RSUs)
- Employee Stock Purchase Plan (ESPP)
- Flexible time off
- Paid company holidays and sick time
- Gender-neutral parental leave
- Grandparent leave
- Medical, dental, and vision coverage
- 401(k) plan with company match
- Life and disability insurance
- Health and dependent care flexible spending account
- Voluntary benefits like hospital and critical illness insurance
- Employee Assistance Program (EAP)
- Home office allowance
- Mobile phone reimbursement
- Wellness coach and gym reimbursement
- Fertility coverage and adoption reimbursement