Jobs · Engineering

Staff AI Platform Engineer, Infrastructure Services

Ladders · United States · 2 mo ago
RemoteRemoteEngineering$156k–$215k/yrFull-time

Location: Remote - US based candidates only, no visa sponsorship available

Responsibilities

  • Architect, harden, and scale the Kong AI Gateway platform
  • Drive incident response and reliability for gateway issues
  • Design across the platform incorporating CI/CD and GitOps
  • Evaluate and roll out AI developer tools and make build-vs-buy recommendations
  • Define architecture and standards while mentoring team members
  • Work with cross-functional teams to meet gateway demands
  • Operate self-hosted model serving infrastructure and optimize resources
  • Build observability into usage and costs of API-based and self-hosted models

Qualifications

  • 8+ years in platform, infrastructure, or DevOps engineering with production ownership
  • Hands-on experience with API gateway technologies (Kong, Envoy, etc.)
  • Strong knowledge of Kubernetes and GitOps across diverse environments
  • Solid CI/CD skills, particularly in Jenkins and GitHub Actions
  • Experience with artifact management systems and source control platforms
  • Familiarity with infrastructure-as-code (Terraform) and cloud platforms
  • Experience with deploying self-hosted LLM inference stacks and GPU infrastructure
  • Track record of technical leadership and cross-team collaboration

Pay

$156,000 – $215,000 annually

Benefits

  • Restricted Stock Units (RSUs)
  • Employee Stock Purchase Plan (ESPP)
  • Flexible time off
  • Paid company holidays and sick time
  • Gender-neutral parental leave
  • Grandparent leave
  • Medical, dental, and vision coverage
  • 401(k) plan with company match
  • Life and disability insurance
  • Health and dependent care flexible spending account
  • Voluntary benefits like hospital and critical illness insurance
  • Employee Assistance Program (EAP)
  • Home office allowance
  • Mobile phone reimbursement
  • Wellness coach and gym reimbursement
  • Fertility coverage and adoption reimbursement

Similar jobs