Platform Engineer – AI Infrastructure
STACK Infrastructure · Plano, TX · 5 days ago
Engineering$128k–$146k/yrFull-time
Position Overview
The Platform Engineer – AI Infrastructure leads the cloud platform, DevOps pipelines, automation runtime environments, and operational infrastructure that power all of STACK’s AI, automation, and data initiatives. This role involves hands-on responsibilities for deployment velocity, reliability, cost optimization, and security.
Key Responsibilities
- Implement Infrastructure-as-Code using Terraform, Bicep, or ARM templates with modular, version-controlled patterns enabling new workloads to deploy within hours.
- Configure Azure networking (VNets, Private Endpoints, NSGs, Private DNS) for secure, globally distributed platform environments across AMER, EMEA, and APAC.
- Build container-based deployment patterns (Azure Container Apps, AKS) for API serving, agent hosting, model inference, and automation execution.
- Provision and manage LLM/SLM serving infrastructure: Azure OpenAI deployments, model endpoints, token-based scaling, and multi-region failover.
- Design and deploy end-to-end CI/CD pipelines (Azure DevOps, GitHub Actions) for application deployment, model promotion, data pipeline orchestration, and automated testing with blue/green and canary patterns.
- Build MLOps pipelines for model registration, versioning, A/B testing, canary deployment, and automated rollback of LLM endpoints and RAG configurations.
- Deploy and manage automation runtime infrastructure: Azure Logic Apps, Power Automate, Azure Functions, Durable Functions, and event-driven triggers for intelligent workflows.
- Create reusable deployment accelerators (Terraform modules, Helm charts, pipeline templates) to reduce time-to-production for each successive initiative.
- Drive Azure cost optimization: commitment-tier analysis, right-sizing, automated shutdown policies, and token consumption tracking across LLM endpoints.
- Implement RBAC, managed identities, Key Vault integration, and least-privilege access across all platform components.
- Ensure SOX compliance, data residency, and governance using Microsoft Purview, Defender XDR, and Azure Policy.
- Manage secrets, certificates, API key rotation, and Entra ID integration for platform authentication across global regions.
- Produce monthly infrastructure cost and performance reports with spend trends, cost-per-query, and optimization metrics.
Qualifications
- 7+ years of cloud infrastructure/DevOps experience with at least 2 years supporting AI/ML, automation, or data platform workloads at scale.
- Expert-level Azure skills: Databricks, Cosmos DB, Azure Functions, Logic Apps, ADLS Gen2, Azure AI Search, Azure OpenAI Service, Container Apps/AKS, and Azure Monitor.
- Strong IaC proficiency: Terraform (modules, state, workspaces), Bicep, or ARM templates with environment-templated patterns.
- Hands-on CI/CD engineering: Azure DevOps, GitHub Actions, container registries, Helm charts, and blue/green/canary deployment automation.
- Solid Python and Bash skills for infrastructure tooling, automation scripts, and deployment utilities.
- Deep understanding of Azure networking, security (RBAC, managed identities, Key Vault, Private Endpoints, Azure Policy), and cost management.
- Experience with containerization (Docker) and orchestration (AKS or Container Apps) for production workload and model serving.
- Familiarity with AI platform infrastructure: Databricks provisioning, Cosmos DB scaling, AI Search management, and LLM endpoint deployment.
Benefits
- Healthcare, Dental Care, Vision Insurance, Life Insurance, Paid Time Off, and Paid Leave Programs.
- Competitive compensation package with a 401K program, flexible spending accounts, and cell phone subsidy.
- Fun and inclusive company culture with events, game nights, happy hours, and barbecues.
- Growing company with opportunities for career advancement.
- Equal opportunity employer.