AI Infrastructure Operations Engineer

About the role

The AI Infrastructure & Operations Engineer will operationalize the Companion platform, ensuring it runs reliably at production scale. They will build observability practices, strengthen platform resilience, and collaborate with technology leadership, AI architects, and security stakeholders.

Responsibilities

• Establish operational reliability for Companion across AKS infrastructure, AI agent workloads, monitoring systems, and deployment pipelines.
• Build meaningful observability practices to understand platform behavior, usage trends, and operational risks.
• Create sustainable operational hygiene around patching, CVE remediation, secrets rotation, dependency management, and cloud maintenance cycles.
• Strengthen platform resilience, documentation, and operational processes to enable scaling without relying on tribal knowledge.
• Operate and improve platform reliability by monitoring and maintaining AKS infrastructure, AI agent workloads, deployment pipelines, and Azure services.
• Investigate incidents, troubleshoot production issues, and improve platform resilience through better operational patterns and tooling.
• Support release operations and ensure deployments remain stable, observable, and recoverable.
• Build observability and operational insight by developing dashboards, alerts, logging patterns, and operational baselines using Azure Log Analytics and Application Insights.
• Identify system trends, performance bottlenecks, and emerging operational risks across infrastructure and AI workloads.
• Improve visibility into AI agent behavior, enterprise workflow integrations, latency patterns, and system health under real user load.
• Strengthen security and operational hygiene by maintaining operational cadence for dependency updates, CVE remediation, image signing, secrets rotation, and cluster patching.
• Support security-first infrastructure practices across Kubernetes, CI/CD pipelines, and Azure environments.
• Partner with security and engineering stakeholders to maintain compliance-aware operational practices in a HIPAA-regulated environment.
• Collaborate across a small, high-ownership team by working closely with technology leadership, platform engineers, security stakeholders, and AI architects.
• Contribute documentation, operational runbooks, and shared knowledge that reduce platform fragility over time.
• Help establish practical operational patterns for AI systems where industry best practices are still emerging.

Requirements

• Strong hands-on Kubernetes operations experience, including troubleshooting workloads, admission controllers, cluster networking, and production incidents.
• Experience supporting cloud-native infrastructure in Azure environments, particularly AKS and related operational tooling.
• Demonstrated strength in monitoring, observability, and incident response using structured logging and metrics platforms.
• SRE mindset with experience handling on-call responsibilities, operational prioritization, and post-incident analysis.
• Comfort operating in fast-moving environments with incomplete documentation, evolving processes, and broad ownership areas.
• Strong communication and collaboration skills with the ability to explain technical issues clearly across technical and non-technical audiences.

Qualifications

• Experience with CI/CD pipeline tooling including GitHub Actions, Kaniko, cosign, image signing, or Actions Runner Controller.
• Familiarity with Infrastructure as Code practices using Bicep or Azure resource automation tooling.
• Exposure to HIPAA, SOC2, or other compliance-aware operational environments.
• Experience supporting AI or LLM-backed applications in production environments.

Skills

• Hands-on Kubernetes operations experience.
• Cloud-native infrastructure experience in Azure environments, particularly AKS.
• Monitoring and observability expertise.
• Incident response and SRE skills.
• Communication and collaboration abilities.
• CI/CD pipeline tooling experience.
• Infrastructure as Code practices.
• Compliance awareness in HIPAA, SOC2, or similar environments.
• Experience with AI or LLM-backed applications.

Benefits

Private Health Management offers a comprehensive benefits package including health/dental/vision benefits, an annual cash incentive program, a 401(k) with match, flexible PTO, PHM for PHM — our services for you and your dependents — and other benefits.

Pay

The target base salary for this position is $120,000 - $140,000.