Jobs · Information Technology

Senior Azure Cloud Infrastructure Engineer (Healthcare AI Platform)

CIVIE · United States · 2 mo ago
RemoteRemoteInformation TechnologyFull-time

Overview

We're looking for a Senior Azure Cloud Infrastructure Engineer to design, build, and operate a highly resilient, secure, and cost-efficient cloud platform supporting advanced AI workloads in a healthcare environment. This role is responsible for mission-critical infrastructure powering our proprietary foundational AI model, including GPU-based compute, while meeting strict requirements for compliance, data protection, and high availability. You will play a key role in ensuring our systems are fault-tolerant, auditable, and continuously optimized for both performance and cost.

What You'll Do

- Architect and manage highly available, fault-tolerant systems on Microsoft Azure with multi-region redundancy and disaster recovery - Design infrastructure with strict adherence to healthcare compliance standards (e.g., HIPAA, HITRUST, SOC 2) - Provision and optimize GPU-based environments for AI/ML workloads, including large-scale model training and inference - Build secure, zero-trust architectures (private networking, encryption, identity isolation, least privilege access) - Implement backup, failover, and business continuity strategies with clearly defined RTO/RPO targets - Continuously reduce infrastructure costs through intelligent scaling, reserved capacity, spot instances, and workload optimization - Develop Infrastructure as Code (Terraform, Bicep, ARM) for repeatable, auditable deployments - Partner with AI/ML teams to productionize and scale foundational models reliably - Establish observability across systems (logging, monitoring, alerting) with proactive incident response - Conduct architecture reviews, risk assessments, and security audits

Required Experience

- 5–8+ years of hands-on experience with Microsoft Azure cloud infrastructure - Proven experience designing high-availability and disaster recovery systems in regulated environments - Strong background in healthcare or other compliance-heavy industries - Deep expertise in: - Azure Virtual Machines, VM Scale Sets, and GPU compute - Azure networking (VNets, Private Link, ExpressRoute, firewalls) - Storage solutions (Blob, Files, managed disks with redundancy options) - Experience implementing compliance frameworks such as HIPAA or SOC 2 - Strong knowledge of identity and access control (RBAC, Azure AD, managed identities) - Experience with Kubernetes (AKS) and containerized workloads - Proficiency in scripting (Python, Bash, PowerShell)

Preferred Qualifications

- Experience with Azure AI ecosystem (Azure Machine Learning, Azure AI Foundry, Cognitive Services) - Familiarity with distributed training, model parallelism, and GPU orchestration - Experience implementing MLOps pipelines in regulated environments - Azure certifications (Solutions Architect Expert, Security Engineer Associate, DevOps Engineer Expert) - Experience with zero-downtime deployments and blue/green or canary strategies

Infrastructure Expectations

- Multi-region architecture with automated failover - End-to-end encryption (data at rest and in transit) - Segmented environments (dev/staging/prod) with strict isolation - Real-time monitoring and alerting with defined SLAs - Automated backup and recovery with regular testing - Cost visibility and governance across all resources

What Success Looks Like

- Near-zero downtime systems with tested failover capabilities - Full compliance readiness with audit trails and documentation - Efficient GPU utilization supporting AI workloads at scale - Measurable reduction in cloud spend without compromising reliability or security - Seamless collaboration between infrastructure and AI teams

Why This Role Matters

You will be building the backbone of the next-generation healthcare AI platform - where reliability, security, and performance directly impact real-world outcomes. This is not just infrastructure; it is critical systems engineering at the intersection of cloud, AI and healthcare.

We Offer

- Paid vacation, sick time, and personal days - 11 company paid holidays - Quarterly UberEats voucher - Monthly Fringe benefits - Flexible work schedules - Professional development stipend - Health, dental, and vision benefits, with employer HSA contribution - STD, LTD and life insurance - 401(k) company match and profit sharing

Similar jobs