Lead AI Infrastructure Architect

About the role

We are looking for a Staff AI Infrastructure Architect to define and operate the cloud architecture behind AIO’s applications. The position is embedded within the AIO team and partners closely with GILLIG IT, setting enterprise standards for how AI applications are deployed, secured, and operated. The work spans data, compute, networking, model hosting, and security, and this role leads the team’s enterprise AI management responsibilities, from vendor and platform strategy to guardrails and policy. This is a hands-on architecture role targeted at approximately 7 or more years of relevant experience.

Responsibilities

• Define the target cloud architecture for AIO applications across data, compute, and networking, and own it from design through operation
• Stand up and manage data services (databases, storage, and pipelines) in partnership with data engineering
• Manage compute for dev, test, and production environments, including containerized and serverless application hosting
• Design and maintain network connectivity: VPC/VNet architecture, private connectivity to on-premise systems, DNS, and load balancing
• Host and manage LLM endpoints via AWS Bedrock and Azure AI Foundry, including quota, cost, and access management
• Define and implement the cybersecurity baseline: identity and access management, secrets management, encryption, logging and monitoring, and patching aligned to IT security standards
• Lead the team’s enterprise AI management responsibilities: drive AI vendor selection, infrastructure strategy, guardrails, and AI security and policy standards
• Establish infrastructure as code (e.g., Terraform) and CI/CD pipelines, and codify them into the team’s common deployment template
• Partner with GILLIG IT to align architecture with enterprise standards, obtain buy-off on designs and deployments, and represent AIO in security and architecture reviews
• Monitor cost, performance, and reliability of deployed applications and own incident response for infrastructure issues on the team’s products
• Support Forward Deployed Engineers in moving proofs of concept to production quickly without compromising the security baseline
• Mentor engineers on infrastructure and deployment practices and support the team’s AI Fluency mission across the company

Requirements

• Bachelors of Science(BS) Degree in Engineering
• Minimum 8 or more years of experience in cloud, platform, DevOps, or infrastructure engineering, including time as an architect or technical lead
• Deep hands-on expertise in at least one major cloud (AWS or Azure) and strong working knowledge of the other