Principal Engineer, GKE Platform for AI Inference Workloads

About the role

Google Kubernetes Engine (GKE) is the industry standard for container orchestration and the core of Google Cloud’s modernization strategy. We are now embarking on a mission to reinvent GKE and Kubernetes as the premier substrate for the next generation of computing: AI inference at massive scale. We believe that serving foundation models and large language models represents a paradigm shift in cloud computing. These workloads demand a fundamental rethink of orchestration, moving from CPU-bound microservices to accelerator-bound, memory-bandwidth intensive workloads that require specialized scheduling, heterogeneous compute pools, and ultra-high-speed networking.