Staff AI Engineer - Zoom AI Services Platform

Responsibilities

• Design and build large-scale cloud services powering Zoom AI APIs and developer platform.
• Design reusable APIs, service abstractions, and platform components for AI capabilities.
• Build distributed systems supporting synchronous, asynchronous, and streaming AI workloads.
• Improve scalability, reliability, observability, and operational efficiency of AI services.
• Design scheduling, resource management, and workload orchestration for large-scale CPU and GPU infrastructure.
• Partner closely with AI modeling, platform, and product teams to onboard new AI capabilities onto the Zoom AI Services platform.
• Drive technical architecture and engineering best practices across the team.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related technical field, or equivalent practical experience.
• 8+ years of software engineering experience building distributed systems, cloud platforms, or large-scale backend services.
• Experience building and operating production AI services such as Speech Recognition (ASR), Machine Translation (MT), LLM applications, AI Agents, Search, Document Intelligence, Computer Vision, or similar AI-powered cloud services.
• Strong experience designing and operating large-scale cloud services, including microservices, service-oriented architectures, and multi-tenant platforms.
• Strong understanding of Kubernetes, containers, distributed systems, networking, and cloud-native technologies.
• Experience building highly available, scalable, and observable production systems running at cloud scale.
• Experience working with AI infrastructure, including model serving, AI inference platforms, GPU/CPU resource management, or ML infrastructure.
• Strong programming skills in Go, Java, C++, Python, or similar languages.
• Excellent system design, technical leadership, and cross-functional collaboration skills, with the ability to drive architecture across multiple engineering teams.

Qualifications

• Preferred Experience with one or more major cloud platforms (AWS, Azure, or GCP).
• Experience optimizing large-scale AI workloads for performance, scalability, reliability, or cost.
• Experience contributing to AI platforms serving both internal products and external developers.
• Experience with open-source AI infrastructure such as Kubernetes, Istio, vLLM, Triton, SGLang, Ray, or similar technologies.

Benefits

As part of our award-winning workplace culture and commitment to delivering happiness, our benefits program offers a variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways.