Senior Software Engineer II, AI Workload Orchestration
About the role
As a Senior Software Engineer II (IC4) on the AI Workload Orchestration team, you will help build and operate CoreWeave’s Kubernetes-native platform for admitting, scheduling, and operating AI workloads at scale. This platform integrates multiple orchestration and scheduling frameworks such as Kueue, Volcano, and Ray to support modern AI training and inference workflows. It complements SUNK (Slurm on Kubernetes) by providing a Kubernetes-first, cloud-native orchestration layer with deep platform integration.
Responsibilities
- Design, build, and operate Kubernetes-native services for AI workload orchestration and scheduling
- Own meaningful components of the platform, drive reliability and performance improvements, and help scale the system as customer demand and workload complexity continue to grow
Requirements
5–8 years of professional software engineering experience in distributed systems, cloud infrastructure, or platform engineering
Strong experience building production systems in Go (Python or C++ a plus)
Solid understanding of Kubernetes fundamentals, APIs, controllers, and operating services in production
Experience working with scheduling, resource management, or quota-based systems
Proven ability to improve system reliability and performance using data and operational metrics
Comfortable owning services in production and participating in on-call rotations
Preferred Experience
- With Kubernetes-native orchestration frameworks such as Kueue, Volcano, Ray, Kubeflow, or Argo Workflows
- Familiarity with GPU-based workloads, ML training, or inference pipelines
- Knowledge of scheduling concepts such as quota enforcement, pre-emption, and backfilling
- Experience with reliability practices including SLOs, alerting, and incident response
- Knowledge of AI infrastructure, HPC, or large-scale distributed compute environments