Staff Backend Engineer, ML Inference Systems
Unity · Mountain View, CA · 4 days ago
Engineering$245k–$318k/yrFull-time
About the role
The Vector Gamer AI team at Unity connects billions of players with the games and experiences they love. We are seeking a Staff Backend Engineer to build and operate the infrastructure that powers these experiences.
Responsibilities
- Design, develop, and deploy production-grade backend services and distributed systems powering large-scale online model inference at billions of daily requests
- Drive technical direction of our inference platform, focusing on low-latency, high-throughput serving infrastructure
- Partner with ML engineers to ensure online serving infrastructure scales with growing model complexity and inference volumes, without compromising latency or throughput
- Ensure the reliability, scalability, and efficiency of our systems in production using monitoring and observability tools like Prometheus and Grafana
- Manage and optimize cloud infrastructure on GCP, orchestrating workloads with Kubernetes across a high-scale production environment
- Promote and implement best practices for backend service development, testing, deployment, and monitoring (DevOps, SRE)
Requirements
- 5+ years designing, deploying, and maintaining distributed systems at scale
- Expertise in Golang for building high-performance, low-latency backend infrastructure
- Hands-on experience with cloud infrastructure on GCP and workload orchestration with Kubernetes
- Strong grounding in monitoring and observability tooling, including Prometheus and Grafana
- Experience in ad tech, recommender systems, real-time personalization, or other performance-critical domains
- Familiarity with microservice architectures, containerization (Docker), and CI/CD best practices
- Familiarity with machine learning platforms, workflows, and serving infrastructure
Qualifications
- Experience with ML inference servers like NVIDIA Triton Inference Server
- Familiarity with auction mechanics or bidding systems in an ad tech context
Skills
- Technical leadership and problem-solving skills
- Experience with cloud-native technologies
- Strong analytical and troubleshooting skills
- Excellent communication and collaboration skills
Benefits
Unity offers a comprehensive benefits package including:
- Comprehensive health, life, and disability insurance
- Commute subsidy
- Employee stock ownership
- Competitive retirement/pension plans
- Generous vacation and personal days
- Support for new parents through leave and family-care programs
- Office food snacks
- Mental Health and Wellbeing programs and support
- Employee Resource Groups
- Global Employee Assistance Program
- Training and development programs
- Volunteering and donation matching program
Pay
Gross pay annually: USD $244,500 - $317,800
Schedule
Full-time, remote position