Senior Systems Software Engineer - NV Cloud Functions

About the role

The Senior Systems Software Engineer will focus on improving the performance, reliability, and scaling behavior of a system that routes AI workloads onto distributed GPU fleets. They will work on a polyglot platform that is now fully open source, with both control plane and edge deployments.

Responsibilities

• Design and ship services in Java, Go, and Rust, building in the open on a public repository where your commits, design proposals, and reviews are transparent to the community.
• Work on automating and optimizing build, test, integration, and release processes for cloud native.
• Partner with engineering teams across NVIDIA so the platform integrates with adjacent NVIDIA technologies, including the KAI Scheduler, NVIDIA NIM, Grove, and Dynamo.
• Help steward an open-source project. Triage community issues and pull requests and write docs contributors can build on.

Requirements

• Bachelor’s or Master’s Degree in Computer Science or equivalent experience
• 3+ years of hands-on software engineering
• Expert-level knowledge in a systems programming language (Go, C, Rust) and a proven understanding of Data Structures, Algorithms, and Distributed Software Architecture
• Strong understanding of container orchestration systems (Kubernetes) and container technologies with hands-on automation experience in continuous integration frameworks like GitLab & ArgoCD
• Expertise in a scripting language (Bash, Python) and knowledge and experience working with the system internals of Unix/Unix-like kernels such as Linux
• Understanding of performance, security, and reliability in complex distributed systems
• Background with pub-sub models and message queues
• Experience optimizing for high-throughput network paths, with a working understanding of unary versus streaming and bidirectional protocols across HTTP/2 and gRPC
• Experience with developing Kubernetes Custom Resources and Operators deployed in Cloud Service Providers

Qualifications

• Experience with NVIDIA technologies and platforms
• Experience with AI and machine learning frameworks
• Experience with distributed systems and cloud-native architectures

Skills

• Systems performance
• Distributed systems
• Kubernetes-based runtimes

Benefits

Competitive salaries and a generous benefits package, including equity and benefits.

Pay

Base salary range: $152,000 - $241,500 for Level 3, and $184,000 - $287,500 for Level 4.

Schedule

Full-time