Senior Software Engineer, Distributed Systems - NIM Factory

About the role

NVIDIA is seeking a senior engineer to design and build factory infrastructure and automation for NVIDIA Inference Microservices (NIMs). The role involves applying deep technical expertise to design efficient, scalable, and reliable automation factory infrastructure that ensures high performance and accuracy for AI models.

Responsibilities

• Develop a factory pipeline that takes an AI model and produces a deployable service validated across Cloud, On-prem, and Kubernetes environments.
• Collaborate with the team to define and deliver rapid iterations on technical strategies and roadmaps to improve the NIM factory.
• Design interfaces, data modeling, and schema design, and expand observability over the factory pipeline and its compute infrastructure.
• Work with technical leaders to design and develop scalable and reliable factory components.
• Collaborate with multiple AI model teams to understand their requirements and build an efficient infrastructure that improves productivity.
• Define metrics and drive improvements based on user feedback.
• Mentor and collaborate with the team to grow colleagues and yourself.

Requirements

• A history of using advanced programming skills to build distributed and compute systems, backend services, microservices, and cloud technologies.
• Effective experience working with multi-functional teams, principals, and architects across organizational boundaries.
• Deep technical expertise in distributed containerized applications using technologies such as Docker, K8s, Cloud Endpoints, Helm, and Prometheus.
• Passion for building rich, microservice applications and their build and test automation pipeline.
• Excellent interpersonal skills and the ability to lead multi-functional efforts.
• Experience debugging and analyzing the performance of distributed microservices or cloud systems.
• Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field (or equivalent experience).
• 8+ years of shown experience developing performant microservices, cloud software, and/or tooling roles.

Qualifications

• Experience delivering event-driven applications using services like Temporal, Kafka, Redis, or others.
• Proven experience building and deploying containers for Microservices, Cloud, and On-prem deployments, and their associated CI/CD pipelines.
• Prior experience working with large-scale full-stack development.

Skills

• Advanced programming skills in distributed and compute systems.
• Experience with multi-functional teams and organizational boundaries.
• Technical expertise in distributed containerized applications.
• Passion for building rich, microservice applications and their build and test automation pipeline.
• Interpersonal skills and leadership abilities.
• Experience debugging and analyzing the performance of distributed microservices or cloud systems.
• Knowledge of Docker, K8s, Cloud Endpoints, Helm, and Prometheus.
• Experience with Temporal, Kafka, Redis, or similar services.
• Experience with large-scale full-stack development.

Benefits

NVIDIA offers competitive compensation, including a base salary range of $168,000 - $270,250 for Level 4 and $200,000 - $322,000 for Level 5, along with equity and benefits.

Pay

The base salary range is $168,000 - $270,250 for Level 4 and $200,000 - $322,000 for Level 5.

Schedule

Not specified.

Benefits

Not specified.

Skills

Not specified.

Benefits

Not specified.