Senior Software Engineer, Distributed Systems - NIM Factory

About the role

NVIDIA is seeking a senior engineer to design and build factory infrastructure and automation for NVIDIA Inference Microservices (NIMs). The ideal candidate will bring deep technical expertise to optimize and validate AI models for best-in-class performance and accuracy across various deployment scenarios.

Responsibilities

• Develop a factory pipeline to transform AI models into deployable services validated across Cloud, On-prem, and Kubernetes environments.
• Collaborate with the team to define and deliver rapid iterations on technical strategies and roadmaps.
• Design interfaces, data modeling, and schema design for the factory pipeline and its compute infrastructure.
• Expand observability over the factory pipeline and its compute infrastructure.
• Define metrics and drive improvements based on user feedback.
• Mentor and collaborate with the team to grow your colleagues and yourself.

Requirements

• A history of using advanced programming skills to build distributed and compute systems, backend services, microservices, and cloud technologies.
• Effective experience working with multi-functional teams, principals, and architects across organizational boundaries.
• Deep technical expertise in distributed containerized applications using Docker, Kubernetes, Cloud Endpoints, Helm, and Prometheus.
• Passion for building rich, microservice applications and their build and test automation pipelines.
• Excellent interpersonal skills and the ability to lead multi-functional efforts.
• Proven experience debugging and analyzing the performance of distributed microservices or cloud systems.
• Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field (or equivalent experience).
• 8+ years of demonstrated experience developing performant microservices, cloud software, and/or tooling roles.

Qualifications

• Experience delivering event-driven applications using services like Temporal, Kafka, Redis, or others.
• Experience building and deploying containers for microservices, cloud, and on-prem deployments, and their associated CI/CD pipelines.
• Experience working with large-scale full-stack development.

Skills

• Advanced programming skills in distributed and compute systems.
• Experience with multi-functional teams and architectural leadership.
• Expertise in distributed containerized applications.
• Passion for building rich, microservice applications and their build and test automation pipelines.
• Strong interpersonal and leadership skills.
• Experience with debugging and analyzing distributed microservices or cloud systems.

Benefits

NVIDIA offers competitive compensation, including a base salary range of $168,000 - $270,250 for Level 4 and $200,000 - $322,000 for Level 5, along with equity and benefits.

Pay

Base salary range: $168,000 - $270,250 for Level 4, and $200,000 - $322,000 for Level 5.

Schedule

Full-time position.

Benefits

• Competitive compensation package including base salary, equity, and benefits.
• Flexible work arrangements.
• Health, dental, and vision insurance.
• Retirement savings plans.
• Professional development opportunities.
• Employee referral program.

How to stand out

• Experience with AI tools in recruiting processes.
• History of building and deploying containers for microservices, cloud, and on-prem deployments.
• Proven experience with large-scale full-stack development.
• Experience with Temporal, Kafka, Redis, or other event-driven applications.