Senior Product Architect, K8s-Based AI Infrastructure

About the role

As a Product Architect at NVIDIA, you'll be the linchpin in transforming ideas into well-defined, functional products, balancing technical feasibility with user needs and market demands. You'll design and oversee the development of cutting-edge AI solutions from conception through their entire lifecycle, shaping the architectures that connect the world’s most powerful AI clusters.

Responsibilities

• Stay at the forefront of technology trends in AI Infrastructure & Agentic AI, proposing new product concepts
• Define detailed product architectures, including performance, scalability, interoperability, and datacenter deployment requirements
• Lead prototyping and testing processes to validate product design and functionality, with a focus on scale, diagnosing bottlenecks and driving innovations in performance
• Iterate and refine designs based on feedback, testing results, and evolving requirements
• Collaborate with internal hardware, software, security, and systems teams to ensure flawless integration of networking, compute, and storage ecosystems
• Work closely with partners and customers to conceptualize ideal solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs) that demonstrate your vision
• Provide comprehensive documentation for product designs, including technical specifications and user guides
• Develop targeted content such as whitepapers, blogs, and curriculum for customers, partners, and users

Requirements

• 8+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent
• Bachelors degree in computer science or related field (or equivalent experience)
• Strong background in technologies that enable large-scale infrastructure management of complex systems, networks, and storage
• Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments
• Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large-scale training & fine-tuning, and model evaluation
• Exceptional communication skills, with the ability to translate complex technical details for diverse audiences
• A passion for staying updated with the latest technological advancements in AI and related fields

Skills

• Prior first-hand experience building large-scale AI infrastructure
• Advanced certifications or publications in AI, deep learning, or related fields
• Experience leading high-impact projects or initiatives in cutting-edge tech domains

Pay

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits.