Senior Deep Learning Performance Architect

About the role

NVIDIA is seeking a Senior Deep Learning Performance Architect to lead the development of innovative architectures that accelerate AI and high-performance computing applications.

Responsibilities

• Develop innovative architectures to extend the state of the art in deep learning performance and efficiency
• Analyze performance, cost and power trade-offs by developing analytical models, simulators and test suites
• Understand and analyze the interplay of hardware and software architectures on future algorithms, programming models and applications
• Develop, analyze, and harness groundbreaking Deep Learning frameworks, libraries, and compilers
• Actively collaborate with software, product and research teams to guide the direction of deep learning HW and SW

Requirements

• MS or PhD in Computer Science, Computer Engineering, Electrical Engineering or equivalent experience
• 6+ years of meaningful work experience
• Strong background in GPU or Deep Learning ASIC architecture for training and/or inference
• Experience with performance modeling, architecture simulation, profiling, and analysis
• Solid foundation in machine learning and deep learning
• Strong programming skills in Python, C, C++

Qualifications

• Background with deep neural network training, inference and optimization in leading frameworks (e.g. Pytorch, JAX, TensorRT)
• Experience with relevant libraries, compilers, and languages - CUDNN, CUBLAS, CUTLASS, MLIR, Triton, CUDA, OpenCL
• Experience with the architecture of or workload analysis on other DL accelerators
• Demonstration of self-motivation, with a knack for critical thinking and thinking outside the box

Skills

• Self-motivated and able to think critically and creatively
• Strong understanding of machine learning and deep learning concepts
• Experience with GPU or Deep Learning ASIC architecture
• Experience with performance modeling, architecture simulation, profiling, and analysis
• Experience with relevant libraries, compilers, and languages

Benefits

• Competitive base salary ranging from $184,000 to $287,500 for Level 4, and $224,000 to $356,500 for Level 5
• Equity and benefits package

Pay

• Base salary range: $184,000 - $287,500 for Level 4, and $224,000 - $356,500 for Level 5

Schedule

• Full-time position