DirectJobHub
Jobs · Engineering · California

Distinguished Software Architect - Deep Learning and HPC Communications

NVIDIA · Santa Clara, CA · 3 wk ago
EngineeringFull-time

Job Summary

The GPU Communications Libraries and Networking team at NVIDIA is seeking a Distinguished Software Architect to co-design our next generation data center platforms. This role involves researching new communication technologies, designing new features for our communication libraries, proposing innovative solutions in hardware and software for our next-gen platforms, and driving the adoption of new communication technologies across application verticals.

Responsibilities

  • Research new communication technologies (e.g., expand the GPUDirect technology portfolio) and design new features for our communication libraries

  • Propose innovative solutions in HW and SW for our next-gen platforms. Co-design these solutions with the GPU, Networking, and SW architects and ensure seamless integration with the software stacks

  • Keep up with the latest DL research and collaborate with diverse teams (internal and external), including DL researchers, and customers

Requirements

  • PhD in Computer Science, Computer Engineering or related field or strong equivalent experience; 15+ years of relevant experience in academia or the industry

  • Expert in following areas: HPC, parallel programming models (MPI, SHMEM), at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC), computer and system architecture, GPU architecture and CUDA

  • Deep understanding of various aspects of high performance networking from prior work experience: network technologies (Infiniband, Ethernet), network design, network topologies, network debug and performance analysis

  • Strong in at least a few of these areas: ML/DL fundamentals and how they tie to communications, parallel algorithms, fault tolerance and resiliency, competitive assessments, performance analysis and optimizations for parallel applications on large clusters, developing applications using DL Frameworks (PyTorch, TensorFlow)

  • Programming fluency with C or C++ for systems software development

  • Flexibility to work and communicate effectively across different HW/SW teams and timezones

Qualifications

  • Industry recognized leader in HPC/DL communications with history of patents, publications and conference talks in relevant areas

  • Influential role in industry standards (e.g., MPI, OpenSHMEM) and open source software (e.g., PyTorch, UCX, Open MPI)

Benefits

NVIDIA offers a competitive base salary range of $320,000 - $488,750, along with equity and benefits. Applications for this position are accepted until July 7, 2026.

Similar jobs