Jobs · Engineering · California

NCX Engineer, AI Accelerator

NVIDIA · Santa Clara, CA · 1 mo ago
EngineeringFull-time

About the role

NVIDIA is seeking an NCX Engineer, AI Accelerator to join our AI Accelerator team. This role involves collaborating closely with strategic customers to implement and enhance groundbreaking AI workloads. You will deliver hands-on technical assistance for advanced AI deployments, intricate distributed systems, and ensure customers realize efficient performance from NVIDIA's AI platform across varied environments.

Responsibilities

  • Develop innovative solutions that advance AI infrastructure capabilities.
  • Influence customer success with breakthrough AI initiatives.
  • Build and deploy custom AI solutions on NCP and Neo Cloud platforms, including distributed training, inference optimization, and MLOps pipelines constructed on NVIDIA reference architectures.
  • Act as the main technical contact for strategic NCPs, offering remote and on-site support, troubleshooting complex production problems, and guiding partner engineering teams on NVIDIA platform guidelines.
  • Deploy and manage AI workloads across DGX Cloud, NCP data centers, and major CSP environments using Kubernetes, containers, and GPU scheduling systems aligned to NCP builds.
  • Profile and tune large-scale training and inference workloads on NCP platforms. Implement observability and SLO/SLA monitoring. Lead detailed efforts to reduce latency, cost, and operational risk.
  • Implement and expand NVIDIA reference architectures on partner platforms, develop integrations with partner control planes and customer environments, and ensure smooth API, data pipeline, and enterprise software connectivity.
  • Build detailed implementation guides, runbooks, and post-mortem documentation that codify standard methodologies for running NVIDIA AI workloads at scale on NCP platforms.

Requirements

  • BS, MS, or Ph.D. in Computer Science, Computer/Electrical Engineering, or a related technical field, or equivalent experience.
  • 8+ years of experience in customer facing technical roles such as Solutions Engineering, DevOps, Site Reliability, or ML Infrastructure Engineering, ideally supporting large-scale cloud or service provider environments.
  • Strong expertise in Linux systems, distributed computing, Kubernetes, containers, and GPU scheduling on multi-tenant or service-provider platforms.
  • Demonstrated AI/ML experience supporting large-scale training and inference workloads (e.g., LLMs, generative models, recommendation systems) in production or critically important environments.
  • Solid programming skills in Python/Go, with hands-on experience using frameworks such as PyTorch or TensorFlow for training and serving.
  • Demonstrated capability to collaborate with customer and partner engineering teams in fast-paced environments, guide intricate technical investigations, and bring issues to root cause and resolution.
  • Excellent communication and technical presentation skills, with the ability to clearly articulate architectures, trade-offs, and recommendations to both engineering and leadership audiences.

Qualifications

  • Experience with the NVIDIA ecosystem, including DGX systems, CUDA, NeMo, Triton, NIM, and NVIDIA networking technologies such as InfiniBand and RoCE.
  • Direct experience collaborating with NVIDIA Cloud Partners, hyperscale CSPs, or managed AI cloud platforms, including implementation of NVIDIA reference architectures for AI infrastructure.
  • Deep familiarity with MLOps and cloud-native practices: containerization, CI/CD pipelines, observability stacks (Prometheus, Grafana, OpenTelemetry), and GitOps workflows.
  • Background in infrastructure as code (Terraform, Ansible, or similar) for repeatable deployment and configuration of GPU-accelerated clusters and NCP building blocks.

Skills

  • Strong technical background in AI/ML, particularly in large-scale training and inference workloads.
  • Experience with distributed systems and cloud-native technologies.
  • Proficiency in Python/Go and experience with frameworks like PyTorch or TensorFlow.
  • Ability to work effectively in a fast-paced, collaborative environment.
  • Excellent communication and presentation skills.

Benefits

  • Competitive salaries and a generous benefits package.
  • Recognition as one of the technology world’s most desirable employers.
  • A commitment to fostering an inclusive work environment.

Pay

Base salary range: $184,000 - $287,500 for Level 4, and $224,000 - $356,500 for Level 5.

Schedule

Full-time position.

Application Instructions

Applications for this job will be accepted at least until June 1, 2026.

Similar jobs

AI Project Manager, CX

NiCEUnited States· 1 wk ago
RemoteInformation Technologyapply on boards.eu.greenhouse.io