Senior Software Engineer, Fleet Intelligence Backend

About the role

We are looking for a Senior Software Engineer to join our DGX Cloud / Fleet Intelligence team and build backend systems that power GPU health monitoring, telemetry ingestion, operational automation, and fleet visibility for NVIDIA’s high-performance GPU infrastructure.

Responsibilities

• Design and develop Go backend services, REST APIs, and data models for GPU Health and Fleet Intelligence.
• Build customer-facing and agent-facing APIs for compute zones, node groups, nodes, alerts, events, metrics, inventory, attestation, retention policies, and reports.
• Develop high-volume ingestion and persistence paths for in-band agents and out-of-band collectors.
• Work with Aurora PostgreSQL, Kafka/MSK, S3, SQS, Prometheus/AMP, and OpenTelemetry-based observability.
• Build and operate scheduled backend services for liveness tracking, alerting, rollups, cleanup, notification delivery, attestation, and XID analysis.
• Optimize database schemas, partitioned time-series storage, query performance, CTE-heavy queries, and connection pooling for reliable service behavior.
• Collaborate with agent, infrastructure, SRE, UI, and cloud operations teams to turn operational workflows into scalable backend systems.
• Improve service reliability, security, observability, testing, and deployment quality across Docker, Kubernetes, Helm, and cloud environments.

Requirements

• 5+ years of industry software engineering experience with a Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or equivalent experience.
• Strong Go backend development experience.
• Experience building REST APIs and production services using frameworks such as Gin or similar.
• Strong PostgreSQL experience, including schema design, query tuning, transactions, migrations, and operational data modeling.
• Experience with distributed systems, event pipelines, telemetry ingestion, or operational analytics.
• Experience with cloud infrastructure, Docker, Kubernetes, and Helm.
• Strong debugging skills across APIs, databases, cloud services, and production systems.
• Familiarity with authentication and authorization patterns such as JWT, service account keys, trusted-edge proxies, or customer-scoped APIs.
• Experience with Linux-based development and production environments.

Skills

• Background with telemetry, monitoring, observability, health, or fleet-management platforms.
• Experience with AWS services such as MSK, Aurora, S3, SQS, AMP, or CloudWatch.
• Experience with OpenTelemetry, Prometheus, LightStep, Grafana, or production tracing/metrics systems.
• Background with NVIDIA GPUs, DGX systems, DCGM, XID analysis, attestation, or AI datacenter operations.
• Experience designing APIs and storage systems that support real-time operational workflows at fleet scale.

Pay

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4. You will also be eligible for equity and benefits.