Senior Staff Software Engineer - AI Agent Platform

About the role

We are looking for a Senior Engineer to design, build, and scale the infrastructure powering NVIDIA’s AI agent ecosystem. You will work at the intersection of distributed systems, developer platforms, and agentic AI — building the foundational services that enable teams across the company to develop, deploy, orchestrate, and operate autonomous AI agents at production scale.

Responsibilities

• Build and develop platform services that own the full agent lifecycle from registration through deployment, execution, and teardown
• Architect Kubernetes-based execution environments with pod lifecycle management, namespace isolation, persistent storage, and identity propagation
• Develop and maintain automated CI/CD pipelines using GitLab CI and ArgoCD, including reusable pipeline templates and deployment blueprints that standardize how agents are built across teams
• Build and operate Kafka-based message pipelines and real-time event streaming using Redis PubSub and SSE
• Implement data ingestion pipelines, access interfaces, and storage layers that power AI agent knowledge and context
• Develop multi-layer auth using OAuth 2.0, JWT validation, token exchange, and gateway integration, and manage secrets lifecycle with Vault (provisioning, rotation, container injection)
• Partner with security teams on compliance, access controls, and approval workflows for agent operations

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or related field (or equivalent experience), with 12+ years in software engineering — ideally in platform engineering, infrastructure, or developer tools
• Experience building and scaling AI agents in production using frameworks like Claude Code, Codex, or LangGraph
• Deep Kubernetes expertise including pod orchestration, persistent storage, RBAC, and multi-cluster management
• Strong Python skills with production API experience using FastAPI, Flask, or similar async frameworks
• Expertise building and managing robust CI/CD pipelines using GitLab CI and ArgoCD for continuous delivery to Kubernetes
• Experience designing AI data platform components (ingestion pipelines, vector stores, retrieval APIs, data preprocessing workflows) and building developer-facing platform APIs consumed by multiple engineering teams
• Solid grasp of auth and identity: OAuth 2.0, JWT, token exchange, and secrets management with Vault
• History of leading sophisticated technical projects such as migrations or greenfield platform builds, with strong interpersonal skills to drive alignment across teams and write clear design documents

Qualifications

• Experience building or operating AI agent platforms or agentic workflow systems, with hands-on expertise in agent protocols and frameworks like MCP, A2A, LangChain, or LangGraph
• Hands-on experience with RAG architectures, embedding pipelines, and vector databases (Milvus, Pinecone, or Weaviate)
• Full-stack skills with React or Vue for building developer portals and dashboards
• Contributions to open-source infrastructure or platform tooling

Skills

• Experience with distributed systems, including Kafka, Redis, and MongoDB or PostgreSQL
• Knowledge of Kubernetes, GitLab CI, ArgoCD, and CI/CD pipelines
• Proficiency in Python, FastAPI, Flask, and async frameworks
• Understanding of authentication and identity management, including OAuth 2.0, JWT, token exchange, and secrets management with Vault
• Experience with AI data platform components and developer-facing platform APIs
• Ability to lead complex technical projects and communicate effectively with cross-functional teams

Benefits

• Competitive base salary ranging from $200,000 to $322,000 for Level 5, and $248,000 to $391,000 for Level 6
• Eligibility for equity and benefits

Pay

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is $200,000 - $322,000 for Level 5, and $248,000 - $391,000 for Level 6.

Schedule

This posting is for an existing vacancy. Applications for this job will be accepted at least until July 26, 2026.