Principal Product Manager, AI Infrastructure and Orchestration

About the role

This role will lead technical work focused on secure, reliable systems and risk-aware execution. You will work across engineering, product, operations, and business stakeholders to translate complex requirements into practical technology solutions. The position offers the opportunity to influence architecture, execution quality, and the technology capabilities that enable long-term growth within a technology-driven environment.

Location: Remote - US based candidates only, no visa sponsorship available.

Responsibilities

• Own the deployment and workload API including resource management and lifecycle semantics
• Determine workload placement and capacity management across nodes and accelerators
• Manage scaling strategies, including autoscaling and cost-latency trade-offs
• Oversee the agent runtime, ensuring state management and execution isolation
• Facilitate traffic routing and request-aware load balancing for agent endpoints
• Implement governance and audit mechanisms for deployment tracking
• Manage metering and packaging of inference measurements and tenant quotas
• Ensure reliability and define SLOs for operational diagnostics

Qualifications

• 6+ years in product management for infrastructure or cloud services, 3+ years with Kubernetes or distributed systems
• Deep understanding of GPU behavior including topology-aware placement and memory constraints
• Expertise in Kubernetes API server, scheduling, and resource management
• Experience with multi-tenancy and security compliance
• Prior ownership of a public or platform API
• Strong technical writing and prototyping skills
• Comfortable working in a matrixed team environment without direct reports
• BS or MS in Computer Science or related technical field, or equivalent experience

Pay

$150,000 – $180,000 annually

Benefits

• Medical, Dental & Vision Insurance
• Flexible Time Off Program
• Paid Holidays
• Paid Parental Leave
• Global Employee Assistance Program (EAP)