Senior Software Engineer, Infrastructure ($160k-$250k + Equity) at well-funded AI video platform

This is a job that Jill, our AI Recruiter, is recruiting for on behalf of one of our customers. She will pick the best candidates from Jack's network. The next step is to speak to Jack.

About the role

• Own the core infrastructure for a cutting-edge real-time AI video interface that operates at sub-second latency levels globally.
• Join a well-funded Series B startup backed by top-tier VCs, operating with a small, high-impact team of roughly 40 people.
• Work at the intersection of infrastructure and research, directly influencing how conversational AI humans are deployed and experienced.

Responsibilities

• Design and manage multi-region GPU deployments across various providers to ensure reliable, high-performance inference.
• Architect EKS clusters including custom routing and scheduling logic to optimize workload placement across a global GPU fleet.
• Collaborate with researchers to optimize CUDA hot paths and reduce cold-start times for live, face-to-face AI conversations.

Requirements

• Possesses hands-on experience deploying and optimizing large-scale GPU inference workloads on cloud providers like CoreWeave or AWS.
• Demonstrates deep expertise in Kubernetes and EKS, specifically regarding complex service routing and cluster management at scale.
• Proven track record of senior technical leadership, taking ownership of ambiguous infrastructure challenges and delivering production-ready solutions.

Qualifications

• Experience with real-time AI systems and sub-second latency requirements.
• Strong background in cloud infrastructure and Kubernetes.
• Ability to work independently and lead complex projects.

Skills

• Proficiency in CUDA and other GPU programming languages.
• Experience with distributed systems and microservices architecture.
• Excellent problem-solving and analytical skills.

Benefits

• Competitive salary range of $160k-$250k plus equity.
• Opportunity to work on cutting-edge technology in the AI industry.
• Flexible remote work option available.

Pay

• $160k - $250k

Schedule

• Remote work option available.