Principal Site Reliability Engineer - AI Infrastructure Operations

About the role

This is a senior, highly impactful role focused on setting reliability strategy, designing foundational systems, and driving cross-team improvements at scale. You will operate as a technical authority for reliability, automation, and operational architecture across Nscale’s GPU, network, and control-plane platforms.

What You'll Be Doing

• Owning and evolving the long-term reliability strategy for Nscale’s AI and HPC infrastructure
• Designing and leading the development of large-scale control-plane systems, automation frameworks, and operational tooling
• Defining reliability standards, SLO frameworks, and operational best practices used across multiple teams
• Acting as a senior technical escalation point during critical incidents, guiding resolution and ensuring systemic fixes
• Identifying structural reliability risks and driving cross-functional initiatives to address them at the architectural level
• Prioritizing and influencing platform design and operational maturity
• Mentoring senior and mid-level engineers, raising the overall quality and effectiveness of SRE practices
• Driving measurable improvements in availability, MTTR, cost efficiency, and operational scalability

About You

• 10+ years of experience in Site Reliability Engineering, Systems Engineering, or Software Engineering roles operating complex, large-scale infrastructure
• Expert-level software engineering skills, with a strong track record of building production-grade automation and systems
• Deep expertise in Linux, networking, and distributed systems design at scale
• Extensive experience debugging and resolving failures across hardware, OS, networking, and application layers
• Proven ability to lead technical initiatives across teams without direct authority
• Strong systems-thinking mindset, with the ability to balance reliability, velocity, and cost

Nice to Have

• Deep hands-on experience with AI or HPC platforms, including GPUs, high-speed interconnects (InfiniBand/RDMA), and workload schedulers (e.g. SLURM)
• Experience designing observability systems for high-cardinality, high-throughput environments
• Familiarity with Kubernetes at scale and hybrid or bare-metal cloud architectures
• A history of driving step-change improvements in reliability, scalability, or operational efficiency

What We Can Offer You

• Highly competitive package (base + equity) with reviews every 12 months
• Join the fastest-growing tech startup, your chance to push boundaries, collaborate with brilliant minds, and make your mark on cutting-edge AI
• Expect a dynamic progression plan tailored to your ambitions. Grow by trying new things, leading, challenging the status quo, and owning your impact, always with our full support
• Human-First Flexibility: We treat you as humans first. Empower you, wherever you work

Salary Range

$150,000 - $2,150,000 USD

Application Instructions

Apply for this job