Principal Site Reliability Engineer - AI Infrastructure Operations

About the role

Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Our mission is to enable AI-focused companies to achieve superior results by reducing the complexity of AI development. We enable our customers to manage costs, innovate rapidly, and prioritize environmental responsibility. Our culture is one of relentless innovation, ownership, and accountability, where every team member contributes to building the technology that powers the future.

Responsibilities

• Owning and evolving the long-term reliability strategy for Nscale’s AI and HPC infrastructure
• Designing and leading the development of large-scale control-plane systems, automation frameworks, and operational tooling
• Defining reliability standards, SLO frameworks, and operational best practices used across multiple teams
• Acting as a senior technical escalation point during critical incidents, guiding resolution and ensuring systemic fixes
• Identifying structural reliability risks and driving cross-functional initiatives to address them at the architectural level
• Partnering with Engineering, Network Operations, and Fleet Operations leadership to influence platform design and operational maturity
• Mentoring senior and mid-level engineers, raising the overall quality and effectiveness of SRE practices
• Driving measurable improvements in availability, MTTR, cost efficiency, and operational scalability

Requirements

• 10+ years of experience in Site Reliability Engineering, Systems Engineering, or Software Engineering roles operating complex, large-scale infrastructure
• Expert-level software engineering skills, with a strong track record of building production-grade automation and systems
• Deep expertise in Linux, networking, and distributed systems design at scale
• Extensive experience debugging and resolving failures across hardware, OS, networking, and application layers
• Proven ability to lead technical initiatives across teams without direct authority
• Strong systems-thinking mindset, with the ability to balance reliability, velocity, and cost

Qualifications

• Deep hands-on experience with AI or HPC platforms, including GPUs, high-speed interconnects (InfiniBand/RDMA), and workload schedulers (e.g. SLURM)
• Experience designing observability systems for high-cardinality, high-throughput environments
• Familiarity with Kubernetes at scale and hybrid or bare-metal cloud architectures
• A history of driving step-change improvements in reliability, scalability, or operational efficiency

Skills

• Linux, Networking, Distributed Systems Design
• Debugging and Resolving Failures
• Systems Thinking
• Observability Systems Design
• Kubernetes at Scale
• Hybrid or Bare-Metal Cloud Architectures
• Reliability, Scalability, Operational Efficiency Improvements

Benefits

At Nscale, you'll find a collaborative, supportive, and innovative environment where your contributions spark real impact. We're building something extraordinary, and we want you at the core. Highly competitive package (base + equity) with reviews every 12 months. 🚀Join the fastest-growing tech startup, your chance to push boundaries, collaborate with brilliant minds, and make your mark on cutting-edge AI. ✨

Pay

$150,000 USD - $2,150,000 USD

Schedule

Remote-first

Equal Opportunity Statement

We strongly encourage applications from people of colour, the LGBTQ+ community, people with disabilities, neurodivergent people, parents, carers, and people from lower socio-economic backgrounds. If there’s anything we can do to accommodate your specific situation, please let us know.