Senior Site Reliability Engineer (Remote USA)

Why Work With Us

Company-sponsored training and development opportunities
Comprehensive benefits package (health, dental, vision, wellness, 401K Matching, annual fitness reimbursement)
Flexible vacation policy
Community involvement opportunities through charitable alliances: https://www.techinsights.com/community-involvement
Wellness resources and support
Inclusive environment that prioritizes diversity, equity, and accessibility
High-growth company driven by high performance

The Opportunity

Our next chapter is an AI-first intelligence platform running the most demanding semiconductor intelligence workflows. We're looking for a Senior Site Reliability Engineer to own the reliability foundation.

What You’ll Do

• Platform Reliability & AI Operations
• Own SLOs, SLIs, and error budgets for all production services; drive error budget discipline across engineering
• Design reliability patterns for AI agent pipelines: LLM observability, tool-use tracking, failure detection, and graceful degradation
• Architect for blast radius containment — agent failures must have bounded customer impact through isolation, circuit breaking, and rapid recovery
• Mature our Canada Central/West active-active architecture toward 24-hour RTO with full regional failover
• Lead incident response and post-incident reviews that produce durable fixes; maintain DR procedures through regular testing
• Developer & AI Engineering Enablement
• Serve as the primary reliability liaison to Software and AI Engineering, translating requirements into actionable standards
• Partner with AI Engineering on compute provisioning, model serving, inference latency, and workload isolation
• Own CI/CD pipeline strategy (Bitbucket Pipelines, GitHub Actions) — set standards, optimize deployment frequency, and ensure teams can ship confidently
• Drive IDP adoption and enable teams on SRE practices: on-call readiness, SLO definition, runbook development, and self-service tooling
• Represent reliability in architectural discussions; surface risk before it's committed to design
• Observability, IDP & Service Catalog
• Own the service catalog — a living inventory of all services, AI agents, dependencies, ownership, and SLOs
• Extend observability to AI workloads: LLM latency, token consumption, agent completion rates, and pipeline throughput
• Build golden path templates in Backstage and/or Atlassian Compass so teams ship reliably without routine SRE involvement
• Apply AIOps in Datadog to automate anomaly detection, incident triage, and remediation recommendations
• FinOps, IaC & Continuous Improvement
• Own infrastructure as code via Terraform and GitOps; enforce IaC policy in partnership with Trust Assurance
• Own FinOps visibility into AWS cost segments; model cloud cost impact as AI/ML workloads scale
• Formally mentor junior and intermediate SRE engineers, with accountability for their technical growth and career progression
• Build AI-assisted automation to progressively reduce toil and scale the team's operational capacity

What You’ll Bring

• Technical Requirements
• Bachelor's degree in Computer Science, Engineering, or equivalent combination of education and experience
• 6–8 years of progressive experience in site reliability engineering, platform engineering, or DevOps, with demonstrated technical leadership at the senior individual contributor level
• Deep expertise in AWS (EKS, Lambda, CloudWatch, AWS Config)
• Proficiency with Terraform and GitOps; experience with policy-as-code (Sentinel, OPA/Rego, or equivalent)
• Strong containerization expertise: Docker, Kubernetes (EKS preferred)
• Proficiency in Python and/or Bash; experience building operational tooling; solid understanding of Java and Spring Boot microservice architecture sufficient to make reliability and deployment decisions for EKS-hosted services
• Familiarity with IDP tooling (Backstage, Atlassian Compass, or equivalent) strongly preferred
• Experience with AI/ML workload infrastructure, LLM API integration, or agentic system operations considered a strong asset
• Professional Skills
• Leads and owns strategic reliability initiatives end-to-end with a high degree of autonomy; accountable for outcomes, not just tasks
• Sets technical direction and influences team and department strategy
• Solves complex, ambiguous reliability problems through systematic analysis and first-principles thinking
• Formally mentors junior and intermediate engineers; builds team capability through coaching and knowledge transfer
• Communicates technical reliability concepts clearly to engineering, product, and leadership audiences
• Approaches operational work with an AI-first posture: builds automation and intelligent tooling as the default

Preferred Qualifications

• Experience designing reliability architecture for agentic AI systems: agent loop observability, blast radius isolation, graceful degradation for LLM-dependent services
• AWS certifications: Solutions Architect Professional, DevOps Engineer Professional, or equivalent
• FinOps Certified Practitioner or demonstrated cloud cost management experience at scale
• IDP implementation or developer experience program leadership
• Experience in semiconductor, SaaS, or data-intensive platform environments
• Experience operating in environments with export-controlled or regulated data
• Knowledge of BCP/DR program management and formal recovery testing