Sr. Engineer - SRE - AI

About the role

At Ally, we believe in fostering a supportive and inclusive environment where our people thrive. We are looking for a skilled SRE professional to join our team and contribute to the success of our AI agent ecosystem.

Responsibilities

• Define and enforce production readiness standards for AI-powered services
• Build and operate SRE agents for automated production readiness checks and incident response
• Instrument AI agent pipelines with structured logging and monitoring
• Own Dynatrace SLOs and manage error budgets
• Identify and address observability gaps in AI systems
• Lead post-incident reviews and drive systemic issue remediation
• Review PRs and designs for AI services against reliability anti-patterns

Requirements

• 3+ years of experience in SRE, platform engineering, or production operations
• Deep familiarity with SLO/SLI/error budget concepts
• Strong Python or TypeScript skills
• Familiarity with Anthropic Claude API or Claude Code
• Experience with distributed systems for observability
• Conducting post-incident reviews and systemic remediation

Qualifications

• 4+ years of experience preferred
• Financial services or highly regulated environment experience

Skills

• Writing and maintaining alerting rules and SLO definitions
• Understanding AI-specific failure modes and observability
• Collaborating with developers for reliability improvements
• Maintaining accurate and current runbooks

Benefits

Ally offers a comprehensive benefits package including:

• Time Away: 20 paid time off days + 11 holidays + 8 hours of volunteer time off
• Planning for the Future: 401K retirement savings plan with matching and company contributions, student loan pay downs, and 529 educational savings assistance programs
• Supporting Your Health & Well-being: flexible health and insurance options, employee and spouse/spouse/child life insurance, short- and long-term disability, and a total well-being program
• Building a Family: adoption, surrogacy, and fertility assistance, paid parental and caregiver leave, and dependent daycare discounts
• Work-Life Integration: employee assistance program, Weight Watchers® discounts, and other employee discount programs

Pay

Base Pay Range: $85,000 - $150,000 USD

Schedule

Work Schedule: Fully on-site, hybrid, or fully remote, with specific expectations communicated during the hiring process.