Lead Site Reliability Engineer
M&T Bank · Buffalo, NY · 2 days ago
Engineering$116k–$194k/yrFull-time
Primary Responsibilities
- Design, implement, and support highly available, scalable, and resilient applications and cloud infrastructure following enterprise technology standards and SRE best practices.
- Lead initiatives to improve system reliability, availability, performance, and operational maturity through automation and engineering excellence.
- Define, implement, and monitor Service Level Objectives (SLOs), Service Level Indicators (SLIs), and error budgets for critical business services.
- Develop comprehensive observability strategies leveraging Dynatrace, OpenTelemetry (OTel), distributed tracing, metrics, logging, dashboards, and alerting solutions.
- Design and maintain end-to-end monitoring solutions that provide actionable insights into application, infrastructure, and customer experience health.
- Analyze production telemetry to proactively identify performance bottlenecks, reliability risks, and capacity constraints.
- Lead incident response activities for high-severity production events, coordinating cross-functional teams to restore services and minimize customer impact.
- Perform and facilitate Root Cause Analysis (RCA) activities, ensuring corrective and preventive actions are identified, prioritized, and implemented.
- Drive operational excellence through automation of repetitive tasks, operational workflows, deployments, recovery procedures, and reliability controls.
- Partner with development teams to build reliable and observable services throughout the Software Development Lifecycle (SDLC).
- Design, develop, and execute automated regression testing strategies to validate application stability, reliability, and performance following deployments and infrastructure changes.
- Review test coverage and reliability validation approaches to ensure comprehensive testing and risk mitigation.
- Create, maintain, and improve Infrastructure as Code (IaC) solutions using Terraform for cloud infrastructure provisioning, configuration management, and environment standardization.
- Support and optimize Microsoft Azure environments, including Azure App Services, resource management, scaling strategies, deployment automation, and application lifecycle management.
- Utilize Azure-native tools such as Azure Monitor, Application Insights, Log Analytics, and related services to improve platform visibility and reliability.
- Drive implementation of performance testing, resiliency testing, fault tolerance validation, and disaster recovery preparedness within assigned domains.
- Establish operational readiness standards and ensure applications meet reliability, scalability, observability, and supportability requirements before production deployment.
- Review architectural designs and provide recommendations to improve platform resiliency, operational efficiency, and cloud optimization.
- Lead capacity planning, performance tuning, and workload optimization efforts across production environments.
- Develop and maintain operational runbooks, incident playbooks, knowledge articles, and standard operating procedures.
- Serve as a key partner with engineering, infrastructure, cybersecurity, architecture, and support teams to identify and implement continuous process improvements spanning organizational boundaries.
- Communicate system health, reliability trends, operational risks, and remediation strategies to technical and business stakeholders.
- Present reliability initiatives, operational metrics, and engineering recommendations at architecture reviews, technical forums, and leadership meetings.
- Mentor engineers on observability, cloud engineering, automation, SRE principles, and operational best practices.
Scope Of Responsibilities
- No supervisory responsibilities. May provide technical leadership, mentorship, and guidance to engineers and project teams.
Education And Experience
- Required: Associate’s degree and a minimum of 7 years’ systems analysis and/or application development work experience, or Bachelor's degree and a minimum of 5 years' systems analysis and/or application development work experience. In lieu of a degree, a combined minimum of 9 year’s education and/or relevant work experience, including a minimum of 5 years’ system analysis and/or application development work experience.
- Preferred: Experience supporting large-scale enterprise applications in regulated environments. Strong analytical and troubleshooting skills related to production systems and distributed architectures. Experience working in Agile and DevOps operating models. Ability to work autonomously and lead complex reliability initiatives. Strong organizational and time management skills. Advanced verbal and written communication skills. Experience driving project milestones and delivery commitments. Proven experience leading major incident response and post-incident improvement efforts. Experience partnering with architecture, infrastructure, cybersecurity, and application development teams. Experience with scripting and automation using PowerShell, Python, Bash, or similar technologies. Industry certifications in Azure, Terraform, Cloud Engineering, or Site Reliability Engineering preferred.
Pay Range
The pay range for this position is $116,400.00 - $194,000.00 Annual (USD). The successful candidate’s particular combination of knowledge, skills, and experience will inform their specific compensation.