Principal Resiliency Engineer

The Role

We are seeking a Principal Reliability Engineer to join our Reliability Architecture team.

Responsibilities

• Build and deploy prototype applications that showcase observability capabilities across hybrid environments (on-premises, AWS, Azure, SaaS).
• Conduct rigorous testing with simulated disruptions, environmental failures, and performance scenarios to validate proposed observability standards.
• Collaborate with platform teams, application owners, and external vendors to integrate observability into real workloads.
• Produce runbooks, configuration guides, architectural patterns, reusable dashboards, and findings to support enterprise enablement and scale.
• Provide feedback and technical insight to IT Architecture leadership and teams to influence enterprise strategy.
• Conduct technical evaluations of proposed standards for observability visualization, distributed tracing, enterprise logging, metrics operations, open standards adoption, event correlation, and alerting notification.
• Host sprint retrospectives and demos for engineering, business, and executive stakeholders to validate and promote adoption.

Qualifications

• Minimum of 8 years in distributed application design and implementation
• Bachelor’s degree in computer engineering or equivalent experience
• 5+ years in enterprise Java technologies and open standards
• 5+ years in infrastructure, networking, middleware, and database architecture
• 5+ years in highly available architecture and disaster recovery
• 3+ years in containers and cloud-based solution delivery
• Strong troubleshooting and performance analysis skills
• Java, Python, Bash, SQL
• CI/CD pipelines and automation frameworks (e.g., Jenkins, Selenium)
• OpenTelemetry, distributed tracing, metrics generation, logging
• Chaos engineering tools (e.g., Gremlin, AWS FIS)
• AWS and Azure cloud environments
• Infrastructure as Code (IaC), container orchestration, hybrid deployments

Benefits

Competitive compensation, including base pay and annual incentive
Comprehensive health and life insurance and well-being benefits, based on location
Pension / Retirement benefits
Paid Time Off and Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.

Pay and Schedule

DTCC offers a flexible/hybrid model of 3 days onsite and 2 days remote (onsite Tuesdays, Wednesdays and a third day unique to each team or employee).

Equal Opportunity Employer

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.