Observability Engineer

About the role

The role combines hands-on engineering with AIOps implementation to deliver full-stack visibility across 250+ services. You will lead efforts to implement predictive monitoring and self-healing capabilities that drive down operational costs while increasing system availability by leveraging AI to triage and resolve incidents. You will mentor and supervise engineers, own technical quality, and push the program toward AI-driven observability with opportunities to build new observability platforms from the ground up as we expand into new environments.

Responsibilities

• Architect and operate Dynatrace for full-stack observability, including agent deployment, distributed tracing, log management, synthetic monitoring, and digital experience monitoring.
• Implement AIOps workflows, including predictive alerting, anomaly detection, automated remediation, and incident automation.
• Build observability integrations, custom extensions, and infrastructure-as-code using Python, JavaScript, Node.js, and Terraform.
• Build operational and executive dashboards and implement SLOs and SLAs.
• Mentor engineers, conduct code reviews, and take accountability for technical delivery and quality.
• Work in Agile environments with sprint-based delivery.

Requirements

• 5+ years of experience in enterprise observability, monitoring, and site reliability engineering.
• Experience implementing AIOps workflows, including predictive alerting, anomaly detection, automated remediation, and incident automation.
• Experience building observability integrations, custom extensions, and infrastructure-as-code using Python, JavaScript, Node.js, and Terraform.
• Experience building operational and executive dashboards and implementing SLOs and SLAs.
• Experience working in Agile environments with sprint-based delivery.
• Knowledge of network monitoring protocols, including SNMP, SNMP traps, NetFlow, and Syslog.

Qualifications

• Bachelor's degree in a Computer Science or Information Technology field.

Skills

• Experience with ServiceNow Event Management, including event rules, alert management rules, alert correlation, threshold tuning, noise reduction, CMDB integration with CI relationships and dependencies, ITOM alignment, automated incident creation, Flow Designer, IntegrationHub, JavaScript, Glide API, HTML or CSS, ServiceNow platform architecture, and developing standardized onboarding processes for integrating new monitoring tools into Event Management with governance, segregation of duties, and compliance documentation.
• Experience with advanced Dynatrace platform capabilities, including Grail, Smartscape, Davis AI, OpenPipeline, DQL, Workflow Automation, Platform API, AppSec, Session Replay, Grail-powered RUM, AI Observability, and Grail log management.
• Experience deploying and building observability platforms from scratch in government cloud environments such as AWS GovCloud, Azure Government, or IL4/IL5, including air-gapped, restricted network, and STIG-hardened deployments.
• Experience building self-service onboarding portals for application team observability adoption.
• Experience with open-source observability tooling, including OpenTelemetry, Prometheus, Grafana, and ELK/EFK.
• Experience with FinOps practices, containerization, and cloud platforms such as AWS, Azure, or GCP.
• Experience operating Splunk and Splunk Enterprise Security (SIEM), Cribl, and SolarWinds at enterprise scale.
• Dynatrace Professional or Master Certification or ServiceNow Certified Implementation Specialist - Event Management (CIS-EM) Certification.

Benefits

Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits.

Pay

The projected compensation range for this position is $86,800.00 to $198,000.00 (annualized USD).

Schedule

Remote: If this position is listed as remote, there may still be occasions when you are required to work in person at a Booz Allen or customer facility.

Hybrid: If this position is listed as hybrid, you will be expected to work from a Booz Allen facility frequently, in alignment with leadership expectations and the needs of the role.

Onsite: If this position is listed as onsite, work will primarily be performed at a Booz Allen office or customer facility, where employees will collaborate directly with colleagues and customers as required by the role.