Senior Observability AIOps engineer
TIAA · New York, NY · 2 wk ago
HybridEngineering$93k–$128k/yrFull-time
About the role
A hands-on senior engineer who bridges traditional observability, APM, and ITSM practices with modern AIOps and AI-driven operations, using Python-based automation and AI/LLM tooling to improve incident response and operational efficiency.
Responsibilities
- Engineering and integrating monitoring and observability platforms with enterprise systems
- Troubleshooting complex application and infrastructure issues
- Developing Python-based automation and API integrations
- Applying ITSM principles to monitoring, event, incident, problem, and change management
- Using AIOps capabilities to reduce alert noise and accelerate root-cause analysis
- Creating effective technical documentation and knowledge bases
- Working effectively with engineering, application, infrastructure, architecture, and operations teams
Requirements
Educational Requirements: Bachelor's Degree Preferred
Work Experience: 3+ Years Required; 5+ Years Preferred
Physical Requirements: Sedentary Work
Career Level: 7IC
Skills
Required Skills
- 3+ years of hands-on experience with Splunk (SPL, dashboards, alerts, data onboarding) as an Administrator, Power User, or Developer
- 3+ years of experience of IT Service Management practices — Incident, Problem, Change, Event, and Service Request Management tool using ServiceNow.
- 3+ years of experience administering a market-leading APM/observability platform (e.g., Splunk Cloud Observability/SignalFX, Dynatrace, Sysdig, Datadog), with solid understanding of metrics, logs, traces, and SLI/SLO/SLA concepts
- 3+ years of hands-on Python development skills for scripting, automation, API integration, and data processing; ability to write production-quality code independently
- Working knowledge of LLMs, Generative AI, AI agents, and AI-assisted troubleshooting/automation (e.g., RAG, prompt engineering, agentic AI concepts)
- Comfortable navigating and troubleshooting across both Linux and Windows environments in production/enterprise settings
Preferred Skills
- Experience with AIOps capabilities such as event correlation, noise reduction, and automated root-cause analysis