DevOps / Observability Engineer

Location: Remote (US) – Long-term engagement

About the role

Design and implement a unified observability pipeline leveraging OpenTelemetry, Prometheus, Grafana, and Splunk on AWS infrastructure. The work includes deploying and configuring both open-source and third-party tools on a Kubernetes-based “Golden Cluster.”

Responsibilities

• Design a unified observability pipeline
• Create a cross-account log aggregation and noise-reduction strategy
• Implement OpenTelemetry Collector, Prometheus, and Grafana on the Golden Cluster
• Configure Splunk HEC integration and CloudTrail centralization
• Enable VPC Flow Logs across all VPCs
• Design and implement an alerting framework
• Build operational dashboards in Grafana and CloudWatch
• Design a log-retention strategy with S3 lifecycle policies
• Deploy EC2 infrastructure for Splunk and Abbyy

Required Skills

• OpenTelemetry Collector deployment, OTLP, processors, exporters
• Prometheus deployment, PromQL, ServiceMonitors
• Grafana dashboard development, data sources, SSO
• CloudWatch Logs, Metrics, Alarms, cross-account
• CloudTrail multi-account, organization trail
• Splunk HEC integration, log shipping
• Alertmanager routing, receivers
• Terraform observability stack modules
• Log management at scale (TB/day) preferred