Observability Platform Engineering Technical Lead

Fidelity Investments · Merrimack, NH · 1 wk ago

On-siteManagementFull-time

About the role

We are seeking a highly experienced, hands-on technical leader and platform builder. You will report to the engineering lead and will be responsible for delivering core platform capabilities within Fidelity’s Enterprise Observability Platform. You’ll own system architecture, observability, security, and delivery while collaborating closely with product owners and engineering teams.

Responsibilities

Design and implement highly scalable, fault-tolerant distributed systems and services that operate at large scale and low latency.
Lead the architecture and build of high-throughput data streaming pipelines (real-time/event streaming), including ingestion, processing, and durable storage.
Develop and own observability for systems: metrics, tracing, structured logging, dashboards, alerts and SLOs.
Implement application instrumentation and collaborate with platform teams to standardize telemetry and monitoring practices.
Use AWS native services (MSK, Lambda, ECS/EKS, EC2, S3, DynamoDB, RDS, IAM, CloudWatch, etc.) to deliver robust solutions.
Design and enforce secure networking and firewall architectures (VPCs, subnets, security groups, NACLs, load balancers, private endpoints).
Write production-quality code and tests in at least one major language (Python, Java, Go, or Node.js).
Own CI/CD pipelines and release automation.
Drive projects end-to-end: translate product requirements, create execution plans, identify risks, and coordinate across product, security, infra, and operations teams.
Mentor engineers, run design reviews, and improve team practices around reliability, scalability, and operability.

Requirements

Strong understanding of distributed systems fundamentals: consensus, partitioning, replication, consistency models, leader election, backpressure, and fault tolerance.

Demonstrated experience designing and operating highly available, highly scalable production systems.

Deep knowledge of observability: metrics, tracing, logging formats specially OpenTelemetry , alerting, and SLO/SLI design.

Solid networking knowledge: TCP/IP, load balancing, NAT, DNS, VPC design, security groups, firewalls, and TLS.

Proven experience building solutions using AWS native services (design patterns and tradeoffs).

Experience implementing application instrumentation libraries and sidecars; familiarity with sampling, tagging, and context propagation.

Experience with building real-time/high-speed streaming pipelines capable of processing large volumes of data; familiarity with Kafka, Kinesis, Flink, Spark Streaming, or similar.

Hands-on coding: able to implement, debug, and ship production code; strong test discipline and experience with CI/CD.

Experience with building containerized applications using Docker and container orchestration (Kubernetes/EKS).

Excellent written and verbal communication; able to drive projects with product managers and stakeholders.

Nice-to-have: Experience with observability platforms like Grafana, Prometheus, Datadog, or Splunk.

Background in performance tuning, JVM internals, or low-latency systems.

Experience with infrastructure-as-code (Terraform, CloudFormation).

Experience building multi-region or global systems.

Qualifications