Senior Data Engineer

Job Details

Responsibilities

• Technical Leadership
• Serve as a senior technical voice on the team — driving architecture decisions, establishing engineering standards, and leading design reviews
• Mentor and provide technical guidance to mid-level and junior engineers; participate in code review and raise overall team craft
• Identify and drive improvements to existing systems — performance, reliability, cost, and maintainability
• Pipeline & Platform Engineering
• Architect, build, and own complex ETL/ELT pipelines that ingest, transform, and deliver large-scale ad event, identity, and campaign data
• Design and optimize data models in Databricks (Delta Lake) and Snowflake for performance, cost efficiency, and downstream usability
• Build and operate real-time and event-driven data flows using Kafka, Kinesis, and AWS-native services (Glue, Lambda, S3, API Gateway)
• Implement CDC patterns and streaming ingestion to support low-latency analytics and operational data products
• Data Quality, Governance & Observability
• Build and maintain data quality frameworks, validation layers, and alerting pipelines using Datadog and Airflow/Astronomer
• Champion data governance standards — lineage, cataloging, access controls — within Unity Catalog and across the platform
• Ensure systems are well-documented, observable, and operationally sound
• Cross-Functional Collaboration
• Partner with data analysts, analytics engineers, and ML/data science teams to translate requirements into durable data products
• Collaborate with platform and infrastructure engineers on shared systems, pipeline dependencies, and cost optimization
• Interface with stakeholders to define data contracts, SLAs, and schema standards

Requirements

• 7+ years of hands-on data engineering experience, with depth in pipeline architecture, data modeling, and large-scale data systems
• Advanced proficiency in Databricks (Delta Lake, Unity Catalog, Workflows) and Snowflake
• Strong Python skills; Scala a plus
• Solid experience with AWS data services: Kinesis, S3, Glue, Lambda, API Gateway
• Experience with real-time / event-driven architectures (Kafka, Kinesis, or equivalent)
• Working knowledge of Airflow or Astronomer for orchestration
• Familiarity with Datadog or comparable observability tooling for data pipelines
• Demonstrated ability to own systems end-to-end — from design through production operations
• Strong communication skills; able to articulate technical tradeoffs to both engineering and non-engineering stakeholders

Nice to Have, But Not a Dealbreaker

• Experience in digital advertising, connected TV, or streaming media — ad delivery, identity graphs, audience segmentation, or campaign measurement
• Experience with identity resolution systems (UID2, HEM, or similar)
• CI/CD for data pipelines and infrastructure-as-code (CDK or Terraform)
• Familiarity with dbt or analytics engineering patterns
• Agile/Kanban experience in a data or platform engineering environment

Benefits

$143,000.00 - $170,000.00 annually. This role is also eligible for an annual discretionary bonus, various benefits, including medical/dental/vision, insurance, a 401(k) plan, paid time off, and other benefits in accordance with applicable plan documents. Benefits for Union represented employees will be in accordance with the applicable collective bargaining agreement.