Manager ETL

Main Functions

The Manager, on-prem and Cloud ETL (Azure Data Integration) leads the strategy, delivery, and operational reliability of enterprise ETL/ELT pipelines across the Azure data ecosystem. This role manages a team of ETL developers (data engineers) responsible for ingesting, transforming, and integrating data to support analytics, reporting, and data science workloads. The role combines people leadership, technical oversight, and operational accountability, with a strong focus on modern, scalable, and secure Azure-native data integration as well as traditional SQL database management for our on-premises legacy architecture.

Leverage Azure

Azure-Focused ETL & Data Engineering: Architect and oversee ETL/ELT solutions using Azure Data Factory (ADF), Fabric Data Factory (FDF), Azure Synapse Pipelines, Fabric Pipelines, and other Azure data services. Modernize legacy ETL platforms (existing on-prem SSIS) into cloud-native pipelines. Implement ingestion frameworks for structured, semi-structured (JSON, XML, .csv), and unstructured data. Work with the Analytics and Reporting team to optimize pipeline performance, reliability, and cost monitoring/management using Azure Monitor, Log Analytics, and cost management tools. Ensure pipelines follow cloud engineering best practices including parallelization, metadata-driven orchestration, and parameterization.

Data Quality, Governance & Security

Data Quality, Governance & Security: Implement data validation, monitoring, and automated quality checks inside the ETL pipelines. Ensure ETL pipelines operationalize and comply with enterprise data governance, lineage, and metadata standards. Work with security to enforce Azure Role Based Access Control, managed identities, encryption, and network security principles. Maintain data privacy compliance (PII handling, data masking, retention policies).

Operational Excellence

Operational Excellence: Oversee daily operation of cloud ETL pipelines, including scheduling, monitoring, and incident management. Maintain and continuously improve SLAs for data availability, timeliness, and pipeline reliability, including proactive reduction of failures, reprocessing time, and operational incidents. Implement CI/CD for ETL code using Azure DevOps Repos and Pipelines. Drive automation to reduce manual operations and improve pipeline recoverability.

Cross-Functional Collaboration

Cross-Functional Collaboration: Work with analytics, reporting, data science, and application teams to understand their data needs and design scalable solutions. Coordinate with business stakeholders to prioritize work based on enterprise value. Provide technical guidance on integrating new systems and onboarding new data sources.