Senior Data Engineer

About the role

The Data & Engineering Division within the Department of Information Technology (DIT) executes and modernizes data and engineering functions, building a scalable data platform and reliable, secure systems. The incumbent in this position is responsible for strategizing, designing and maintaining County wide systems and applications. This position reports directly to the Deputy Director of Data & Engineering.

Allegheny County manages a wide range of programs and services for residents, including public safety, health, public works, parks, and economic development. The Department of Information Technology is modernizing its data storage and integration, moving toward an agile hybrid model that brings robust master data management and seamless software integration to the County. Contribute directly to strategic priorities, harness data analytics to drive impactful process improvements, and play a key role in shaping the future of public services. We are seeking applicants ready to grow their skills and make a difference, and help lead Allegheny County's data-driven initiatives. Join an innovative team where Data Engineers are empowered to drive transformation within the County.

Responsibilities

• Works closely with stakeholders to understand data-related needs and opportunities.
• Develops Extract, Transform, Load (ETL) pipelines in Airflow that provide accurate and reliable data for County users.
• Documents County data sources, workflows, integrations and endpoints.
• Partners with Data-Stewards to prepare and maintain datasets for the Western PA Regional Data Center, the County’s open data portal.
• Assists Data Analysts with their data needs.
• Perform other tasks and duties as requested or required.

Requirements

• Bachelor’s degree from a fully accredited institution.
• Four (4) years of full-time work experience in data engineering.
• Additional experience in Data Analytics, Software Development or Business Intelligence is beneficial.
• Additional education may be substituted for work experience.
• An equivalent combination of education and experience is acceptable.
• Residency: Allegheny County within 1 year.
• Veterans' Preference: Will be awarded to eligible candidates.
• Candidates must successfully pass a background check, which includes verification of Allegheny County Real Estate Tax status.

Skills

Knowledge of:

• General programming skills.
• Data cleaning and manipulation techniques, in Python, SQL and R.
• Reporting systems & tools.
• Version control systems, including managing repositories, branching, and committing code.
• Configuration and utilization of common data sources.
• Building and deploying Docker images.
• Cloud technologies and hosting platforms.

Skill in:

• Linux (Ubuntu), Python, SQL, and R.
• Reporting systems & tools.
• Git, GitHub and additional platforms, e.g. integrated development environments (IDEs).
• MS SQL Server, Oracle, and application programming interfaces (API’s).
• Docker.
• Azure.
• Microsoft Office Suite including Microsoft CoPilot.
• Generative AI systems, e.g. Claude AI.

Ability to:

• Research best practices for the delivery of County ETL, data services and local implementation issues.
• Assess data infrastructure, discover anomalies, and iteratively refine analysis and documentation based on feedback from the Data &