Data Engineer I
Center for Energy and Environment · Minneapolis, MN · 1 mo ago
Hybrid$83k–$87k/yrFull-time
About the role
Join Our Dynamic Technology Team We are looking for a Data Engineer to join our Technology team. As a Data Engineer, you will build and maintain data architecture and pipelines supporting various programs and initiatives across CEE, including automated data ingestion processes and dashboards. This role reports to the Director of Information Technologies and primarily focuses on ETL processes: extracting, cleaning, ingesting, and transforming data to meet Analysts' needs. This role will work collaboratively with other Data Engineers to support the Efficient Technologies Accelerator (ETA), as well as broader data needs across the organization.
Responsibilities
- Support the development and implementation of the team’s data architecture, including processes for managing, integrating, and maintaining datasets provided by external partners.
- Write, modify, and maintain Python ETL scripts and SQL data models to automate, scale, and optimize data processing workflows.
- Build and maintain repeatable processes to combine raw data from multiple sources into clean, searchable datasets housed in cloud data warehouses.
- Develop, maintain, and monitor automated data workflows using Prefect or similar workflow orchestration tools, including scheduling, task dependencies, error handling, and troubleshooting.
- Develop and implement data validation and QA/QC processes to monitor data integrity, identify discrepancies, and improve data quality.
- Troubleshoot and resolve issues across data pipelines and ETL, investigate discrepancies, and work with team members to identify and implement solutions.
- Work closely with Energy and Data Analysts to build and enhance data solutions, including interactive dashboards using tools such as Plotly Dash and