Azure Data Engineer
Location: Saint Paul, Minnesota (Remotely or Hybrid)
Duration: 10 months (Anticipated start: September 21, 2026 – Anticipated end: June 21, 2027)
About the Project
The Minnesota Department of Information Technology Services ("MNIT") and the Department of Children, Youth, and Families ("DCYF") are modernizing the child welfare information system through the implementation of a Comprehensive Child Welfare Information System ("CCWIS"). As part of this initiative, the State plans to consolidate data from 87 county databases into a centralized data lake to support a future DDI vendor solution. This role will focus on the analysis, design, development, implementation, and support of Azure Databases and Data Lakes, with an emphasis on the Data Lakehouse and its integrated data reserves.
Responsibilities
- Design, develop, and implement relational and non-relational databases in Azure.
- Develop and implement data transformations and optimize data workflows.
- Ensure data access patterns are optimized and maintain documentation.
- Administer, maintain, and secure data to ensure efficient and reliable storage solutions.
- Coordinate with cross-functional teams to meet security standards and implement best practices for data security and integrity.
- Implement disaster recovery solutions and backup/recovery strategies using tools like Azure Backup or Geo-replication.
- Provide mentorship and knowledge transfer to other Database Engineers.
- Collaborate on cloud infrastructure integration and CI/CD pipelines.
Requirements
- Experience designing, developing, and implementing data lakes and relational/non-relational databases in Azure.
- Experience with Databricks and Oracle databases.
- Strong experience developing data transformation solutions and cloud infrastructure integration.
- Proficiency in coding and testing programs/scripts to load data using Azure data load utilities.
- Experience with CI/CD pipelines and cloud computing concepts.
- Familiarity with tools such as Azure Monitor, Azure Data Factory, SQL Analytics, Query Performance Insight, Azure Resource Manager, and Azure CLI/PowerShell.
- Experience developing and implementing backup/recovery strategies and security measures (e.g., role-based access control, encryption, network security).
- Strong organizational and time management skills.
Qualifications
- Desired: 7+ years of experience designing, developing, and implementing data lakes and relational/non-relational databases in Azure.
- Knowledge of data concepts, data modeling, schema design, and indexing strategies.
- Knowledge of Azure SQL instances, managed instances, and elastic pools.
- Knowledge of Data Warehouse Administration and Teradata Data Warehouse.