Azure Data Engineer

About the role

This position is based in Jackson, MI and requires 3 days onsite per week.

Responsibilities

• Design and implement Azure Synapse Analytics, Azure Data Factory, and Databricks solutions
• Work with Azure Storage, Azure Key Vault, SQL Pools, and other Azure services (Functions, Logic Apps)
• Develop and manage Linked Services, Integration Runtimes, Datasets, Pipelines, and Activities
• Implement control flow logic and conditions (For Each, If, Switch, Until), Lookup, Stored Procedures, scripts, validations, Copy Data, Data Flow, Azure Functions, Notebooks, and SQL Pool Stored Procedures
• Deploy code across environments (Dev → QA → Prod) using GitHub and CI/CD pipelines
• Create and optimize SQL stored procedures, including functions, dynamic SQL, and record-by-record processing
• Develop and debug Python code using libraries such as PySpark, Pandas, NumPy, and MySQL/Oracle connectors
• Retrieve data through APIs and stored procedures via Python
• Install and troubleshoot Python libraries for end-users
• Work with Spark Pools and Spark for data processing
• Merge data and handle delta loads through Notebooks
• Develop and maintain Power BI reports and dashboards

Requirements

• Strong hands-on experience with Azure Synapse Analytics, Azure Data Factory, and Databricks
• Proficiency in Python libraries: PySpark, Pandas, NumPy, and experience with MySQL/Oracle
• Experience with CI/CD pipelines, GitHub, and code deployment across environments
• Strong background in SQL stored procedures, dynamic SQL, and record-by-record processing
• Ability to retrieve, process, and debug data through APIs and stored procedures using Python
• Hands-on experience with Spark Pools, Spark, and Notebooks for data merging and delta loads
• Experience with Power BI for reporting and visualization