Azure Data Engineer
Inherent Technologies · Jackson, MI · 1 wk ago
Information TechnologyFull-time
About the role
This position is based in Jackson, MI and requires 3 days onsite per week.
Responsibilities
- Design and implement Azure Synapse Analytics, Azure Data Factory, and Databricks solutions
- Work with Azure Storage, Azure Key Vault, SQL Pools, and other Azure services (Functions, Logic Apps)
- Develop and manage Linked Services, Integration Runtimes, Datasets, Pipelines, and Activities
- Implement control flow logic and conditions (For Each, If, Switch, Until), Lookup, Stored Procedures, scripts, validations, Copy Data, Data Flow, Azure Functions, Notebooks, and SQL Pool Stored Procedures
- Deploy code across environments (Dev → QA → Prod) using GitHub and CI/CD pipelines
- Create and optimize SQL stored procedures, including functions, dynamic SQL, and record-by-record processing
- Develop and debug Python code using libraries such as PySpark, Pandas, NumPy, and MySQL/Oracle connectors
- Retrieve data through APIs and stored procedures via Python
- Install and troubleshoot Python libraries for end-users
- Work with Spark Pools and Spark for data processing
- Merge data and handle delta loads through Notebooks
- Develop and maintain Power BI reports and dashboards
Requirements
- Strong hands-on experience with Azure Synapse Analytics, Azure Data Factory, and Databricks
- Proficiency in Python libraries: PySpark, Pandas, NumPy, and experience with MySQL/Oracle
- Experience with CI/CD pipelines, GitHub, and code deployment across environments
- Strong background in SQL stored procedures, dynamic SQL, and record-by-record processing
- Ability to retrieve, process, and debug data through APIs and stored procedures using Python
- Hands-on experience with Spark Pools, Spark, and Notebooks for data merging and delta loads
- Experience with Power BI for reporting and visualization