Senior Azure Data Engineer
Highbrow Technology Inc · United States · 2 mo ago
RemoteRemoteAnalystContract
About the role
Remote contract position (W2 or 1099) for a senior-level Azure data engineer.
Responsibilities
- Design and implement data lake / lakehouse architectures on Azure.
- Build, tune, and orchestrate pipelines using Azure Databricks, Data Factory, and Spark SQL.
- Optimize distributed data processing for performance and cost.
- Apply dimensional data modeling to deliver analytics solutions.
- Automate deployments via DevOps and CI/CD practices.
- Deliver production-grade, scalable data solutions for enterprise clients.
Requirements
- Strong experience with Azure Databricks (notebooks, clusters, Delta Lake).
- Hands-on expertise in Azure Data Factory and pipeline orchestration.
- Proficiency in Python (PySpark, Pandas, NumPy) and SQL.
- Experience with Spark SQL, performance tuning, and distributed data processing.
- Solid understanding of the Azure ecosystem: ADLS, Synapse Analytics, Azure Functions, Event Grid, Key Vault, Purview.
Preferred Qualifications
- Experience with Microsoft Fabric.
- Proven track record of improving pipeline performance (e.g., 30–40% optimization).
- Exposure to hybrid cloud environments.
- Prior experience working with large enterprise clients.