Senior Engineer/Senior Azure Data Engineer – Azure Synapse, Databricks & Power BI
MDAEdge · Rockville, MD · 1 mo ago
On-siteInformation TechnologyFull-time
Key Responsibilities
- Design and develop robust data pipelines using Azure Data Factory and Azure Databricks.
- Work with streaming data processing using Spark clusters in Azure Databricks.
- Manage and utilize Azure Data Lake Gen1/Gen2, Blob containers, and Azure SQL Server for data storage and processing.
- Build and maintain Azure Data Warehouses and deliver scalable solutions using Azure Synapse Analytics.
- Implement secure data access and management using Azure Key Vault and Azure Active Directory.
- Integrate event-driven architecture using ESB, Event Grid, and Azure Functions.
- Work with Cosmos DB for NoSQL database solutions within cloud-native applications.
- Develop and publish interactive dashboards and analytics reports using Power BI.
- Ensure security, compliance, and performance of data infrastructure.
Must-Have Skills
- Strong experience with:
- Azure Data Lake Gen1/Gen2
- Azure Data Factory
- Azure Databricks (including Spark clusters)
- Azure Synapse Analytics
- Azure SQL Server, Cosmos DB, Blob Storage
- Azure Key Vault, Azure Active Directory
- Azure Functions, Event Grid, ESB
- Mandatory experience with Power BI for analytics and dashboard creation.