Azure Data Engineer
Bright Vision Technologies · South Plainfield, NJ · 6 mo ago
On-siteInformation TechnologyFull-time
Core Responsibilities
- Build Data Pipelines: Design, develop, and maintain ETL/ELT processes to move and transform data.
- Data Transformation: Cleanse, map, and optimize data for analysis.
- Manage Data Stores: Work with data lakes, data warehouses (like Synapse), and databases.
- Automate Tasks: Deploy production code and automate data workflows.
- Collaborate: Support data scientists, analysts, and developers.
Key Skills & Technologies
- Languages: SQL (essential for querying), Python (for scripting, PySpark).
- Azure Services: Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Azure Cosmos DB, Azure DevOps.
- Big Data: Apache Spark, DataBricks, Hadoop (foundational knowledge).
- Concepts: Data Warehousing, Data Modeling, ETL, CI/CD.