Data Engineer – ADF / Databricks / Qlik Replicate / Snowflake

Location: Dallas, TX | Duration: 6 months

About the Role

Data Engineer specializing in Azure Data Factory (ADF), Databricks, Qlik Replicate, and Snowflake. This role supports enterprise data and analytics initiatives, focusing on scalable data pipelines, real-time and batch data ingestion, and robust data solutions.

Responsibilities

• Design, develop, and maintain scalable data pipelines using:
  • Azure Data Factory (ADF)
  • Azure Databricks
  • Snowflake
• Implement and manage real-time and batch data ingestion solutions using Qlik Replicate.
• Ensure reliable and efficient data movement across multiple platforms.
• Develop data transformation and ETL/ELT processes using:
  • PySpark
  • SQL
  • Databricks
• Optimize data pipelines for performance, scalability, data quality, and reliability.
• Collaborate with business and technical stakeholders to:
  • Understand data requirements
  • Design data models
  • Deliver robust data solutions
• Monitor, troubleshoot, and optimize data workflows.
• Follow best practices for data governance, data security, and cloud architecture.

Requirements

• 10+ years of experience in data engineering.
• Strong hands-on experience with:
  • Qlik Replicate development
  • Azure Cloud services
  • Snowflake
  • ETL pipelines using Azure Data Factory and Azure Databricks
• Strong debugging capabilities for Qlik Replicate tasks.
• Strong knowledge of performance optimization.
• Sound knowledge of Azure Databricks and SAP.
• Strong experience with:
  • ETL/ELT
  • Data ingestion
  • Data transformation
  • Data pipelines
  • Data integration
• Strong SQL and PySpark skills.
• Domain knowledge in Supply Chain and Healthcare.
• Experience working with enterprise data and analytics environments.

Skills

• Azure Data Factory (ADF)
• Azure Databricks
• Databricks
• Qlik Replicate
• Snowflake
• PySpark
• SQL
• Azure Cloud
• SAP
• ETL/ELT
• Data Pipelines
• Data Integration
• Data Modeling
• Batch Data Processing
• Real-Time Data Ingestion
• Performance Optimization
• Data Governance
• Data Security

Preferred Skills

• Advanced Azure Data Engineering
• Qlik Replicate task development and debugging
• Snowflake data engineering
• Databricks performance optimization
• Supply Chain analytics and data solutions
• Healthcare data solutions