Data Engineer

Key Responsibilities

• Design and implement data integration solutions in collaboration with the Solution Engineer and data architects.
• Support ingestion, transformation, and orchestration using ADF, Synapse pipelines, Databricks Workflows, and event-based patterns.
• Implement batch, incremental, and event-driven ingestion using agreed reference architectures.
• Maintain and extend data integration frameworks.

Data Modeling & Consumption

• Contribute to data modeling standards (Dimensional, Data Vault, Lakehouse).
• Implement analytics-ready models and semantic layers for BI and ML.
• Apply agreed data contracts and integration patterns.

Governance, Security & Compliance

• Implement data cataloging, lineage, and data quality controls.
• Apply RBAC, ABAC, encryption, and auditability controls.

Performance & Operational Excellence

• Optimize Databricks performance, cost, and storage layout.
• Monitor and troubleshoot pipelines and workloads.

Platform Evolution & Collaboration

• Support platform modernization, POCs, and migrations.
• Contribute to engineering standards and participate in design reviews.
• Partner with offshore teams, architects, and business stakeholders.

About You

• You are an experienced data engineer who enjoys working on complex platforms, delivering high-quality implementations while leveraging guidance from senior architectural leadership.
• Required Skills & Experience:
• Bachelor’s degree in Computer Science, Information Technology, or a numerate discipline.
• At least 5 years of experience in data engineering roles.
• At least 3 years of hands-on Databricks and Delta Lake experience.
• Strong Azure data platform expertise (Databricks, ADF, Synapse, Event Hubs, Functions, ADLS Gen2, Key Vault, DevOps).
• Proficiency in Spark, PySpark, and SQL.
• Experience implementing Medallion / Lakehouse architectures.
• Familiarity with data governance, Unity Catalog, and DQ frameworks.
• Understanding of security, compliance, CI/CD, and IaC (Bicep/Terraform).
• MLOps and AI platform knowledge: MLflow, feature stores, model lifecycle and deployment patterns.
• Strong communication and collaboration skills.
• Preferred Qualifications:
• Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect).
• Experience with Terraform, ARM templates, or Bicep for infrastructure automation.
• Experience with GenAI, and using AI agents, use of Copilot, Claude, or similar models for automation or process optimization to reduce day to day manual work.
• Experience integrating Azure Data Services with Power BI and AI/ML workflows.

What We Offer

• Your salary offer will be based on an assessment of a variety of factors including your specific experience and work location.
• You will be eligible for a comprehensive and competitive benefits package which includes medical plans for you and your family, health and wellness programs, retirement plans, tuition reimbursement, paid annual leave, and much more.