GCP Senior Data Engineer

Role Overview

We are looking for a hands-on Technical Lead / Senior Data Engineer to lead a BAU Data Engineering team responsible for the stability, reliability, production support, and continuous improvement of data pipelines on GCP. The role requires strong hands-on expertise across the Data Lake → Dimensions/Facts → Data Warehouse lifecycle, along with team leadership and production troubleshooting capabilities.

Key Responsibilities

• Lead and mentor an offshore BAU Data Engineering / Production Support team.
• Act as the technical escalation point for pipeline failures and data issues.
• Troubleshoot production issues and implement SQL fixes, DAG updates, backfills, and validations.
• Build and optimize Apache Airflow / Cloud Composer DAGs, including Jinja templating.
• Optimize BigQuery queries, partitioning, clustering, and cost.
• Develop Python automation to reduce recurring production issues and manual effort.
• Ensure strict ITIL, change management, testing, deployment, evidence, and rollback processes.
• Work closely with global/US teams and provide required working-hour overlap.
• Drive continuous improvement and reduce technical debt.

Mandatory Skills

• SQL Server
• Python
• Apache Airflow / Cloud Composer
• Hadoop
• Google BigQuery
• Data Lake
• Production Support / Incident Management
• Data Engineering Technical Leadership

Preferred Skills

• BigQuery SCD Type 1 & Type 2
• Partitioning & Clustering
• Kimball Data Warehouse methodology
• Star Schema, Dimensions & Facts
• Salesforce data integration
• GCP Data Engineering
• Python automation & API integration
• BAU / Production Support
• ITIL & Change Management