GCP Data Engineer

Job Description Key Responsibilities: Write efficient, optimized SQL queries to extract, clean, transform, and analyze large and complex datasets from multiple sourcesAutomate repetitive data workflows and reporting processes to improve efficiency and reduce manual effortDocument methodologies, code, and findings clearly for reproducibility and knowledge sharingExecute migration tasks under the guidance of senior engineers/architectsBuild ingestion scripts, transformation logic, and end-to-end data pipelinesSupport migration of data from Teradata to BigQueryImplement pipeline monitoring, logging, and alerting to ensure reliabilitySupport testing, validation, and reconciliation of migrated datasets to ensure data integrityMaintain and update technical documentation and operational runbooksCollaborate with cross-functional teams including data analysts, architects, and business stakeholders to understand requirements Required Skills & Experience: Strong SQL and Python skills6 -10 years of exp needed Basic-to-intermediate experience with GCP services (BigQuery, GCS, Composer, Cloud Functions)Solid understanding of ETL/ELT data flows and pipeline designExperience working with APIs, file-based ingestion, and orchestration toolsAbility to test, validate, and debug data pipelines effectivelyHands-on exposure to migration tools such as Storage Transfer Service, gsutil, and bq CLIWorking knowledge of Spark (Dataproc) is a plusUnderstanding of Teradata-to-GCP mapping concepts (e.g., Teradata → GCS, ADF → Composer)Familiarity with CI/CD concepts and practicesExposure to version control systems such as Git for code management and collaborationUnderstanding of data security, access controls, and governance best practices in cloud environmentsFamiliarity with data quality frameworks and reconciliation techniquesGood communication and problem-solving skills, with the ability to work independently and in a team setting