GCP Data Engineer with Cloud Spanner experience
GTECH LLC · Atlanta, GA · 6 days ago
On-siteInformation TechnologyContract
Senior Data Engineer Real-Time Data Pipelines 3-6 months contract to hire Hybrid Role in Atlanta, GA Video Interview We are looking for an experienced Senior Data Engineer to build and optimize real-time data pipelines for client's Customer Data Platform. Key Responsibilities & Requirements Experience: 5+ years in Data Engineering, including 2+ years building real-time data pipelines. Company Background: Mandatory experience with FAANG or top-tier product companies. Google Cloud Platform (GCP): 3+ years of experience with Pub/Sub, Dataflow (Apache Beam), and BigQuery. Cloud Spanner: 1+ year of hands-on experience with schema design, primary key optimization, change streams, hotspot avoidance, and low-latency data access in production. Streaming & ETL: Strong expertise in Kafka/Spark Streaming, SQL, Python, PySpark, CDC, and SCD Type 2. Hybrid Cloud Migration: Experience with Databricks, Delta Lake, Snowflake, and Azure services, including Azure-to-GCP migration. Platform Engineering: Hands-on experience with Terraform, CI/CD, and Airflow/Cloud Composer. Data APIs: Experience building data pipelines that support REST/GraphQL APIs and low-latency data access. We are looking for engineers with experience building and operating large-scale, production-grade data platforms.