Senior Data Platform Engineer

Key Responsibilities

• Design and maintain Airflow DAGs for production data workflows
• Develop and optimize Spark / PySpark jobs on Dataproc
• Build and optimize complex SQL transformations
• Implement robust data quality and validation frameworks
• Maintain pipeline performance, retries, and SLA compliance

Required Skills

• 6+ years of data engineering experience
• Strong Python programming skills
• Production experience with Apache Spark PySpark
• Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred)
• Experience building APIs using FastAPI
• Strong SQL and data modeling knowledge
• Experience implementing data quality checks (schema validation, row count checks, anomaly detection)

Benefits

• 401(k)