ETL Developer II
Skills
- SQL (5 years)
- Apache Airflow (Cloud Composer) (3 years)
- GCP (BigQuery, Dataflow, Pub/Sub, GCS, Composer) (3 years)
- Python (5 years)
- Big Data (warehousing/processing concepts, performance) (5 years)
- Postgres (3 years)
Responsibilities
Design, build, and maintain scalable batch/streaming data pipelines on Google Cloud.
Deep SQL expertise, production-grade orchestration with Apache Airflow (Cloud Composer), and strong Python for ELT/ETL.
Design, develop, and operate reliable data pipelines and DAGs using Apache Airflow/Cloud Composer.
Build ELT/ETL on GCP services; enforce coding, testing, and observability standards.
Write expert level SQL for modeling, complex transformations, windowing functions, and performance tuning.
Develop Python data components, packaging, and CI/CD for deployment to Composer/Dataflow.
Work with Big Data ecosystems and MPP warehouses; support data ingestion, schema evolution, and partitioning/clustering strategies.
Integrate Postgres sources/targets.
Partner with product, analytics, and platform teams; uphold security, compliance, data quality, and documentation standards.
Preferred/Nice To Have Skills
Experience in the ads domain.
Ability to communicate with stakeholders and solve problems efficiently.
Preventing data quality issues before they impact users.
Prioritizing projects and handling multiple requests.