Databricks Data Engineer (GCP)
Randstad Digital Americas · Phoenix, AZ · 3 wk ago
Information Technology$40–$50/hrFull-time
About the role
We are seeking an experienced Databricks Data Engineer to join our high-performing Data & AI practice in Phoenix, AZ. In this role, you will be responsible for designing and deploying enterprise-grade Lakehouse solutions on Google Cloud Platform (GCP). You will build robust batch and real-time data pipelines, optimize ETL/ELT processes, and implement data governance using Unity Catalog to power advanced analytics across the enterprise. Location: Phoenix, Arizona. Job type: Contract. Education: Bachelors.
Responsibilities
- Design, build, and maintain scalable batch and real-time data engineering pipelines using Databricks, PySpark, and SQL.
- Integrate Databricks seamlessly with GCP services including Google Cloud Storage (GCS), BigQuery, Pub/Sub, and Cloud Composer.
- Implement metadata-driven ingestion frameworks, incremental load patterns, and structured data models.
- Configure and manage Databricks Unity Catalog to enforce fine-grained access controls, security, and data lineage.
- Implement automated orchestrations using Cloud Composer/Apache Airflow and drive CI/CD DataOps best practices.
Qualifications
- 4+ years of hands-on data engineering experience building enterprise data pipelines with Databricks and PySpark.
- Strong experience with GCP cloud architecture and native services (GCS, BigQuery, Pub/