Lead GCP Engineer
Staffing Spot, Inc. · Charlotte, NC · 6 days ago
HybridContract
About the role
We are seeking an experienced Lead GCP Engineer to lead the design, development, and implementation of enterprise-scale cloud and data engineering solutions on Google Cloud Platform (GCP). The ideal candidate has strong hands-on expertise in GCP, BigQuery, Python, PySpark, SQL, ETL, and data engineering, combined with proven experience providing technical leadership and working with enterprise stakeholders.
Responsibilities
- Lead the architecture, design, development, and implementation of enterprise-scale GCP data solutions.
- Provide technical leadership and mentor senior and junior engineers.
- Design and develop scalable ETL/data pipelines using GCP services, Python, PySpark, and SQL.
- Develop and optimize data solutions using BigQuery.
- Lead cloud migration and modernization initiatives involving legacy data platforms and ETL technologies.
- Analyze existing data architectures and recommend improvements for scalability, performance, reliability, and cost optimization.
- Collaborate with architects, product owners, business analysts, and technical stakeholders to translate business requirements into technical solutions.
- Conduct technical design reviews and code reviews.
- Troubleshoot complex production issues and perform root-cause analysis.
- Establish and enforce engineering best practices, coding standards, and development methodologies.
- Support CI/CD, automated deployments, and DevOps practices.
- Participate in Agile ceremonies and manage technical deliverables through JIRA.
- Prepare technical documentation, solution designs, and architecture diagrams.
- Communicate technical concepts effectively to both technical and non-technical stakeholders.
Requirements
- 15+ years of overall IT/software engineering experience.
- 5+ years of hands-on GCP experience.
- Strong experience with BigQuery.
- Strong hands-on Python experience.
- Strong experience with PySpark / Apache Spark.
- Excellent SQL skills.
- Extensive experience with ETL/data engineering.
- Strong understanding of cloud-based data architecture and data warehousing.
- Experience with GCP services such as BigQuery, Cloud Storage, Dataflow, Dataproc, Pub/Sub, and Cloud Composer.
- Experience working with enterprise-scale applications and data platforms.
- Strong experience with Agile/Scrum and JIRA.
- Proven technical leadership experience.
- Excellent written and verbal communication skills.
- Strong stakeholder-management and presentation skills.
Preferred Qualifications
- Experience with Ab Initio.
- Experience migrating Ab Initio/legacy ETL workloads to GCP.
- Experience with cloud data lake/data warehouse architecture.
- Experience with CI/CD and DevOps.
- Git and automated deployment experience.
- Experience with data governance, security, and cloud cost optimization.
- Experience leading distributed/global engineering teams.