Lead Data Engineer
Mastercard · Miami, FL · 1 wk ago
Hybrid$140k–$231k/yrFull-time
Key Responsibilities
- Data Products Design, develop, and maintain data products
- Ensure data products meet quality, auditability, lineage, and compliance standards
- Platform Engineering & Framework Development
- Build reusable data engineering frameworks and accelerators used across multiple teams
- Develop standardized patterns for ingestion, transformation, orchestration, monitoring, and data quality
- Drive adoption of self-service platform capabilities and common engineering standards
- Build and optimize Apache Iceberg-based lakehouse solutions for analytical and operational workloads
- Cloud Engineering
- Build cloud-native solutions on AWS - S3, EMR, Glue, Lambda, ECS/EKS, CloudWatch
- Implement CI/CD pipelines, automated testing, and Infrastructure-as-Code
All About You
- 8+ years of experience in data engineering, data platform development, or related technical roles
- Leading design and implementation of scalable enterprise data solutions and reusable engineering frameworks
- Advanced hands-on experience with Apache Spark (PySpark) and distributed data processing at enterprise scale
- Deep hands-on experience with Apache Iceberg or similar open table formats
- Solid understanding of CI/CD pipelines, infrastructure-as-code and DevOps practices
- Experience with data governance, data quality frameworks, and metadata management tools
- Strong experience with AWS Cloud services, including services such as Amazon S3, EMR, Glue, Lambda, ECS/EKS, and CloudWatch for developing, deploying, and managing cloud-native data solutions
Our Purpose
We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.