Senior Data Platform Engineer
EITACIES Inc. · Austin, TX · 2 mo ago
On-siteEngineeringFull-time
Key Responsibilities
- Design and maintain Airflow DAGs for production data workflows
- Develop and optimize Spark / PySpark jobs on Dataproc
- Build and optimize complex SQL transformations
- Develop REST APIs using FastAPI Python to support data services
- Implement robust data quality and validation frameworks
- Maintain pipeline performance, retries, and SLA compliance
Required Skills
- 9+ years of data engineering experience
- Strong Python programming skills
- Production experience with Apache Spark PySpark
- Experience with Airflow DAG development
- Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred)
- Experience building APIs using FastAPI
- Strong SQL and data modeling knowledge
- Experience implementing data quality checks (schema validation, row count checks, anomaly detection)
Benefits
- 401(k)