Data Engineer – Cloud Data Pipelines
Yogi Careers · San Francisco, CA · 2 mo ago
Information TechnologyFull-time
Overview
Responsibilities
- Design and implement cloud-native data pipelines using Spark, Kafka, and cloud services
- Build ETL workflows to ingest and process structured and unstructured data
- Work closely with Data Scientists and Analysts to enable self-serve analytics
- Optimize performance, reliability, and scalability of big data platforms
Requirements
- BS/MS in Computer Science, Engineering, or a related field
- 3+ years of experience with Python, SQL, and distributed systems
- Hands-on experience with AWS (Glue, Redshift, S3), GCP, or Azure
- Proficiency in Apache Spark, Airflow, and Kafka
- Experience with data modeling, data warehousing, and pipeline orchestration