Senior Data Engineer

Technical/Functional Skills

• Google Cloud Platform (GCP)
• PySpark
• Python
• Airflow
• Hive
• Kafka
• Data pipeline development, enhancement & maintenance
• Design, build, and maintain scalable ETL/ELT pipelines
• Automate data ingestion from multiple data sources
• Ensure reliable, high‑performance, and scalable data movement
• Develop and optimize PySpark‑based data processing frameworks
• Build and manage Airflow workflows and orchestration pipelines
• Work with Hive and Kafka‑based batch and streaming data solutions
• Implement data quality, monitoring, governance, and operational controls
• Support production incidents, performance tuning, and continuous improvement initiatives

Roles & Responsibilities

• Design, build, govern, and optimize data platforms, pipelines, and integrations
• Ensure secure, reliable, and scalable data availability for analytics, reporting, AI/ML, and business operations
• Develop and maintain scalable ETL/ELT pipelines
• Automate ingestion from diverse data sources
• Optimize PySpark data processing frameworks for performance and cost
• Create and manage Airflow DAGs for workflow orchestration
• Utilize Hive and Kafka for batch and streaming data processing
• Implement data quality checks, monitoring, and governance controls
• Respond to production incidents, perform performance tuning, and drive continuous improvement

Preferred Experience

• Strong functional knowledge in retail, especially search & personalization (added advantage)
• Extensive experience with large‑scale GCP data engineering solutions
• Hands‑on experience developing and supporting Airflow DAGs
• Proven ability to build and optimize Spark/PySpark data pipelines
• Exposure to Hive‑based data processing and Kafka‑driven ingestion frameworks
• Experience supporting analytics, personalization, recommendation, or search platforms

Benefits

• Discretionary annual incentive
• Comprehensive medical coverage: medical & health, dental & vision, disability planning & insurance, pet insurance plans
• Family support: maternal & parental leaves
• Insurance options: auto & home insurance, identity theft protection
• Convenience & professional growth: commuter benefits, certification & training reimbursement
• Time off: vacation, sick leave, holidays
• Legal & financial assistance: legal assistance, 401(k) plan, performance bonus, college fund, student loan refinancing

Pay

Salary Range: $110,000 – $150,000 per year