Senior Data Engineer

About the role

Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. As a Senior Data Engineer, you will shape your career in a collaborative, global community while driving business success through cloud-based data solutions.

Responsibilities

• Design and develop data ingestion programs to process large data sets in batch mode using AWS services (Glue, Lambda, S3, Redshift) and Databricks.
• Optimize SQL queries and apply advanced query optimization techniques.
• Develop cloud solutions in AWS data platforms with a strong understanding of distributed computing paradigms.
• Apply data modeling and data architecture concepts to build scalable data platforms.
• Implement DevOps pipelines using Jenkins and GitLab.
• Apply data governance principles and tools (Alation, Glue Data Quality, data mesh).
• Suggest solution architecture for diverse technology applications.
• Collaborate using Agile methodology and project management tools.

Requirements

• Hands-on programming experience in Python and PySpark.
• Advanced SQL skills with a focus on query optimization.
• Strong understanding of AWS and distributed computing paradigms.
• Basic understanding of IAM roles, security, and AWS infrastructure.
• Proven track record in developing large-scale data platforms and driving business success.
• Sound knowledge of data governance principles and tools.

Skills (Nice to Have)

• Ability to develop data ingestion programs for real-time data from live sources using Apache Kafka and Spark Streaming.
• Understanding of DBT (Data Build Tool) for data transformation and modeling.

Pay

The base compensation range for this role in the posted location is $85,000 - $95,000. Actual compensation may vary based on factors such as geographic location, education, certifications, relevant experience, skills, seniority, performance, market considerations, and internal pay equity. This role may also be eligible for additional compensation such as variable incentives, bonuses, or commissions.

Benefits

• Paid time off: 12–25 vacation days (depending on grade), company-paid holidays, personal days, and sick leave.
• Medical, dental, and vision coverage (or provincial healthcare coordination in Canada).
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada).
• Life and disability insurance.
• Employee assistance programs.
• Additional benefits as provided by local policy and eligibility.