Senior Data Engineer

About the role

Join Capgemini and help the world’s leading organizations unlock the value of technology to build a more sustainable, more inclusive world. As a Senior Data Engineer, you will design and develop data solutions on AWS, drive business success through large-scale data platforms, and collaborate with a global community of colleagues.

Responsibilities

• Design and develop data ingestion programs to process large datasets in batch mode using AWS services (Glue, Lambda, S3, Redshift) and Databricks.
• Optimize SQL queries and apply advanced query optimization techniques.
• Develop cloud-based data solutions on AWS with a strong understanding of distributed computing paradigms.
• Apply data modeling and architecture concepts to build scalable data platforms.
• Implement DevOps pipelines using Jenkins and GitLab.
• Adhere to data governance principles and utilize tools like Alation, Glue Data Quality, and data mesh.
• Propose solution architectures for diverse technology applications.
• Manage projects using Agile methodology and project management tools.

Requirements

• Hands-on programming experience in Python and PySpark.
• Advanced SQL skills with a focus on query optimization.
• Strong understanding of AWS infrastructure, including IAM roles and security.
• Proven track record in developing large-scale data platforms on AWS.
• Experience with data modeling and data architecture concepts.
• Familiarity with data governance tools (e.g., Alation, Glue Data Quality, data mesh).

Additional Skills (Highly Valued)

• Ability to develop real-time data ingestion programs using Apache Kafka and Spark Streaming.
• Understanding of DBT (Data Build Tool) for data transformation and modeling.

Pay

The base compensation range for this role in the posted location is $85,000 - $95,000. Actual compensation may vary based on factors such as geographic location, education, certifications, relevant experience, skills, seniority, performance, market considerations, and internal pay equity. This role may also be eligible for additional compensation, including variable incentives, bonuses, or commissions.

Benefits

• Paid time off (vacation: 12-25 days, company-paid holidays, personal days, sick leave) based on employee grade.
• Medical, dental, and vision coverage (or provincial healthcare coordination in Canada).
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada).
• Life and disability insurance.
• Employee assistance programs.
• Other benefits as provided by local policy and eligibility.