Senior Big Data Engineer

Location: Mississauga, ON | Employment Type: Contract | Pay Range: $50.00–$60.00 per hour

About the role

Join our dynamic team as a Senior Big Data Engineer in a hybrid role based in Canada. This contract position involves designing, building, and optimizing large-scale data pipelines and distributed data systems. Your expertise in data processing technologies will be crucial in enhancing our data infrastructure's reliability and performance.

Responsibilities

• Build and maintain scalable data pipelines to process and transform large volumes of data.
• Design and develop solutions for efficient data ingestion, processing, and storage.
• Develop and manage real-time and batch data workflows ensuring high availability and low-latency delivery.
• Write complex queries to extract, validate, and analyze data supporting data-driven decision-making.
• Automate pipeline scheduling and orchestration to improve operational reliability.

Requirements

• 6–8 years of professional experience in data processing and optimization.
• Hands-on expertise in building and optimizing distributed data workflows at scale.
• Proficiency in complex query development for data analysis and validation.
• Solid understanding of distributed systems architecture and data flow.
• Strong analytical and problem-solving abilities with independent work experience.

Skills

• PySpark
• Hadoop
• SQL
• DataBricks
• Shell Scripting