Data Engineer – Qlik Replicate/Snowflake

About the role

Technology Partners is seeking a talented Data Engineer to join the data engineering team to design, test, and maintain scalable data pipelines supporting advanced analytics projects.

Key Responsibilities

• Automate data ingestion from sources such as flat files, databases, APIs, and message queues.
• Develop and maintain scalable data models, ensuring data quality and system performance.
• Transform and cleanse data to support analytical, business intelligence, and machine learning use cases.
• Troubleshoot and resolve issues related to data pipelines, data quality, and system performance.
• Collaborate with vendors, consultants, and cross-functional teams to optimize data flow and integration processes.
• Write, review, and optimize complex SQL queries for data transformation and reporting.
• Assist in deploying and maintaining data pipelines that support real-time and batch processing.
• Apply lean principles to improve data processing efficiency and eliminate waste.

Required Skills & Experience

• 5+ years of experience in data engineering, data warehousing, or analytics.
• Strong expertise in SQL (more than 5 years) with proven troubleshooting and optimization skills.
• Hands-on experience with Snowflake (3+ years) in production environments.
• Practical knowledge of cloud data platforms and tools such as CDC/ingestion platforms (e.g., Qlik Replicate, Fivetran, HVR).
• Proficiency in dbt (data build tool) for developing and maintaining data models, tests, and deployment pipelines.
• Experience with object-oriented programming, especially Python (2+ years).
• Ability to troubleshoot data pipeline failures, data quality issues, and latency problems independently.
• Bachelor's degree in a relevant field such as Computer Science, Mathematics, or Statistics.
• Excellent communication skills, both verbal and written, with a collaborative mindset.
• Strong understanding of data pipeline orchestration tools (e.g., Dagster beneficial).
• Knowledge of Git, CI/CD processes, and production support practices.
• Ability to work flexibly, including occasional travel and outside regular hours.

Desired Skills & Experience

• Certifications such as Snowflake Data Engineer Certification or equivalent.
• Experience with additional tools like DataStage, SQL Server, Db2, Azure, or similar.
• Exposure to enterprise tools like Informatica or Debezium.
• Prior work in supply chain or logistics industries is a plus.
• Experience with project management and independent work capabilities.