ETL Team Lead

About Canal Insurance

Canal Insurance Company specializes in insurance for commercial trucking and specialty transportation operations. Founded in 1939 and located in Greenville, South Carolina, Canal recognizes that its success is driven by the hard work and dedication of its employees. The company fosters a culture designed to recruit and retain top talent, emphasizing happiness, productivity, and innovation.

Located in beautiful downtown Greenville, Canal offers a workplace with career growth opportunities, a comprehensive benefits package, an employee referral program, a casual dress code, and a commitment to innovation, integrity, and community engagement.

Benefits

• Basic & Voluntary Life Insurance Plans
• Medical, Dental, & Vision coverage
• Short Term & Long Term Disability
• 401(k) plan with company match up to 6%
• Flexible Spending Accounts
• Employee Assistance Programs
• Generous PTO Plan

Responsibilities

Production Support, Operations & Reliability

• Own end-to-end operational support for Canal's existing data stack, including daily monitoring of ETL loads across SQL jobs, DHIC (GW DataHub and InfoCenter), and legacy SSIS packages.
• Collaborate with the AMS team to troubleshoot pipeline failures, performance issues, schema mismatches, permissions issues, and cloud resource failures.
• Perform root-cause analysis and implement permanent fixes in coordination with the AMS team.
• Ensure SLA adherence and on-time delivery of critical reporting datasets for scheduled ETL jobs.
• Provide direction to AMS and ETL Developers for maintenance of Legacy & Current ETL processes.
• Refactor or retire outdated or redundant ETL processes.
• Maintain and improve existing pipelines using the following technologies:
  • Microsoft SQL Server Database programming
  • T-SQL Scripting
  • SQL Server Integration Services
  • Microsoft PowerShell
  • Guidewire DataHub and InfoCenter
  • Oracle Database programming
  • Oracle PL-SQL Scripting
  • SAP BODS (SAP BusinessObjects Data Services)
  • PostgreSQL Scripting

Operational Excellence

• Assist the AMS team in creating and enhancing operational runbooks, SOPs, monitoring dashboards, and incident response workflows.
• Partner with other IT operational segments, business SMEs, and the AMS team to minimize downtime and ensure business SLAs are met.
• Improve existing and implement new proactive measures for daily processing.

Business Continuity

• Ensure development support coverage for critical data pipelines (rotation-based) in collaboration with the AMS team.
• Support month-end and quarter-end financial reporting cycles.
• Coordinate production releases and validate deployments.

The ETL Team Lead will become the steady-state technical owner of the entire data operations layer during Canal’s modernization journey.

Technical Leadership & Collaboration

• Serve as technical lead for onshore/offshore developers.
• Review code, enforce best practices, and mentor junior engineers.
• Partner with Scrum Masters, Project Managers, Enterprise Architecture, QA Automation, Change Management, and AMS support teams.

Data Ingestion, ETL/ELT Development & Optimization

• Develop reusable ingestion patterns for Guidewire DataHub and InfoCenter, HubSpot, Telematics, and other business facets.
• Collaborate with Canal Architects to modernize existing ETL workloads using Delta Lake, Medallion Architecture, and Fabric Lakehouse.
• Build scalable data ingestion pipelines using Azure Data Factory, MS Fabric, Databricks, Synapse Pipelines, and other emerging technologies.
• Integrate internal and external data into the platform.

Real-Time, Streaming & Event-Driven Engineering

• Design and implement real-time data pipelines using Event Hub, Fabric Real-Time Analytics, Databricks Structured Streaming, and KQL-based event processing.
• Develop and enable real-time operational insights and automation capabilities, including Telematics alerting, FNOL automation, and fraud/VNOS/VNOP detection through event-driven architectures and streaming analytics.

Modern Azure Data Stack Leadership

• Lead the strategy, design, and engineering of Canal’s modern Azure data ecosystem using next-generation tools and Medallion Architecture, including:
  • Implementing Medallion Architecture (Bronze/Silver/Gold) across Fabric Lakehouse, Warehouse, Eventhouse, and KQL Database.
  • Leveraging Delta tables with schema enforcement, ACID compliance, and versioning.

Data Modeling, Curation & Governance

• Develop curated, analytics-ready datasets to support Power BI, operational reporting, and advanced analytics use cases.
• Assist Canal architects with the implementation of Data Governance tools.
• Establish robust data quality, validation, alerting, and observability frameworks to maintain accuracy, consistency, and trust in enterprise data.

AI/ML Data Enablement (Optional)

• Prepare ML-ready datasets for pricing, risk, fraud detection, underwriting, claims leakage, and predictive insights.