Sr Data Tech Lead - Trading and Supply Freight Data Platform

About the role

Join the ECI Group's Professional Technical Services Network as a contract Sr Data Tech Lead - Trading and Supply Freight Data Platform. This is a Houston based contract role with an anticipated 6-month duration with an estimated start date of July 1st.

Leadership & Strategy

• Drive the architecture, design, and delivery of Data ecosystems for futuristic data platform.
• Define data product roadmaps and drive development of data solution using approved tech stack and related technologies.
• Align data engineering initiatives with long-term business and technology strategies.
• Provide technical leadership to ensure adherence to best practices, standards, and quality expectations.
• Lead data modelling and architecture using tools such as SAP PowerDesigner and WizDesign.
• Develop and optimize intelligent, AI-augmented data pipelines across ADF, ADLS, Databricks, DLT, and Structured Streaming to enable high-performance data delivery.
• Establish data governance frameworks covering security, privacy, quality, and lifecycle management.
• Monitor pipeline performance and lead root cause analysis for data and process issues.
• Drive CI/CD and touchless change management frameworks to enable seamless deployments.

Technical Expertise

• 12–17 years of experience in data engineering, data architecture, or analytics platforms.
• Deep expertise in:
• Azure Data Engineering (ADF, ADLS, Databricks, DLT), AZURE Function, SQL, REST/FAST API, LogicApps
• Databricks Delta Live Tables & Structured Streaming
• Unity Catalog governance and lineage
• Strong hands-on skills in SQL, Python, Spark/Scala.
• Strong experience in data modeling, data architecture, and metadata management.
• Ci/CD for application delivery (Azure DevOps/GitHub Actions)
• Containerization (Docker), Kubernetes basics
• API gateway, reverse proxies, load balancing
• Solution Data Architecture, Data Modeling tools like SAP PowerDesigner, BiZ Design
• Working knowledge of AI/ML, GenAI, Agentic AI, and applying AI for data engineering automation.
• Ability to envision and build future-ready, scalable data ecosystems.
• Proven ability to lead mid-sized to large technical teams.
• Strong decision-making capabilities backed by data.
• Exceptional communication and executive presentation skills.
• Conflict management and stakeholder alignment experience.
• High accountability, ownership, and ability to drive independent outcomes.
• Adaptability and continuous learning mindset.
• Experience with Kafka, Hadoop, Spark Streaming.
• Experience with workflow tools like Airflow, Azkaban, Luigi.
• Knowledge of PowerBI/QlikSense visualizations.
• Certifications in Azure Data Engineer, Databricks, AI/ML, or Data Science.
• Experience with GitHub/Azure DevOps, CI/CD, Agile/Kanban methodologies.
• Understanding of Freight Domain like Voyage Management, Chartering, Freight Pricing, Demurrage, Laytime, Port calls, Vessel scheduling
• Integration with RightAngle, Endur, Veson IMOS or internal Shell Freight systems