IT SOFTWARE ENGINEER

About the role

Allied Reliability is seeking a contract Software Engineer to function as a Data Tech Lead, providing end‑to‑end leadership across architecture, engineering, governance, and capability development. The role delivers sustainable and innovative solutions to unlock value from data.

Responsibilities

• Leadership & Strategy
  • Drive the architecture, design, and delivery of data ecosystems for a futuristic data platform.
  • Define data product roadmaps and develop data solutions using the approved technology stack.
  • Align data engineering initiatives with long‑term business and technology strategies.
  • Provide technical leadership to ensure adherence to best practices, standards, and quality expectations.
• Technical Oversight
  • Lead data modeling and architecture using tools such as SAP PowerDesigner and WizDesign.
  • Develop and optimize AI‑augmented data pipelines across Azure Data Factory, ADLS, Databricks, Delta Live Tables, and Structured Streaming for high‑performance delivery.
  • Design OLTP schemas, normalization, indexing strategies, and perform performance tuning for transactional systems.
  • Manage transaction concurrency, deadlocks, and provide expertise in PostgreSQL, MySQL, and SQL Server (per Shell standards).
  • Optimize Databricks workloads with a focus on performance and cost efficiency.
  • Implement robust security, governance, lineage, and metadata controls using Unity Catalog.
  • Troubleshoot pipeline issues, ensure high data quality, and enforce SLA compliance.
• Governance & Quality Assurance
  • Establish data governance frameworks covering security, privacy, quality, and lifecycle management.
  • Monitor pipeline performance and lead root‑cause analysis for data and process issues.
  • Drive CI/CD and touchless change‑management frameworks to enable seamless deployments.
• Stakeholder Management
  • Collaborate closely with PMs, BAs, Data Scientists, Architects, and business stakeholders.
  • Translate complex technical concepts into business terms for executive audiences.
  • Resolve conflicts and ensure alignment across strategic priorities.
  • Provide clear, confident representation of the data organization to senior leadership.

Required Skills & Experience

• Technical Expertise (12‑17 years)
  • Deep expertise in Azure Data Engineering: Azure Data Factory, ADLS, Databricks, Delta Live Tables, Structured Streaming, Azure Functions, SQL, REST/FAST API, Logic Apps.
  • Strong hands‑on skills in SQL, Python, Spark/Scala.
  • Extensive experience with data modeling, data architecture, and metadata management.
  • CI/CD for application delivery using Azure DevOps or GitHub Actions.
  • Containerization (Docker) and basic Kubernetes knowledge.
  • API gateway, reverse proxies, and load balancing.
  • Data architecture and modeling tools: SAP PowerDesigner, BizDesign.
• AI & Future‑Ready Skills
  • Working knowledge of AI/ML, Generative AI, Agentic AI, and applying AI for data‑engineering automation.
  • Ability to envision and build future‑ready, scalable data ecosystems.
• Soft Skills / Leadership Competencies
  • Proven ability to lead mid‑sized to large technical teams.
  • Strong decision‑making capabilities backed by data.
  • Exceptional communication and executive presentation skills.
  • Conflict management and stakeholder alignment experience.
  • High accountability, ownership, and ability to drive independent outcomes.
  • Adaptability and continuous‑learning mindset.
• Nice to Have
  • Experience with Kafka, Hadoop, Spark Streaming.
  • Familiarity with workflow tools such as Airflow, Azkaban, Luigi.
  • Knowledge of PowerBI or QlikSense visualizations.
  • Certifications in Azure Data Engineer, Databricks, AI/ML, or Data Science.
  • Experience with GitHub/Azure DevOps, CI/CD, Agile/Kanban methodologies.
  • Understanding of freight domain concepts: voyage management, chartering, freight pricing, demurrage, laytime, port calls, vessel scheduling.
  • Integration experience with RightAngle, Endur, Veson IMOS, or internal Shell freight systems.
  • Knowledge of T&S business processes.