Data Engineer

About the role

A rapidly growing oilfield services organization providing specialized solutions and technical expertise to support energy operators. The company leverages technology, operational expertise, and data-driven insights to improve efficiency, safety, and performance within the drilling industry.

Responsibilities

• Build, maintain, and support end-to-end data pipelines from ingestion through delivery.
• Develop and schedule transformation workflows using Databricks, PySpark, Spark SQL, and Delta Lake.
• Design, manage, and optimize data models, schemas, views, and database structures.
• Support Azure SQL database administration, including performance tuning, security, access controls, and reliability.
• Integrate data from internal and external sources, including APIs and operational systems.
• Develop automated processes for data ingestion, transformation, monitoring, and troubleshooting.
• Create curated datasets to support application developers, business teams, and analytics users.
• Document data workflows, models, and processes to ensure long-term maintainability.

Qualifications

• 4+ years of experience in data engineering or a related data-focused role.
• Strong hands-on experience with Databricks, including Jobs/Workflows, PySpark, Spark SQL, and Delta Lake.
• Advanced SQL experience, including Azure SQL/T-SQL, query optimization, indexing, and schema design.
• Experience administering and maintaining production databases.
• Strong Python skills for data ingestion, automation, and transformation.
• Experience working with REST APIs, including authentication, pagination, and data extraction.
• Understanding of production data workflows, scheduling, monitoring, troubleshooting, and reliability practices.
• Strong analytical and problem-solving skills with the ability to work independently.