Senior Data Engineer (Ref: 197457)

We are recruiting for our client, a long-established distributor of industrial automation, electrical control and maintenance parts that supports manufacturing and facilities teams across diverse sectors. The organisation moves large volumes of technical inventory and connects complex supply needs with practical, ready-to-deploy hardware, so its data systems must handle product, pricing and transactional complexity at scale. Candidates will join a technically focused environment where data powers pricing, digital commerce and analytics decisions used by operations and commercial teams.

About the role

Lead the evolution of the organisation's data platform by owning end-to-end data engineering for pricing, commerce and analytics domains. You will maintain and improve Databricks-based ETL pipelines that turn multiple source systems into consistent, analyzable datasets and business-ready models. Day-to-day work includes designing robust ingestion and transformation patterns, translating stakeholder requirements into delivery plans, improving data quality and performance, and supporting platform reliability on Azure Databricks. The role offers scope to influence how data is modelled and consumed across reporting, pricing engines and digital channels, and will directly affect commercial and operational decision-making.

Responsibilities

• Maintain and enhance ETL processes bringing source data into Databricks.
• Design high-level solutions and create task lists for data ingestion and transformation.
• Collaborate with pricing, digital, and analytics teams and engage with business stakeholders for requirements and discovery.
• Support the platform (Databricks on Azure) and contribute to achieving an enterprise data warehouse.

Requirements

• Strong experience with Databricks (on Azure).
• Advanced SQL proficiency; Python/PySpark experience desirable.
• Experience designing ETL processes and data transformations.
• Good communication skills and ability to interact with senior stakeholders.

Benefits

• Bonus: approximately 10% (subject to HR confirmation).

Pay

Salary band capped at $170,000.

Schedule

Hybrid in-office requirement (three days in office, flexible which days). Location flexible between Willingboro, NJ and Chicago.