Software Engineering - Data, Lakehouse and AI Data Platform Engineer - Associate - New York

Pipeline Engineering

Build, enhance and support batch and streaming data pipelines on the Lakehouse and AI data platform.

Refactor or modernise existing data flows where needed to improve reliability, performance and maintainability.

Where needed, build reusable tooling to improve delivery, consistency and operational support.

Ensure data pipelines are production-ready, well tested and operationally supportable.

Data Modelling and Curation

Develop raw, refined and curated datasets that support analytics, reporting and AI use cases.

Apply sound data modelling principles to represent business entities, relationships and historical change accurately.

Work with consumers to shape data products that are usable, well documented and aligned to business needs.

Data Quality and Reconciliation

Implement controls to validate completeness, accuracy and consistency of data across pipelines and datasets.

Use reconciliation approaches to build confidence in production outputs and investigate breaks where they arise.

Contribute to clear standards for testing, monitoring and issue resolution.

Contribute to practical improvements in testing, monitoring or reconciliation tooling where these strengthen platform reliability and day-to-day delivery.

Delivery and Partnership

Work closely with engineers, platform teams and data consumers to deliver agreed outcomes to time and quality expectations.

Communicate clearly on progress, risks, dependencies and design choices, including where delivery would benefit from improvements to shared platform tooling.

For more senior candidates, take a broader role in technical leadership, task breakdown and support for junior engineers.