Sr. Data Engineer

About the role

Senior Data Engineer to design, build, and maintain scalable data solutions across our modern data platform. The role is grounded in core data engineering discipline, including data modeling, pipeline architecture, performance optimization, and data quality, with hands‑on ownership across the full Microsoft Fabric stack: pipelines, lakehouses, notebooks, semantic models, and Fabric‑native applications. You will work closely with analytics, BI, and business stakeholders to ensure data is reliable, well modeled, and delivered at the right grain and freshness to support reporting, analytics, and downstream applications. The EDW team delivers on a three‑week sprint cadence: two weeks of development, followed by one week of UAT, reconciliation, retrospective, and grooming. You will own your work end‑to‑end inside that cadence, from refinement and estimation through the production deploy.

Responsibilities

• Design and build robust, scalable ETL and ELT pipelines that ingest, transform, and curate data from diverse source systems.
• Own data modeling across bronze, silver, and gold layers, including dimensional modeling (star schema), surrogate key strategy, and slowly changing dimension (SCD) handling.
• Optimize pipeline and query performance, including partitioning, indexing, and file‑format strategy (e.g., Delta and Parquet).
• Enforce data governance practices, including handling of sensitive data (PII, financial, HR) and access‑control patterns.
• Drive data defects to their true origin; partner with owning teams to fix issues at the source rather than filtering downstream, and document any interim handling for audit purposes.
• Deploy Fabric artifacts through source control and CI/CD, keeping Dev, UAT, and Production in parity; direct changes to Production outside the release process are not acceptable.
• Ensure curated gold and silver layers meet the grain, freshness, and structure the BI team needs, and help triage whether a report request requires new engineering work or can be served from existing structures.

Requirements

• 5 or more years in data engineering with demonstrated ownership of production data pipelines.
• Strong hands‑on Microsoft Fabric experience, or equivalent Azure Synapse or Databricks experience with a willingness to specialize in Fabric.
• Proficiency in SQL, PySpark, and Spark SQL for data transformation.
• Solid understanding of dimensional modeling and of Delta Lake and medallion architecture patterns.
• Strong source control (Git) and CI/CD experience for data pipelines, including branching strategy, pull‑request discipline, and automated promotion across environments.
• Strong understanding of data quality, governance, and security practices, especially around PII, financial, and HR data.
• Ability to communicate technical trade‑offs clearly to non‑technical business stakeholders.

Skills

• Microsoft Fabric (pipelines, lakehouses, notebooks, semantic models, Fabric‑native applications)
• Azure Synapse / Databricks (equivalent experience)
• SQL, PySpark, Spark SQL
• Dimensional modeling (star schema), surrogate keys, SCD handling
• Delta Lake, medallion architecture
• File formats: Delta, Parquet
• Partitioning, indexing, performance optimization
• Git source control and CI/CD pipelines
• Data governance, PII, financial, HR data handling
• Technical communication to non‑technical stakeholders

Benefits

• Competitive salaries and benefits (medical, dental, vision)
• 401(k) program with company match
• Life insurance
• Generous paid time off package
• Educational reimbursement
• Paid family leave
• Adoption assistance

Pay

Compensation range: $130,000 to $150,000 + Bonus. Salary range reflects the Jersey City, NJ market; compensation may vary based on geographic location.