Lead Analyst Data Engineer

Boardwalk is a limited partnership operating in the midstream portion of the natural gas and natural gas liquids industry, providing transportation and storage services for customers. With 14,000 miles of pipeline and storage assets, we offer diverse market connectivity across 13 states, delivering reliable natural gas for power generation, home heating, and petrochemical feedstocks. We prioritize sustainability, environmental stewardship, safety, and community support in our operations.

About the role

The Lead Data Engineer is responsible for architecting and delivering scalable, high-performance data pipelines and platforms across cloud environments. This role leads the adoption of modern data architectures such as a Lakehouse and Databricks, strengthens data integration and governance, supports analytics and AI/ML use cases, and mentors data engineers and analysts to advance engineering standards and team capability.

Responsibilities

• Architect and deliver scalable, high-performance data pipelines and platforms in cloud environments.
• Lead the adoption of modern data architectures, including Lakehouse and Databricks.
• Strengthen data integration, governance, and security practices.
• Support analytics and AI/ML use cases.
• Mentor data engineers and analysts to advance engineering standards and team capability.

Requirements

• 7–10 years of implementation experience in cloud data architecture, with at least 5 years in AWS environments.
• Proficiency in AWS services: Glue, Redshift, Athena, Lake Formation, SageMaker, Bedrock, Step Functions.
• Extensive experience working with Databricks.
• Working knowledge of the Alation data governance tool.
• Strong skills in SQL (T-SQL), Python (PySpark/Pandas), DAX, Power Query (M), PL/SQL.
• Experience with databases: SQL Server, Oracle, PostgreSQL, Azure SQL, Teradata.
• Skilled in Power BI, Git, Visual Studio Code, SSMS.
• Knowledge of architectural patterns: Medallion architecture, data mesh, Lakehouse, SOA data layers.
• Excellent communication, collaboration, and leadership abilities.

Qualifications

• Bachelor’s degree in Computer Science, Data Science, Engineering, or related field (required).
• Master’s Degree (preferred).
• AWS and Databricks certifications (preferred).
• Experience leading cloud migration and data modernization initiatives (preferred).
• Experience designing and implementing scalable data architectures in AWS and Databricks (preferred).
• Experience managing data governance, security, and compliance in complex environments (preferred).
• Experience mentoring junior architects and engineers (preferred).
• Experience working with cross-functional teams to deliver business value through data (preferred).

Boardwalk Pipelines, LP, maintains a drug-free workplace and requires pre-employment drug & substance abuse testing. Boardwalk is an equal opportunity employer.