Data Engineer

Key Responsibilities

• Perform data analysis, data profiling, data modeling, source-to-target mapping, and reporting activities for enterprise data and analytics projects.
• Develop and maintain conceptual, logical, and physical data models to support current and future operational, analytical, and reporting requirements.
• Analyze legacy and strategic source systems to assess data quality, identify inconsistencies, and recommend corrective actions to improve data integrity and governance.
• Collaborate with business stakeholders, technical teams, and external partners to design, develop, and support complex data integration pipelines using ETL tools such as Databricks, Informatica PowerCenter, Pentaho Data Integration (Kettle), and similar technologies.
• Develop, maintain, and enhance technical documentation, including data models, data dictionaries, source-to-target mapping documents, ETL specifications, process flows, and reporting artifacts.
• Develop and maintain SQL-based data solutions, including complex queries, stored procedures, database objects, and data transformation processes.
• Support business intelligence and reporting initiatives through the development of reports, dashboards, and analytical solutions utilizing platforms such as Oracle Business Intelligence Enterprise Edition (OBIEE), Power BI, and other enterprise reporting tools.
• Participate in the design and implementation of innovative data architecture and integration strategies to improve data sharing and interoperability across multiple business domains within DSNY and across City agencies.
• Support and maintain internal IT systems, applications, and databases, ensuring reliability, performance, and adherence to agency standards.

Required Qualifications

• Strong proficiency in SQL and Python programming. Additional experience with pySpark preferred.
• Experience with data modeling, data analysis, ETL development, and database design.
• Experience with enterprise reporting and analytics platforms such as Power BI, OBIEE, Tableau, or similar tools.
• Knowledge of modern data platforms and cloud-based analytics environments; experience with Databricks is highly desirable.

Preferred Qualifications

• Experience with Microsoft .NET technologies, including ASP.NET, C#, TypeScript, React or other modern web application framework.
• Experience with Java development and related technologies.
• Familiarity with data warehousing, data governance, cloud platforms, and enterprise data integration best practices.