Lead Data Engineer - Data Platform Engineering (Hybrid)
Northwell Health · Melville, NY · 4 days ago
Information TechnologyFull-time
Job Responsibility
- Coordinates implementation of information system initiatives to meet user requirements.
- Communicates with user departments and project teams regarding implementation activities and system changes to ensure feasibility.
- Develops system specifications that appropriately meet department requirements.
- Develops systems to track data in comprehensive and innovative ways.
- Collaborates with hospital departments and outside vendors to facilitate managed care contract implementation.
- Captures and maintains communication between the hospital and vendor(s) regarding system applications.
- Performs periodic post-installation reviews of system initiatives.
- Conducts system-wide in-services with managers and staff, as necessary.
- Ensures systems compliance to applicable laws, regulatory standards and policies.
- Uses knowledge and skills to contribute to the development of functional objectives and principles to achieve goals in innovative ways.
Job Qualification
- Bachelor's Degree required, or equivalent combination of education and related experience.
- 5-7 years of relevant experience including technical experience with Apache Hadoop, NoSQL, setting up cloud clusters, Apache Spark, and other advanced data science and big data technologies, required.
- Highly Preferred: Extensive Google Cloud Platform (GCP) experience, Previous experience as a Data Platform Engineer/ Data Engineer/ Analytics Engineer for a large organization, Experience in/ with Python (FastAPI, Pandas, Polars, etc.), Experience with infrastructure as code, specifically Terraform, Extensive experience with Airflow, DBT, and/ or Dataform, Experience with OpenLineage, OpenMetadata and data contracts, Extensive experience with BigQuery, CloudSQL, Pub/ Sub, Dataflow, Cloud Storage, etc., Experience with the Cloud Healthcare API/ FHIR/ HL7.