Senior Cloud Data Engineer

About the role

The Massachusetts Department of Public Health (DPH) is looking for a highly skilled and experienced Senior Cloud Data Engineer for Data Modernization Initiative (DMI) Projects. DPH is executing large-scale data modernization across the agency, including creating a consolidated Enterprise Data Platform on modern cloud tools (AWS & Snowflake) and re-platforming existing business data applications from solutions such as SAS and legacy databases to the new platform. DPH data systems enable epidemiologists, public health researchers, state and local public health officials, and business leaders to analyze public health trends and drive policy decisions.

Responsibilities

• Involve in Design and development of cloud-based data management systems.
• Proficiency and practical experience in Design and implementation of data pipelines in both centralized and decentralized Data architectures.
• Ensures established data security policies and standards are followed while designing data solution for cloud-based platforms.
• Collaborates with cross-functional teams to architect highly scalable, highly available, and highly performant cloud data solutions.
• Evaluates and recommends new cloud products and services for efficient data curation, storage and processing.
• Monitors the performance of cloud data solutions and strategizes optimization measures.
• Ensures compliance with data governance policies and best practices in the cloud.
• Implements data management and data governance processes for cloud data.
• Conducts thorough analysis and documentation of cloud data engineering strategies and designs.
• Establish regular overall system performance assessment processes and action plans.
• Expertise in Data Integration leveraging Informatica (IICS), Snowflake, SQL and Python code to solve complex use cases.
• Provide direction for the design and development of the data layers including review of ETL requirements.
• Capable of leading team design sessions and facilitating decisions.
• Ensure timely delivery of solutions meeting requirements and expectations.

Qualifications

• 5+ years of experience in Design and development of Data pipelines, Cloud Data Architecture, Data warehousing, Data modeling, ETL, enterprise and business information system architectures, and system engineering.
• Thorough knowledge and Implementation experience of data warehouse and Enterprise Data architecture principles, specifically Decentralized data architectures like Data Mesh.
• 3-5 years of experience developing Cloud-based (AWS) data solutions.
• 5+ years of Cloud database platform experience such as Snowflake.
• Experience in creating and maintaining end-to-end data pipelines.
• Strong communication skills comfortable explaining/proposing solutions to technical stakeholders, vendors, and business consumers.
• Proficiency with Unix, Linux, and shell scripting.
• Experience working with a large, multi-terabyte enterprise data platform in Cloud.
• Clear understanding on system administration, database administration, storage architectures, backup & recovery, and networking.
• 3-5 years of experience in Informatica (IICS) ETL, GitHub(CI/CD) and Airflow (Orchestration) experience.
• Experience working with highly sensitive health care information and familiar with HIPAA and other data privacy controls.

Preferred skills

• Amazon Web Services (AWS) Certification or Cloud Data Engineer Certification.
• Informatica (IICS) and Airflow (Orchestration) experience.
• Snowflake certification.
• Tableau and/or Power BI reporting experience.

Pay

$80-$83/hour