Data Engineer IV

Responsibilities

• Lead the research, design, and development of data solutions to address analytical, research, and clinical data requirements, ensuring system scalability, security, performance and reliability.
• Design and maintain data applications such as interfaces, ingestion pipelines, data transfer mechanisms and data partition strategies using Databricks, Delta Lake, Unity Catalog, and related cloud technologies to enable efficient access of data structures.
• Develop prototypes and pilot new data engineering solutions to determine their viability for adoption and long-term operational support.
• Lead the planning process around future growth scalability, and optimization of data solutions.
• Establish and support data standards, governance practices, lineage tracking, and data quality processes.
• Lead efforts to improve processes and meet strategic goals for data engineering, data management, infrastructure management, infrastructure automation, and platform reliability.
• Proactively identify issues, troubleshoot and tune data solutions for scientific computing.
• Work with internal stakeholders to correctly scope, define, implement, and deliver data platform solutions.
• Prepare and present technical information on data solutions to all levels of stakeholders.
• Independently organize and manage multiple complex projects, priorities, and technical initiatives simultaneously.
• Prepare and maintain written technical design specifications, flow charts and data flow diagrams as needed for new and existing applications.

Qualifications

• BS in Computer Science, Engineering or equivalent experience. Minimum of 10 years of experience with various database platforms, reporting tools, and data structures.
• Minimum of 10 years of experience with database design and ETL development.
• Minimum of 10 years of experience in technical leadership.
• Proficient in one or more scripting language.
• In-depth knowledge and expertise of database technologies, along with solid programming, design and system analysis skills.
• Proven track record researching, implementing and socializing technical solutions.