ETL Developer

About the Role

This position involves designing, developing, and maintaining Extract, Transform, and Load (ETL) processes to support data integration and reporting needs. The role works with various data sources, transforms data into actionable insights, and ensures data quality and consistency across systems.

Responsibilities

• Design, develop, and implement ETL processes to extract data from multiple sources, transform it according to business requirements, and load it into data warehouses or databases.
• Create and optimize ETL workflows, scripts, and procedures to ensure efficient data processing.
• Integrate data from diverse sources such as databases, flat files, APIs, and cloud platforms.
• Ensure data accuracy and consistency by implementing data validation and cleansing processes.
• Develop data transformation logic to convert raw data into meaningful and actionable information.
• Utilize tools and scripting languages to automate data transformation tasks and improve processing efficiency.
• Monitor and ensure the quality and integrity of data through regular audits and validation checks.
• Implement data governance practices and enforce data standards to maintain high-quality data.
• Analyze and optimize ETL processes for performance and scalability.
• Troubleshoot and resolve ETL-related issues and performance bottlenecks.
• Document ETL processes, data flows, and system configurations for reference and compliance purposes.
• Provide regular updates and reports on ETL processes, data integration, and performance metrics to stakeholders.
• Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver solutions.
• Provide support for data-related issues and assist in troubleshooting and resolving data-related problems.
• Stay current with the latest ETL technologies, tools, and best practices.
• Recommend and implement improvements to enhance ETL processes and data management practices.

Requirements

• 7-9 years of experience in designing ETL processes, pipelines, and SQL queries, ensuring data flow.
• Proficiency in ETL processes and tools, with the ability to oversee and execute complex data transformations.
• Extensive experience in data migration projects, demonstrating a track record of successful data transitions.
• Ability to analyze data sources, understand data relationships, and develop strategies to extract, transform, and load data effectively.
• Strong understanding of relational databases (such as MySQL, Oracle, and SQL Server) and knowledge of SQL.
• Deep understanding of data management principles, including data mapping, data quality assurance, and data governance.
• Understanding of data modeling principles and practices to design efficient data structures and optimize data warehouse performance.
• Skills in optimizing ETL processes and database queries to improve performance and reduce load times.

Skills

• ETL
• Python
• Shell Scripting
• Linux
• FHIR
• EDI
• InterOp
• Healthcare domain expertise
• Excellent knowledge of Shell scripting and Python programming languages for data manipulation and transformation.