Data Engineer

Responsibilities

• Create and maintain robust data pipelines using Databricks, Spark, SQL, or SSIS.
• Develop and manage efficient ETL/ELT processes for data extraction, transformation, and loading.
• Integrate data from various sources, ensuring data quality and consistency.
• Write, optimize, and maintain complex SQL queries to enhance performance.
• Collaborate with analysts and stakeholders to understand data requirements and deliver solutions.
• Optimize data pipelines, SQL queries, and Delta Tables to ensure high performance and scalability.
• Ensure the accuracy and reliability of data through rigorous testing and validation.
• Maintain comprehensive documentation of data pipelines, processes, and query optimizations.
• Identify and implement opportunities for process improvements and automation.

Requirements

• Bachelor’s degree in computer science, Mathematics, Statistics, or a related field.
• Minimum 4 years of experience in data engineering, including:
• Advanced SQL
• Azure Data Factory or other ETL tools
• Python or other programming languages
• Azure Databricks or Spark
• Azure DevOps or other CI/CD tools
• Strong analytical and problem-solving skills.
• Excellent communication and interpersonal skills.
• Ability to work independently and as part of a team.
• Strong attention to detail and ability to maintain data accuracy and integrity.

Qualifications

• Familiarity with healthcare data standards such as HIPAA and HITECH.
• Experience in healthcare, particularly specialty pharmacy.
• Knowledge of dimensional data modeling.
• Data Warehousing Experience.

Skills

• Advanced SQL
• Azure Data Factory or other ETL tools
• Python or other programming languages
• Azure Databricks or Spark
• Azure DevOps or other CI/CD tools

Benefits

• Generous paid time off
• Flexible on-site and hybrid work schedules
• Medical, dental, vision, health savings and flexible spending accounts
• 401K with employer matching
• Employer-paid life insurance and short/long term disability coverage
• Employee Assistance Program

Pay

TBD

Schedule

Hybrid