HPG Big Data Engineer / Senior-Level

Responsibilities

• Build and support an Azure based ecosystem designed for enterprise-wide analysis of structured, semi-structured, and unstructured data.
• Support regular requests to move data from one cluster to another.
• Analyze requirements, design Master Data Management solutions, and integrate those solutions for customer environments.
• Closely collaborate with team members to successfully execute development initiatives using Agile practices and principles.
• Lead efforts to design, develop, deploy, and support software systems.
• Collaborate with business analysts, project lead, management and customers on requirements.
• Participate in the deployment, change, configuration, management, administration and maintenance of deployment process and systems.
• Proven experience effectively prioritizing workload to meet deadlines and work objectives.
• Gather requirements, designs, constructs and delivers solutions with minimal team interaction.
• Bring new data sources into GCP/HDFS, transform and load to databases.

Requirements

• 8-10+ years of Data Engineering experience
• 8-10+ years of experience with Azure Functions, Synapse pipelines, Azure storage accounts for data lakes, Azure queues and tables for configurations, LogAnalytics and Azure Kubernetes.
• Bachelor’s Degree in Computer Science, Software Engineering, Computer Engineering, Electrical Engineering, Electronics Engineering, or related field.
• Development skills with Python
• Experience with ETL processes or Analytics/Reporting applications
• Experience with Microsoft Azure or Amazon Web Services (AWS)
• Strong development experience with Microsoft SQL or Postgres, including advanced features
• Solid expertise in developing modern, scalable applications
• Experience with HL7 or other healthcare integration (a plus)
• Supply chain or healthcare industry experience (a plus)