Data Engineer Principal
About the role
HealthPartners is seeking a Data Engineer, Principal to join our team. Our mission is to provide simple and affordable healthcare, improving patient and member experience, health, and reducing the per capita cost of health care through the use of data.
Responsibilities
- Build, manage, and optimize data pipelines to facilitate data movement in service of improving patient and member experience, health, and reducing the per capita cost of health care.
- Implement and test methods (or build systems) that improve data reliability and quality.
- Work in collaborative scrum teams with other developers, analysts, and data scientists to design and develop technology solutions that achieve measurable results at scale.
- Collaborate with data scientists to train, develop, and operationalize learning models.
- Identify, design, and implement software architecture to manage software development tasks associated with developing, debugging, or designing software applications, operating systems, and databases according to provided design specifications.
- Build enhancements within an existing software architecture and envision future improvements to the architecture.
- Guide, mentor, influence, and adopt a cloud-first modern data architectural direction, and consistently adopt the associated standards and best practices.
- Monitor and analyze information and data systems and evaluate their performance to discover ways of enhancing them (such as new technologies and upgrades).
- Collaborate with cross-function engineering teams to design interfaces that support data integration with internal and external platforms.
- Perform other duties as required, to meet team sprint goals.
Required Skills/Qualifications
- Bachelor’s degree in computer science, data or social science, operations research, statistics, applied mathematics, econometrics, or a related quantitative field AND 4 or more years of experience in business analytics, data science, software development, data modeling and/or data engineering work OR Master's Degree in Computer Science, Math, Software is acceptable.
- 10 or more years of programming experience with command in at least two or more of the following programming languages: SQL, Python, Java, R or Spark.
- Expert proficiency in SQL; experience with Oracle, PostgreSQL, MySQL, or Microsoft SQL Server.
- 10 or more years of experience using a combination of tools such as Azure Data Factory, Synapse, Data Explorer, App Insights, Power BI, and Databricks.
- 3 or more years of experience using Azure CosmosDB and Azure Data Lake Storage.
- Motivated, self-driven, curious, and creative.
- Proven ability to lead projects and teams with minimal guidance.
- Skilled communicator, and demonstrate an ability to work with end users and business leaders.
- Demonstrate the ability to support and complement the work of a diverse development and/or operations team.
- Lead a collaborative, cross-functional team.
- Active participation in sprint reviews.
- Expert and a minimum of five year’s experience in the following domains: Data management, software engineering, I&O (infrastructure and operations).
Preferred Qualifications
- Knowledge of health care operations.
- Exposure to agile/scrum.
- Ability to work in a hybrid cloud environment consisting of on premise and public cloud infrastructure.
- Experience with one or more of the following skill sets:
- Expert in Relational databases like Oracle, SQL server.
- Expert in Optimizing and tuning SQL/Oracle queries, stored procedures and triggers.
- Expert in Python (numpy, pandas, matplotlib etc) and Jupyter notebooks for exploratory data analysis, machine learning, and process automation.
- Expert in areas of CI/CD, Continuous testing, and site reliability engineering.
- Expert in Microsoft Azure applications such as Azure Data Factory, Synapse, Purview, Databricks /Spark, Power BI, PowerApps.
- Expert in event streaming tools like NiFi, Kafka and Flink.
- Expert in data processing tools, like Apache’s Sqoop, Spark and Hive.
- Expert in Document or NoSQL datastores, particularly MongoDB.
- Expert in Power BI data models using advanced Power Query and DAX.
- Expert in in AI/ML Ops.
- Interest and desire to contribute to emerging practices around DataOps (CI/CD, IaC, configuration management, etc.).
- Collaborate effectively with product management, program management, engineers, and stakeholders.
- Excellent analytical and critical thinking skills.
- Ability to influence without authority and thrive in an ambiguous environment.
About Us
At HealthPartners, we believe in the power of good – good deeds and good people working together. As part of our team, you’ll find an inclusive environment that encourages new ways of thinking, celebrates differences, and recognizes hard work. We’re a nonprofit, integrated health care organization, providing health insurance in six states and high-quality care at more than 90 locations, including hospitals and clinics in Minnesota and Wisconsin. We bring together research and education through HealthPartners Institute, training medical professionals across the region and conducting innovative research that improve lives around the world. At HealthPartners, everyone is welcome, included and valued. We’re working together to increase diversity and inclusion in our workplace, advance health equity in care and coverage, and partner with the community as advocates for change.