Data Engineer Senior
HealthPartners · Bloomington, MN · 3 wk ago
Information TechnologyFull-time
About the role
The Data Engineer supports Care Delivery Finance within HealthPartners, delivering a governed, scalable analytics platform that provides Finance and operational leaders with trusted, actionable insights.
Responsibilities
- Work with stakeholders, data scientists and analysts to frame problems, clean and integrate data, and determine the best way to provision that data on demand
- Collaborate with other developers to design technology solutions that achieve measurable results at scale
- Collaborate with data scientists to train, develop and operationalize learning models
- Build, design and develop scalable, efficient data pipeline processes to handle data ingestion, cleansing, transformation, integration, and validation required to provide access to prepared data sets for analysts and data scientists
- Evaluate and recommend technology and frameworks for building cross product data assets to optimize for flexibility, long-term viability, and time to market
- Guide, mentor, influence, and adopt a cloud-first modern data architectural direction, and consistently adopt the associated standards and best practices
- Anticipate the need for data governance and work with designated committees to ensure that data modeling and data handling procedures are compliant with applicable laws and policies across data pipeline
- Lead root cause analysis in response to detected problems/anomalies to identify the reason for alerts and implement advanced solutions that prevent recurring points of failure
- Formulate techniques for quality data collection to ensure adequacy, accuracy and legitimacy of data
- Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
- Support the data environment by releasing new features, resolving issues for users, and working with other technology teams
- Monitor and analyze information and data systems and evaluate their performance to discover ways of enhancing them (such as new technologies and upgrades)
Requirements
- Bachelor’s degree in computer science, data or social science, operations research, statistics, applied mathematics, econometrics, or a related quantitative field AND 4+ years of experience in business analytics, data science, software development, data modeling and/or data engineering work
- OR Master's Degree in Computer Science, Math, Software is acceptable 5+ years of programming experience with command in at least two languages: SQL, Python, Java, R or Spark
- Expert proficiency in SQL; experience with Oracle, PostgreSQL, MySQL, or Microsoft SQL Server
- 4+ years of experience in at least one of the BI/Analytics space such as Azure Data Factory, Synapse, Data Explorer, Cosmos, App Insights, Power BI, and Databricks (or similar)
- 3+ years of experience in the areas of Graph databases, Big Data, or Hyper Scale products in Azure
- Experience using Git, or a comparable code repository
- Must be motivated, self-driven, curious, and creative
- Skilled communicator, and demonstrate an ability to work with end users and business leaders
- Demonstrate the ability to support and complement the work of a diverse development and/or operations team
- Experience working in a collaborative, cross-functional team; Active participation in sprint reviews
Skills
- Expert Knowledge and a minimum of four years’ experience in the following domains: Data management, software engineering, I&O (infrastructure and operations)
- Knowledge of health care operations
- Ability to work in a hybrid cloud environment consisting of on premise and public cloud infrastructure
- Experience with one or more of the following skill sets:
- Expert in Relational databases like Oracle, SQL server
- Expert in Optimizing and tuning SQL/Oracle queries, stored procedures and triggers
- Expert in Python (numpy, pandas, matplotlib etc) and Jupyter notebooks for exploratory data analysis, machine learning, and process automation
- Expert in areas of CI/CD, Continuous testing, and site reliability engineering
- Expert in Microsoft Azure applications such as Azure Data Factory, Synapse, Purview, Databricks /Spark, Power BI, PowerApps
- Expert in event streaming tools like NiFi, Kafka and Flink
- Expert in data processing tools, like Apache’s Sqoop, Spark and Hive
- Expert in Document or NoSQL datastores, particularly MongoDB
- Expert in Power BI data models using advanced Power Query and DAX
- Expert in in AI/ML Ops
- Interest and desire to contribute to emerging practices around DataOps (CI/CD, IaC, configuration management, etc.)
- Collaborate effectively with product management, program management, engineers, and stakeholders
- Excellent analytical and critical thinking skills
- Ability to influence without authority and thrive in an ambiguous environment
Benefits
Designed To Support Your Total Health
- Comprehensive range of benefits to support every aspect of your life, including health, time off, retirement planning, and continuous learning opportunities
- Commitment to nurturing your diverse talents, valuing your dedication, and supporting your work-life balance
- Working together to increase diversity and inclusion in our workplace, advance health equity in care and coverage, and partner with the community as advocates for change