Data Engineering Tech Lead

We are more than a health system. We are a belief system. We believe wellness and sickness are both part of a lifelong partnership, and that everyone could use an expert guide. We work hard, care deeply and reach further to help people uncover their own power to be healthy. We inspire hope. We learn, grow, and achieve more – in our careers and in our communities.

About the role

In this senior role, the tech lead will oversee the architecture, development, and maintenance of our data platform, ensuring data quality and efficiency. As the primary subject matter expert within the Information Technology team, you will collaborate with business analysts, architects, vendor partners, and other teams to deliver complex applications and services. You will provide technical expertise, enforce the vision of the application or service architecture, and safeguard the integrity and security of the application environment. Additionally, you will lead code or design reviews, analyze results, and recommend improvements to deliver quality products.

Responsibilities

• Collaboration (15%) – Work with architects, Business Analysts, Product Owners, and peers to provide technical expertise, enforce application architecture vision, and safeguard the integrity of the application environment. Review and provide input into architectural designs and requirements.
• Functional Subject Matter Expertise (15%) – Serve as the subject matter expert and advocate for the software applications supported by the team.
• Technical Expertise (30%) –
  • Act as the deep technical expert for the applications supported by the team.
  • Support cross-team technical collaboration and identify risks while designing contingency plans.
  • Analyze existing operations and evaluate options for improvements.
  • Conduct security audits to identify areas of improvement.
  • Guide teams through technical issues and challenges.
  • Assist with designing governance, quality assurance, and standards activities for technology architecture compliance.
  • Lead technology change to deliver business outcomes while leveraging subject matter experts.
  • Oversee or consult on technology implementation and modification activities, particularly for new or shared solutions.
  • Create and deliver production-ready IT services that can be easily leveraged by agile teams.
  • Adapt to new and emerging technologies and oversee proof-of-concepts (PoCs).
  • Provide detailed designs, review developer implementations, and ensure quality and best practices (e.g., automated unit tests, integration tests, continuous integration).
• Technical Documentation – Create, review, and approve technical documentation for supported applications.
• Technology Strategy (10%) – Lead the development of technology strategy and roadmap within a given specialty, including design, documentation, communication, and implementation of new or existing standards for infrastructure technologies. Stay current on industry trends.
• Vendor Management (10%) – Work with third-party vendors to validate technical aspects, assess feasibility concerns, and develop reporting metrics, dashboards, and status reporting to drive outcomes and meet quality and performance expectations.
• Operations (30%) –
  • Work with internal customers and third-party vendors to communicate, coordinate, manage expectations, approve, and assist with operational processes such as crisis management, support escalation, change management, release management, and capacity management.
  • Analyze, plan, justify, schedule, and coordinate the implementation and maintenance of administrative, operational, and financial initiatives, including TCO, optimization, and efficiency.
• Research and Analysis – Analyze and plan initiatives to improve the specialty area’s operations.

As a High Reliability Organization (HRO), responsibilities require a focus on safety, quality, and efficiency in performing job duties. This profile provides an overview of responsibilities and duties and is subject to change.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Information Science, or a related field.
• Minimum of 12–15 years of experience in data engineering, with a focus on ETL and Cloud technologies (can be less than 10 years with relevant expertise).
• Proficiency in Informatica ETL tools, SQL, and Azure Cloud platforms (preferably Azure, but others acceptable).
• Experience with Informatica IDMC – Architect, design, and develop ETL processes on IDMC and the Informatica suite of tools.
• Familiarity with MDM Architecture and Data Flow.
• Experience in potential migration from existing data platforms to Databricks and Microsoft Fabric.
• Working experience with Azure-based Data Pipelining, Scheduling, Monitoring, and PySpark, with the ability to debug troublesome pipelines.
• Hands-on expertise in dealing with data pipelines.
• Strong working experience with Big Data technologies (Spark, Databricks) for data integration and processing (ingestion, transformation, curation, etc.), preferably on Azure cloud. Clear understanding of how resources integrate with cloud and on-premises environments.
• High level of proficiency with database and data warehouse development, including replication, staging, ETL, stored procedures, partitioning, change data capture, triggers, scheduling tools, cubes, and datamarts.
• Experience working with backend languages such as Python.
• Strong computer literacy and proficiency in data manipulation using analytics tools/platforms like Databricks and Azure Fabric with the Spark engine.
• Expertise in at least one technology stack for designing, developing, testing, and delivering complex software (e.g., Java, Python, PySpark).
• Excellent debugging, troubleshooting, and analytical skills with the ability to own, troubleshoot, and resolve complex data issues.
• Strong analytical and problem-solving skills.
• Ability to collaborate with Architects and Managers to develop Metrics & KPIs.
• Ability to identify technical risks and form contingency plans.
• Good communication and collaboration skills to work effectively with cross-functional teams.
• Experience working in an Agile development environment (preferred).
• Experience building data pipelines to support ML workflows (a plus).
• Experience working with geographically distributed teams (different time zones).

Desired Attributes

• Adaptable to new technology.
• Forward-thinking, with the ability to be strategic when evaluating future technologies.
• Possesses a continuous-learner mindset.
• Ability to estimate the financial impact of technology alternatives.
• Ability to quickly comprehend the functions and capabilities of existing, new, and emerging technologies that enable and drive new business designs and models.
• Demonstrated ability to work well with others and be respected as a leader.

Schedule

• Work Shift: Day
• Scheduled Weekly Hours: 40