Data Engineer II

About the Role

At MetLife, data isn’t just a tool—it is a catalyst for growth. As part of our Data & Analytics organization, you’ll unlock trusted insights that drive bold decisions, power personalized customer experiences, and deliver lasting business impact. The MetLife Corporate Functions Data Office, within the Data and Analytics Organization (D&A) in GTO, implements scalable data solutions for stakeholders to generate actionable insights. We partner with D&A teams, Technology, and Business/functional partners to build and deploy next-generation data solutions.

As a Data Engineer II, you will build, test, monitor, validate, and support data pipelines using Azure Data Factory, Databricks, PySpark, Spark SQL, SQL, and Python. This role requires strong hands-on engineering experience and significant Python expertise to develop, automate, validate, and operationalize data solutions supporting reporting, analytics, and operational decision-making. Initially, the role focuses on validation activities, including source-to-target validation, data profiling, reconciliation, anomaly detection, test automation, defect analysis, and data quality controls. Over time, you will contribute more broadly to pipeline development, optimization, deployment, and operational support within Azure and Databricks environments.

Responsibilities

• Perform data validation activities for enterprise data assets, including source-to-target validation, reconciliation, profiling, anomaly detection, and defect analysis.
• Develop automated validation, testing, and data quality controls using Python, PySpark, Spark SQL, SQL, and related frameworks to ensure accuracy, completeness, consistency, and timeliness of enterprise data.
• Build, enhance, and support ETL/ELT pipelines using Azure Data Factory, Databricks, Python, PySpark, and Spark SQL, with an initial focus on validation and quality engineering use cases.
• Troubleshoot data issues, analyze root causes, document findings, and partner with Business, Technology, Operations, and Data & Analytics teams to resolve defects and improve data reliability.
• Design, develop, and optimize scalable data processing and validation solutions that support reporting, analytics, and operational decision-making.
• Implement and support Delta Lake and Lakehouse architecture patterns to enable reliable, scalable, and efficient data processing.
• Ensure data processing and validation solutions comply with established security, quality, and operational standards.
• Contribute to reusable validation frameworks, engineering standards, operational playbooks, and continuous improvement initiatives across the data platform.

Requirements

• Bachelor's or master's degree in Computer Science, Engineering, Information Systems, Mathematics, Statistics, Operations Research, or a related quantitative field, or equivalent experience.
• 3-5 years of experience in data engineering, analytics engineering, data validation engineering, data platform development, or related disciplines.
• Strong hands-on experience developing data engineering and validation solutions using Python, PySpark, Spark SQL, and/or SQL.
• Experience building, testing, validating, and supporting ETL/ELT pipelines using Azure Data Factory, Databricks, and Delta Lake architectures.
• Experience developing, troubleshooting, and optimizing scalable cloud-based data solutions in Azure, including data quality, reconciliation, and validation activities.

Preferred Qualifications

• Experience with data quality testing, data profiling, source-to-target validation, reconciliation, anomaly detection, and validation frameworks.
• Experience developing automated testing solutions using pytest or similar frameworks.
• Experience supporting production data pipelines, monitoring, observability practices, and incident or defect resolution.
• Experience with Git, Azure DevOps, and CI/CD pipelines.
• Experience with Attacama or similar data quality platforms and exposure to GenAI technologies.

Schedule

This is a hybrid role requiring a minimum of 3 days per week in office.

Pay

The expected salary range for this position is $90,000 - $110,000. This role may also be eligible for annual short-term incentive compensation. All incentives and benefits are subject to the applicable plan terms.

Benefits

MetLife’s U.S. benefits address holistic well-being with programs for physical and mental health, financial wellness, and support for families. Offerings include:

• A comprehensive health plan covering medical, prescription drug, and vision, as well as dental insurance.
• No-cost short- and long-term disability coverage and company-paid life insurance.
• Legal services and a retirement pension funded entirely by MetLife, plus a 401(k) with employer matching.
• Group discounts on voluntary insurance products, including auto, home, pet, critical illness, hospital indemnity, and accident insurance.
• Employee Assistance Program (EAP) and digital mental health programs.
• Parental leave, paid time off, paid holidays, and volunteer time off.
• Tuition assistance and more.