ETL Tester

About the Role

We are seeking an ETL Tester to focus on data validation, reconciliation, and database testing within data warehousing environments. The role emphasizes SQL and automation testing, with additional value placed on cloud and distributed-system testing skills.

Responsibilities

• Perform ETL and data pipeline validation and reconciliation.
• Conduct SQL and database testing, including Spark SQL for distributed systems.
• Apply data warehousing concepts to testing scenarios.
• Utilize Databricks Notebooks for exploratory testing and validation.
• Validate data pipelines and workflows on the Databricks platform.
• Integrate test automation into CI/CD pipelines.
• Apply data quality frameworks and validation techniques.

Requirements

• Experience in ETL and data testing.
• Proficiency in SQL, with preference for Spark SQL.
• Experience with cloud testing, particularly AWS.
• Familiarity with Databricks platform and workflows.
• Understanding of CI/CD pipelines and test automation integration.

Skills

• Data validation and reconciliation.
• Automation testing.
• Exploratory testing using Databricks Notebooks.
• Data pipeline and ETL testing.
• Data quality frameworks and validation techniques.