Engineer

About the role

We are looking for a strong Data Engineer with hands-on experience in DB2, Hive, and Spark. The ideal candidate should have deep expertise in SQL (especially stored procedures), data cleanup, and handling large-scale batch data processing.

Responsibilities

• Develop, optimize, and maintain complex SQL queries and stored procedures (DB2 focus)
• Perform data cleanup, transformation, and validation on large datasets
• Work extensively with DB2 (heavy data environments) and Hive
• Design and implement batch data processing pipelines
• Use Apache Spark for scalable data processing and performance optimization
• Analyze data issues and ensure data quality, consistency, and integrity
• Collaborate with cross-functional teams for data requirements and delivery
• Troubleshoot performance issues and optimize ETL/data workflows

Requirements

• 5-10 years of experience (flexible based on profile)
• Strong expertise in SQL and stored procedures (DB2 mandatory)
• Hands-on experience with DB2 (large-scale data handling)
• Working knowledge of Hive and Hadoop ecosystem
• Experience with Apache Spark (PySpark/Scala preferred)
• Solid understanding of batch processing frameworks
• Experience in data cleansing, transformation, and validation
• Good problem-solving and performance tuning skills

Nice to Have

• Experience with ETL tools (Informatica, DataStage, etc.)
• Exposure to cloud platforms (AWS/Azure/GCP)
• Knowledge of data warehousing concepts