Ab Initio Migration Specialist

Key Responsibilities

• Analyze existing Ab Initio graphs, plans, and ETL workflows to understand current architecture.
• Design and implement migration strategies from Ab Initio to Azure Databricks.
• Translate complex Ab Initio logic into efficient Spark, PySpark, and SQL-based ETL pipelines.
• Develop reusable migration frameworks, standards, and best practices.
• Collaborate with business stakeholders to gather requirements and define technical solutions.
• Provide technical leadership and guidance to offshore development teams.
• Perform data validation, reconciliation, and root cause analysis to ensure data accuracy.
• Troubleshoot ETL execution issues throughout migration activities.
• Support System Integration Testing (SIT), User Acceptance Testing (UAT), production validation, and performance optimization.
• Ensure complete source-to-target data consistency and successful production rollout.

Required Skills

• Ab Initio (GDE, Co>Operating System, EME, Conduct>It, Continuous Flows)
• Azure Databricks
• Apache Spark
• PySpark
• SQL
• ETL Migration
• Data Validation & Reconciliation
• Azure Data Lake Storage (ADLS)
• Azure Data Factory (ADF)
• CI/CD for Data Pipelines

Required Qualifications

• 8+ years of overall experience in Data Engineering and ETL development.
• 5+ years of hands-on experience specializing in Ab Initio migration projects.
• Strong expertise in Ab Initio graph development, DML, transforms, joins, rollups, lookups, partitioning, normalization, and related components.
• Hands-on experience with Azure Databricks, Spark, PySpark, and SQL.
• Proven experience delivering enterprise ETL modernization or cloud migration initiatives.
• Strong analytical, troubleshooting, and debugging skills.
• Excellent communication and stakeholder management abilities.
• Experience collaborating with offshore development teams.