IT - Python PySpark Databricks Developer

Key Responsibilities

• Develop and maintain ETL/ELT pipelines using Python, PySpark, and Databricks.
• Build and optimize Spark-based data processing workflows.
• Write efficient SQL queries for data extraction and transformation.
• Work with Delta Lake and cloud-based data platforms.
• Maintain and monitor data pipelines.
• Collaborate with data engineers, analysts, and business stakeholders.

Required Skills

• Strong experience in Python, PySpark, Databricks, and SQL.
• Knowledge of ETL processes and data warehousing concepts.
• Experience with Azure or AWS cloud platforms.
• Familiarity with Git and Agile development practices.
• Strong analytical and problem-solving skills.