Data Engineer

Key Responsibilities

• Develop, maintain, and monitor ETL/ELT data pipelines.
• Aid in integrating data from multiple sources into data warehouses and data lakes.
• Write, optimize, and troubleshoot SQL queries for data extraction and transformation.
• Support the design and maintenance of scalable data architectures.
• Ensure data quality, integrity, and consistency across systems.
• Collaborate with data analysts, data scientists, and software engineers to understand data requirements.
• Maintain data pipeline performance and resolve issues as they arise.
• Document data workflows, processes, and technical specifications.
• Participate in code reviews and follow data engineering best practices.
• Support cloud-based data platforms and storage solutions.

Required Qualifications

• Bachelor's degree in computer science, Information Technology, Data Science, Software Engineering, or a related field.
• Basic knowledge of SQL and relational databases.
• Familiarity with Python, Java, or Scala.
• Understanding of ETL/ELT concepts and data integration.
• Basic knowledge of data warehousing concepts.
• Familiarity with version control tools such as Git.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork skills.
• Willingness to learn new technologies and tools.

Preferred Skills

• Exposure to cloud platforms such as AWS, Azure, or Google Cloud Platform.
• Familiarity with data pipeline tools such as Apache Airflow, Apache Spark, or Azure Data Factory.
• Basic understanding of big data technologies such as Hadoop or Spark.
• Experience with Linux and shell scripting.
• Knowledge of CI/CD concepts and DevOps practices.
• Understanding of data security and governance principles.