Data Engineer

About the role

Altus Consulting is seeking a skilled Data Engineer to join our dynamic team. You will be responsible for designing, developing, and maintaining data pipelines and infrastructure that provide reliable and high-quality data for our clients' analytics needs. You will leverage your understanding of data engineering principles, best practices, and technologies to deliver efficient and scalable solutions.

Responsibilities

• Design and develop data pipelines using industry-standard tools and technologies (e.g., Apache Spark, Kafka, Airflow).
• Extract, transform, and load (ETL) data from various sources into data warehouses and lakes.
• Develop and maintain data quality checks and monitoring processes.
• Optimize data pipelines for performance and scalability.
• Collaborate with data scientists and analysts to understand their needs and deliver data that meets their requirements.
• Document data pipelines and processes effectively.
• Stay up-to-date with the latest advancements in data engineering technologies and trends.

Preferred Skills

• Strong programming skills (Python, Java, Scala).
• Experience with Big Data technologies (Hadoop, Spark).
• Experience with Cloud platforms (AWS, Azure, GCP).
• Familiarity with data warehousing and data lake technologies.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Ability to work independently and as part of a team.

Basic Qualifications

• Active TS/SCI with poly clearance is required.
• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field (preferred).
• 2+ years of experience in data engineering or a related role.
• Understanding of data engineering principles and best practices.