Data Engineer

About the role

The Data Engineer will be responsible for designing, implementing, and maintaining scalable data infrastructure solutions. This includes working with big data technologies such as Apache Hadoop, Spark, and Kafka. The ideal candidate will have experience with cloud platforms like AWS, Azure, or Google Cloud.

Responsibilities

• Design and implement data pipelines using Apache Hadoop, Spark, and Kafka
• Develop and maintain data storage solutions using cloud platforms
• Collaborate with cross-functional teams including data scientists, software engineers, and product managers
• Optimize data processing workflows to improve efficiency and reduce latency
• Ensure data quality and integrity through automated testing and validation processes

Requirements

• Bachelor's degree in Computer Science, Information Systems, or related field
• 5+ years of professional experience in data engineering
• Experience with big data technologies such as Apache Hadoop, Spark, and Kafka
• Hands-on experience with cloud platforms like AWS, Azure, or Google Cloud
• Strong understanding of data warehousing concepts and SQL
• Excellent problem-solving skills and ability to work independently and as part of a team

Qualifications

• Experience with Python, Java, or Scala
• Knowledge of NoSQL databases like MongoDB or Cassandra
• Experience with ETL tools such as Talend or Informatica
• Experience with data modeling and database design

Skills

• Proficiency in data engineering tools and frameworks
• Strong analytical and problem-solving skills
• Ability to work under pressure and manage multiple projects simultaneously
• Excellent communication and collaboration skills

Benefits

• Competitive salary commensurate with experience
• Flexible work schedule
• Health insurance coverage
• 401(k) retirement plan
• Professional development opportunities

Pay

Salary range: $120,000 - $150,000 annually

Schedule

Hybrid work arrangement, combining remote and in-office work