Big Data Engineer - Sr

Key Responsibilities

• Design, build and maintain batch and real-time data pipelines
• Develop new data features
• Migrate existing pipelines
• Work with Kafka event streaming
• Spark batch processing
• Orchestration frameworks
• AWS cloud services
• Collaborate in Agile teams
• Support enterprise-scale migration - data engineering initiatives.

Skills

• Python with some Java or Java with Python
• SQL
• AWS
• Kafka
• Spark
• EMR/Hadoop
• Data Pipelines
• Data Orchestration
• Cloud Data Warehousing
• Workflow Orchestration