Big Data Engineer - Sr
Dexian · Plano, TX · 2 mo ago
HybridInformation TechnologyContract
Key Responsibilities
- Design, build and maintain batch and real-time data pipelines
- Develop new data features
- Migrate existing pipelines
- Work with Kafka event streaming
- Spark batch processing
- Orchestration frameworks
- AWS cloud services
- Collaborate in Agile teams
- Support enterprise-scale migration - data engineering initiatives.
Skills
- Python with some Java or Java with Python
- SQL
- AWS
- Kafka
- Spark
- EMR/Hadoop
- Data Pipelines
- Data Orchestration
- Cloud Data Warehousing
- Workflow Orchestration