Data Scientists/Data Engineer

About the role

The employee's relocation is contingent on client needs; the frequency of relocation is unknown and depends on client requirements. There is no national or international travel involved for this position.

Responsibilities

• Develop data ingestion processes for structured, semi-structured, and unstructured data in Hadoop environments.
• Create Hive scripts, Hive UDFs, partitioned tables, and MapReduce programs to process and analyze large datasets in HDFS.
• Build real-time data pipelines and streaming solutions using Kafka Connect, Spark Streaming, Spark SQL, Data Frames, and Datasets.
• Configure Flume agents, Sqoop imports/exports, and Oozie Workflows to support data integration and workflow automation.

Skills

• Hadoop
• Hive
• HDFS
• Spark
• Spark SQL
• Kafka
• Sqoop
• Flume
• Oozie
• MapReduce
• HBase

Benefits

• Health insurance
• Retirement plans
• Paid time off
• Sick leave

Qualifications

• Bachelor's degree (or foreign equivalent) in Computer Science, Commerce, Data Analytics, Engineering, C.I.S., or equivalent.
• Minimum of 5 years of progressively responsible experience.