Hadoop/Bigdata Developer

About the Role

• Update the high-level Infrastructure design documents.
• Install/Upgrade/Maintenance and Monitoring of BDA/Hadoop (CDH)/Kafka/Nifi/ODI Clusters.
• Set up and troubleshoot User access in Hadoop cluster.
• Create ACL roles for Hive Databases for different access groups.
• Data ingestion support using Oracle Golden Gate/Confluent Kafka and Hadoop (Big data).
• Business requirements to set up the data transfer between multiple sources.
• Data replication from One cluster to other cluster environments (Prod – DR, DR-UAT, etc.).
• Migration support between multiple environments.
• Code tuning to improve performance for long-running jobs in MapReduce/Spark using Hive/Spark/Anaconda, etc.
• Add Nodes and respective services to the Hadoop/Kafka clusters.
• Coordinate with multiple teams and multiple Vendors to stabilize the Bigdata environments.
• Integration of ETL (ODI/NIFI/UC4) applications to Bigdata technologies for data processing and scheduling.
• Renew Server certificates for Hadoop and Kafka clusters.
• Generate different encrypt and decrypt keys to communicate the servers Internal and external servers.
• Universal scripts to monitor the server health for Hadoop/Kafka/Nifi/ODI and other Bigdata applications.
• Fix issues related to the network between the clusters.
• Participate in daily sync-up meetings with the project team.
• Enhance the existing framework for further deployment into production and maintenance.

Qualifications

• Bachelor's Degree in computer science, Computer Information Systems, Information Technology, or a closely related technical field, or a combination of education and experience equating to the U.S. equivalent of a bachelor's degree in one of the aforementioned subjects.

Work Location

McKinney, TX with required travel to client locations throughout the USA.

Please mail resumes to 6951 Virginia Parkway Suite 304, McKinney, TX 75071 or email to hr@techfuturiq.com