Hadoop Admin (Specialist - System Management)

About the role

The Hadoop Administrator will be responsible for deploying, maintaining, and administering the Hadoop cluster. This includes adding and removing nodes, configuring Name Node high availability, and keeping track of all running Hadoop jobs.

Responsibilities

• Deploying and maintaining the Hadoop cluster
• Adding and removing nodes using cluster monitoring tools like Ganglia, Nagios, or Cloudera Manager
• Configuring the Name Node high availability
• Implementing and managing the overall Hadoop infrastructure
• Taking care of the day-to-day running of Hadoop clusters
• Working closely with the database team, network team, BI team, and application teams to ensure all big data applications are highly available and performing as expected
• Knowledge on Apache Distribution and manually setting up all configurations
• Awareness of configuration setup using Hadoop distributions like Hortonworks, Cloudera, or MapR
• Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster
• Deciding the size of the Hadoop cluster based on the data to be stored in HDFS
• Ensuring the Hadoop cluster is up and running all the time
• Maintaining and reviewing Hadoop log files
• Managing backup and recovery tasks
• Managing resource and security aspects
• Troubleshooting application errors

Requirements

Knowledge on Apache Distribution, manual setup of configurations, awareness of configuration setup using Hadoop distributions like Hortonworks, Cloudera, or MapR, capacity planning, and ensuring the Hadoop cluster is up and running all the time.

Qualifications

Experience with Hadoop distributions like Hortonworks, Cloudera, or MapR, knowledge of Apache Distribution, and manual setup of configurations.

Skills

Knowledge on Apache Distribution, manual setup of configurations, awareness of configuration setup using Hadoop distributions like Hortonworks, Cloudera, or MapR, capacity planning, and ensuring the Hadoop cluster is up and running all the time.

Benefits

• Comprehensive Medical Plan
• Covering Medical, Dental, Vision
• Short Term and Long-Term Disability Coverage
• 401(k) Plan with Company match
• Life Insurance
• Vacation Time, Sick Leave, Paid Holidays
• Paid Paternity and Maternity Leave

Pay

Actual compensation within the range will be dependent upon the individual's skills, experience, performance, and internal equity.

Schedule

Hybrid - 3days