Hadoop Developer

About the role

We are seeking a seasoned Hadoop specialist with a minimum of 10 years of experience to oversee large-scale data environments, ensure platform stability, and support data lifecycle management.

Responsibilities

• Monitor and resolve HDFS and Ozone related issues.
• Investigate cluster performance, storage utilization, and capacity concerns.
• Manage quota requests, storage allocation, and capacity planning.
• Support platform maintenance and perform integration activities.
• Coordinate with application teams during incident and problem management.
• Create and maintain operational documentation, runbooks, and knowledge articles.

Requirements

• Strong experience with the Hadoop ecosystem: HDFS, Hive, Spark, Ozone.
• Hive Metastore management and table/partition maintenance.
• Hadoop data lifecycle management.
• Data ingestion, ETL processes, and data validation.
• Shell scripting and Python automation.
• Cloudera Data Platform (CDP) or similar Hadoop distributions.
• Strong SQL and data analysis skills.

Preferred Skills

• Experience supporting large-scale Hadoop environments with multi-petabyte storage.
• Knowledge of distributed storage architecture and data replication.
• Capacity management, storage forecasting, and quota governance.
• Platform onboarding, integration, and decommissioning.
• Familiarity with cloud platforms (Azure, AWS, or GCP).
• Experience with monitoring tools such as Cloudera Manager, Grafana, Splunk, or Prometheus.
• Strong analytical and problem-solving skills with root cause analysis.

Qualifications

Bachelor of Computer Science.

Benefits

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Pay

$95,000 - 115,000 a year