Hadoop Engineer

About the role

We are seeking a Hadoop Engineer to support NextGen Platforms built around Big Data Technologies. This role is involved in the full life cycle of an application as part of an agile development process. The position requires the ability to interact, develop, engineer, and communicate collaboratively at high technical levels with clients, development teams, vendors, and other partners.

Responsibilities

• Provide subject matter expertise in managing Hadoop and Data Science Platform operations, with a focus on Cloudera Hadoop, Jupyter Notebook, OpenShift, and Docker-Container Cluster Management and Administration.
• Manage platform operations across all environments, including upgrades, bug fixes, deployments, metrics and monitoring, disaster recovery, and incident, problem, and capacity management.
• Work on complex, major, or highly visible tasks in support of multiple projects that require multiple areas of expertise.
• Integrate solutions with other applications and platforms outside the existing framework.
• Serve as a liaison between client partners and vendors in coordination with project managers to provide technical solutions.
• Analyze various Hadoop log files and work with compression, encoding, and file formats.

Requirements

• Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster management, and the Hadoop Administrator's role.
• Expert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, and Zookeeper.
• Proficiency in Unix/Linux, databases (Sybase/SQL/Oracle), Java, Python, Perl, and Shell scripting.
• Experience with automation and DevOps tools such as Ansible, Jenkins, SVN, and Bitbucket.
• Knowledge of fully integrated AD/Kerberos authentication.
• Familiarity with Monitoring, Alerting, and Job Scheduling Systems.

Qualifications

• Cloudera Admin or Developer Certification.
• Certification in Cloud, Docker-Container, or OpenShift Technologies.

Skills

• Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster management, and the Hadoop Administrator's role.
• Expert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, and Zookeeper.
• Proficiency in Unix/Linux, databases (Sybase/SQL/Oracle), Java, Python, Perl, and Shell scripting.
• Experience with automation and DevOps tools such as Ansible, Jenkins, SVN, and Bitbucket.
• Knowledge of fully integrated AD/Kerberos authentication.
• Familiarity with Monitoring, Alerting, and Job Scheduling Systems.

Benefits

• Medical, dental, vision, life, disability, and other insurance plans.
• Employee Stock Purchase Program (ESPP).
• 401K program with company match after 12 months of tenure.
• Health Savings Account (HSA) on the HDHP plan.
• SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions.
• Corporate discount savings program and other discounts.
• On-demand training program, certification prep, and a library of technical and leadership courses/books/seminars.
• Certification discounts and other perks to associations like CompTIA and IIBA.
• Dedicated customer service team for questions about benefits and other resources.
• Certified Career Coach.

Pay

Commensurate with experience.

Schedule

Hybrid schedule.