Hadoop Admin

Description

Job Description Minimum 5 years experience with RHEL or Centos. Version 6 required, Version 7 a plus Experience managing groups of RHEL/Centos hosts at a scale of 100+ nodes, including installation Experience with storage and network configuration of RHEL/Centos, particularly on physical hosts with complex configurations Experience with Linux performance management, monitoring, and troubleshooting Ability to facilitate the installation and troubleshooting of new software based on the needs of the business, with little to no supervision Ability to learn and follow established change management processes. Experience in an ITIL environment a plus General experience with network troubleshooting, including an understanding of IP networking, TCP/IP, DNS, and routing Hadoop administration experience 3+ years managing Hadoop on a scale of 50+ nodes. CDH 5.x with Cloudera Manager highly preferred. Experience with HDP 2.1 or later will be considered in the context of other experience Experience in the administration of the following Hadoop subsystems Core (HDFS/YARN/MapReduce) required Zookeeper required Oozie required Hive required Spark required Impala plus LDAP and Kerberos integration required, ADspecific experience a plus Sentry or similar plus HDFS Encryption plus Experience with performance and workload management in a large, busy Hadoop cluster Experience with shell scripting. Bash preferred. Experience with running and troubleshooting Java applications, particularly distributed Java applications and the ability to read and understand problems from logs and stack traces Experience developing code, particularly in Java and/or Python a big plus