Infrastructure Analyst (Yarn/Hadoop)

Description

Top Three Skills 1. Previous experience with YARN (Resource Management and tuning)
2. Experience with container management and supporting and monitoring cluster usage
3. This person should have understanding of applications that are being supported more than having experience with each tool
This Infrastructure analyst must be able to Analyze, make recommendations and Implement
Communication skills biggest soft skill, collaboration. 15 16 people on a call, cannot be afraid to bring up items and bring up issues on calls. Must be actively engaged on these calls Job Description The business partner is looking for (3) Infrastructure Analysts for a 6 12 month contract supporting the Capacity Availability Performance Platform Support Team in Tempe, AZ.
Top Required Skills 1. Previous experience with YARN (Resource Management and tuning)
2. Experience with container management
3. Previous experience supporting and monitoring cluster usage
This Infrastructure analyst must be able to Analyze, make recommendations and Implement
Required Technology Experience 35 yrs. of professional handson experience in the following Indepth understanding of YARN; especially configuring and managing resource pools
Working in a Hadoop/Linux based environment
Cloudera Manager knowledge The ability to understand and interpret log data Communication skills to be able to educate and explain to consumers how the tech works. Business writing skills to create documentation & procedures
Ability to create automation solutions Experience with reporting (transparency)
Daytoday responsibilities This will be a very hands on type role supporting a project that is already active Daytoday The role will have a heavy focus on Resource Management and tuning. YARN works with resource management in Hadoop make sure jobs get appropriate amount of resources, memory, etc. in order to execute their work load. Other day to day activities will include Container management, Cluster utilization monitoring, recommending tweaks to this. Improving the scalability to the Hadoop cluster based on sizing we have, here are recommendations to tune and alter as need be. A lot of jobs that will be submitted to this cluster from data science. SAS jobs that will be coming in. Hadoop architecture and how these tools interact with the cluster. There will be a lot of time spent also working with the vendors
This Infra Analyst does not need to know the tools as understanding the resource management and tools and understanding how the cluster is performing. Must be able to Log into the cluster, look at log files, make suggestions. Analyze, make recommendations and implement
When tuning recommendations come, they could be using HPSM
Environment The size of clusters within their environment will vary from 2530 and some up to 100+ nodes
Grown within Hadoop grown more in infrastructure that has some of the application side. Will have a good understanding of how the various tools will react Additional Information There will be heavy interaction with team members, Business Partners and also vendors
Communication between dispersed team members will take place via phone, email, Webex, Skype
There will be meetings that consist of 15+ people and it will require heavy involvement and participation from the Infrastructure Analyst