Hadoop Developer

Description

The Systems Infrastructure Engineering team is responsible for a variety of infrastructure systems internationally as part of the Global Shared Services organization. Platforms managed by the team include cloud services, virtualization, Windows and Linux servers, storage, backups, authentication services, and databases. Our team strives to provide actionable solutions engineering to meet the demands of Catalinas global business. The incumbent for this position will report to the Manager of Systems Infrastructure Engineering.
WHAT YOU WILL BE DOING
Lead efforts to establish a mature solution engineering practice supporting on premise and cloud installations of Apache Hadoop and Hortonworks Data Platform (HDP)
Migrate legacy Apache Hadoop (1.x) environments to modern supportable versions with a focus on integrating fault tolerance to the platform
Engage with the EA function to ensure that Systems Infrastructure designs are in line with current and future platform needs and requirements
Develop and maintain financial investment guidance models for performance specific investments to ensure effective use of capital
Participate in project and annual budgeting processes and manage to tight financial goals
Engage and manage external vendors/outsourcing partners to enhance team capabilities and execution abilities
Build a risk model to identify key performance risks and manage/mitigate effectively
Engage in Catalinas technology roadmap development
Engineer and manage the installation, configuration, and tuning of Hadoop platforms
Provide analysis of Hadoop environments and perform the necessary actions to avoid deficiencies and service interruptions
Respond to major incidents and other conference calls in support of IT business processes
Develop, implement, and oversee policies and procedures to ensure consistent platform systems provisioning, uptime, and regulatory compliance
Manage and provide current platform usage statistics and provide future projected growth estimates
Lead efforts towards Hadoop platform consolidation and cleanup
Assist in developing and maintaining platform life cycle management technology
Design framework to manage Role Based Access Control (RBAC) using principle of least privilege
Advise business units on platform and resource utilization
WHAT YOU BRING TO THE TEAM
Technical expertise in managing production Hadoop environments
Strong background installing, configuring, and managing Hortonworks HDP
Experience installing and configuring Apache projects such as HDFS, Hive, Solr, Zookeeper, Hbase, and Kafka
Professional scripting experience with languages such as PowerShell, Python, and BASH
Bachelors degree in Technology or equivalent experience
Strong technical, leadership, communication, and financial skills
Experience working with and troubleshooting network configurations utilizing multiple subnets and VLANs
Experience in version control systems (Git)