Data Platform Engineer

Description

The Data Platform Engineer engages in the design, development and maintenance of the big data platform. This platform hosts structured and non-structured data sets that support various business operations and enable data-driven decisions. The role involves administering various data-hub ecosystem open source software tools along with other vendor supported tools like HortonWorks Hadoop, CISCO DV, IBM COGNOS tools. The DPE will work closely with Data Scientists, infrastructure Administrators and Data Platform Architects to ensure the platform meets business demands.Essential Resource Responsibilities / Accountabilities:Level I- Installs and /or upgrades, configures, administers and troubleshoots the data hub software environment in order to achieve a reliable, highly available, well performing system- Provides direct technical support to data warehouse user community, and triages support to appropriate personnel when technical support is not sufficient.- Develops standards, policies and procedures for the form, structure and attributes of the data warehouse tools and systems - Develops data/information quality metrics- Develops processes to monitor cluster performance and resource usage- Works with Server Engineers to install new nodes, resolve node failures, and apply patches and upgrades- Maintains processes that feed data from various systems across the enterprise, ensuring data quality and process efficiency- Follows and helps streamline procedures for provisioning access to the BI system and establishing securityMinimum Resource Qualifications:- Bachelor's degree in Information Technology, Computer Science, Software Engineering, or closely related field (or four additional years related work experience in lieu of bachelors)- Related work experience (i.e. Co-ops/Internships) preferred- Ability to take initiative and have a strong vision for driving large scale distributed data platforms- Experience with ecosystem components such as Hadoop, Cisco DV, Cognos, etc- Familiarity with Linux system administration, Linux scripting and networking skills- Proficiency in a programming language such as Python or Java is a plus- Experience with relational and NoSQL databases, including modeling and writing complex queries is a plus- Excellent communication and analytical skillsLevel I - Ability to perform routine tool maintenance working with the vendors and others on the team- Ability to identify data warehouse application and data issues- Monitor system uptime and performance- Escalate appropriately to management and/or more senior Tool Administrators- Minimum of 3 years