Hadoop Developer

Description

Job Description Client is seeking a Hadoop Developer. Summary The client is looking for a data developer who has Hadoop development and implementation experience. This individual will be involved in the design and implementation of faulttolerant and scalable pipelines for diverse data sources.This position will develop solutions to process data from a variety of sources which may include mobile devices, web clickstream, various 3rd party, and operational system data.Processes and applications will move data as batch and in nearrealtime.As a part of the client's big data team, you will assist in the development in the architecture and platforming of data in order for analysts and business users access data for their analytics and insight.You will work directly and indirectly with analysts and business users to develop appropriate solutions to bring business value. Responsibilities Develop software using Hadoop technologies like HBase, Spark, Sqoop, NIFI and Kafka Utilizing programming languages like Java, Scala, Python with an emphasis on tuning, optimization and best practices for application developers Analyze requirements to successfully support design activitiesDesign and build integration components and interfaces in collaboration with Architects and Infrastructure EngineersPerform all technical aspects of software development (write, test, support) Perform unit, component, integration testing of software components including the design, implementation, evaluation, and executionConduct code reviews and tests of automated build scripts Debug software components, identify, fix and verify remediation of code defects own work and the work of othersWork with product owners to prioritize features for ongoing sprintsManage a list of technical requirements based on industry trends, new technologies, known defects, and issuesCustom data pipeline development (cloud and locally hosted); work heavily within the Hadoop ecosystem Experience within Insurance, Financial Services, or other regulated industries