Hadoop Developer

Description

Day to Day Description Design, develop, implement and maintain the enterprise data architecture within SDLC environment. Collaborate with business units and data owners to successfully implement and maintain an enterprise level business analytics and data warehousing solution.
Selection of best practices for data modeling within various business units; oversight of activities related to data cleansing, data quality and data consolidation.
Develop guidelines to ensure data governance standardization and consistency.
Why this position Agile team environment, working closely with business members
Directly supervised by hiring manager
Performance based on deliverables completed on time
Top Skills Sr. Developer 8+ years
Articulate, communication skills
Hadoop Cloudera, Spark, Python General technology development Java, Python, etc.
Soft Skills Team player, able to work in large team
Nice to have Lead experience
Data integration process
Qualification Over 8 years of engineering and/or software development experience.
Handson experience in Big Data components/frameworks including Hadoop Components (Hive/Impala, Kafka, Flume, Storm, MapReduce, Pig, Oozie, Hbase), Spark, and languages (Java, Scala, Python).
Handson experience with building highly scalable and distributed NoSql, Anlytics reporting and search systems using technologies as Kafka, Spark, Solr/Elastic Search Experience with data modeling and metadata management is a plus.
Experience in architecture and implementation of large and highly complex data as service projects.
History of working successfully with crossfunctional engineering teams in a large corporate environment.
Deep understanding of data virtualization, PARQET, AVRO, REST, JSON technologies.
Experience with machine learning and NLP is a plus.