Scala/Spark Developer

Description

Required Skills 9+ years of hands on experience in variety of platform & data development roles
4+ years of experience in big data technology with experience ranging from platform architecture, data management, data architecture and application architecture
High Proficiency working with Hadoop platform including Spark/Scala, Kafka, SparkSQL, Hbase, Impala, Hive and HDFS in multitenant environments
Good knowledge and Handson Spark Scala Programming Experience with AWS components and services, particularly EMR, S3, and Lambda
Good understanding of file formats including JSON, Parquet, Avro, and others Strong development skills around Hadoop, Spark, MapReduce, and Hive Strong understanding of Hadoop internals Experience with open source technologies such as Cassandra Experience with messaging and complex eventprocessing systems such as Kafka and Storm Facilitate in job scheduling monitoring Excellent in writing shell scripts Experience with application architecture in a big data environment. Knowledge on Java Programming and Data Migration ETL knowledge is desirable
Experience in full lifecycle architecture guidance
Advanced analytical thinking and problem solving skills
Advanced knowledge of application, data and infrastructure architecture disciplines
Understanding of architecture and design across all systems