Big Data ETL Developer

Description

Qualifications Bachelors Degree, or greater, in related discipline required;
7+ years of strong software development experience, preferably using C# or Java;
3+ years of software development experience in Hadoop environment (Hive, Pig, HBase);
Knowledge or working experience of ETL Tools (Informatica Big Data Management or Talend);
Knowledge or working experience of Queues (Kafka, RabbitMQ)
Nice to have map reduce experience; and
Experience in using version control preferably one or multiple among Git, TFS, CVS, Subversion.
The Software Development Engineer is a fast paced position in a rapid growth enterprise data integration software team. The ideal candidate is a person that strives to achieve excellence backed by strong software development skills in c# or Java with recent experience in Hadoop based projects, willing to work in windows and linux environments, willingness to put team ahead of self, willing to constantly upgrade skills, and willing to support software during deployments and operation.
Responsibilities Develop hive, pig scripts for data transformation;
Develop python, shell scripts for data flow orchestration;
Lead software build and deployment when needed;
Develop Big Data Pipelines using ETL Tools (Informatica)
Support RESTBased ETL Hadoop software in higher environments like UAT, Production;
Troubleshoot SSIS or Informatica Packages if needed;
Ability to work with SQL Server meta data system;
Ability to troubleshoot asp.net web api based REST layer; and
Ability to work in both Windows and Linux environments as and when needed.