Big Data Architect

Description

JOB RESPONSIBILITIESResearch and analyze emerging technologies, platforms, tools and solutions; map new and existing business opportunities to potential big data, intelligence and analytics solutionsCapture business/functional requirements, expected service levels and user experience requirements from business unitsProvide recommendations, technical direction and leadership for the selection and incorporation of cloud based big data warehouse and data lake solutions and business applicationsDevelop effective phased roadmap and practical architectures for deploying modern enterprise data warehouse and data lake platforms for business intelligence, advanced analytics, machine learning and data science applicationsPlan, architect and build nextgeneration enterprise data lake and analytics applications using the Hadoop platforms (ecosystem technologies) like Azure HDInsight, Cloudera, Hortonworks, MAPRDevelop highly scalable, extensible and reliable big data solutions that enable collection, storage, modeling, and analysis of large structured / unstructured datasets from multichannel sourcesDevelop and maintain processes to acquire, analyze, store, cleanse, and transform large datasets using tools like Spark, MapReduce, Kafka, Sqoop, Hive, NiFi, HBASE, YARN etc.Apply strong expertise on ETL architectures, data movement technologies, data cleansing techniques, optimization of datastores, and building communication channels between structured and unstructured databases to support solution operationalizationDevelop and maintain enterprise data standards, quality guidelines, best practices, security policies and governance processes for the BigData / Hadoop ecosystemApply strong understanding of cloud or onpremise infrastructure architectures, environments, constraints, and available options for bigdata warehouses and datalakes; develop solution deployment roadmap and architectures with cloud/infrastructure teamsCANDIDATE PROFILE10+ years of handson experience in architecture, design or development of enterprise data solutions, applications, and integrations4+ years of demonstrated experience in architecture, data modelling and implementation of large, scalable, and highly complex big data warehouse and data lake projects using cloudnative and opensource platforms and technologiesDemonstrated expertise and handson experience with Hadoop ecosystem platforms (like Azure HDInsight, Cloudera, Hortonworks, MAPR) and NoSQL datastores (HBase, Cassandra, Azure CosmosDB)Demonstrated expertise and handson experience with Azure & AWS based big data technologies like Azure SQL Data Warehouse, Azure Data Lake, Azure ML Studio/Workbench, Databricks, Cortana Intelligence Suite, Redshift, RDS, Glacier, Kinesis etc.Advanced level proficiency and handson scripting experience with Spark, Python, U/SQL etc.; Advanced level proficiency in R, PySpark, SparkR, Scala, HiveHandson expertise working with large complex data sets, realtime/near realtime analytics, and distributed big data platforms; Experience in deploying data movement, storage and cleansing, transformation and data quality management for big data solutionsExcellent communication skills writing, presentations, interpersonal skillsB.S. Engineering or Computer Science is preferred; advanced certifications in big data, machine learning and advanced analytical platforms etc. is desirable.