Data Engineer

Description

Deep understanding of end-to-end data engineering domain with focus on open source technologies and metadata management Able to communicate with teams and persistent attitude in the engagement. Exposure to Agile processes Proficient in Scala. Familiarity with Orchestration systems like Spark and Scalding (Twitter Open Source Scala Library)Experience w/scripting and automation and GITFamiliarity with protobuf, thrift and injection, SQL and Data ModelsOpen to learn new tools and technologies

Responsibilities

• Technical Lead Bachelors in science , engineering or equivalent.Interact with clients and internal stakeholders, provide guidance to team members and execute projects through the course of coding, quality control, deployment, maintenance and support in order to deliver the project on time by ensuring maximum application uptime WITHIN the limits of SLAs, Cognizant and clients standards, processes and policies..Project Planning and Set-up-Understand project scope Based on the analysis of the type of the project provide inputs on project methodology to senior stakeholders (Project Manager / Architects etc.) Consolidate inputs from developers and collectively provide inputs on activities/ tasks, task level estimates, schedule, dependencies, risks etc. Consolidate inputs from developers and collectively provide inputs to testing strategy, configuration, deployment, hardware/software requirement etc. Analyze in detail resources required for every phase, conduct estimation of time utilization of different resources and activities, prepare resource and development plan or provide inputs and review with PM Participate in KT sessions conducted by customer/ other business teamsRequirement Understanding and Analysis-Along with the Business Analyst, gather requirements (functional and non-functional) from customer Analyze requirements for feasibility with regards to testing and implementation Provide inputs for requirements prioritization Debrief team on the requirements gathered and seek feedback Participate in client calls and seek clarifications if any Create and maintain requirements traceability matrix along with BA Provide inputs during creation of operational concepts and scenarios Work with administrators to setup security requirementsDesign-Understand various functional and non functional requirements and HLD in order to provide inputs to create LLD and review Recommend make/ buy or alternate solutions Provide inputs in designing end to end solutions