Data Engineer/Senior Data Engineer

Description

ESSENTIAL DUTIES AND RESPONSIBILITIES
These are the most significant job duties performed. The size, scope and complexity of assigned duties and responsibilities are dependent on the level and experience of the incumbent. To perform this job successfully, an individual must be able to perform each assigned essential duty satisfactorily. Other responsibilities or special projects not specifically mentioned may also be assigned. Solid experience in designing and implementing event driven ETL/ELT processes against enterprise data warehouse implementations. Ideal candidate will have experience leveraging AWS serverless architecture as components of data feeds in orchestration with other cloudbased aspects. Expert level proficiency in at least one of Python, Java/Scala, Node JS and Unix/Linux shell scripts is a must have Experience in designing and developing eventdriven, data processing data pipelines in AWS.
Expert level proficiency in writing Advanced SQLs and performance tuning for big data processing
Experience in Microsoft SQL Server and SSIS specifically to facilitate migrate away from SSIS packages to data pipeline architecture
Strong knowledge in related AWS architecture/features.; utilizing AWS resources including S3, Data pipelines, SNS, SQS, Lambda, EC2, RDS (Aurora, SQL Server, Postgres) Builds data transformations including importing data from files, moving data from one database platform to another, S3 buckets using Python and SQL.
Experience with cloud deployment and modern devOps required
Experience with R, MATLAB, Apache Kafka or AWS Kinesis is huge plus
Collaborates with business analysts, subject matter experts, and other team members to determine data extraction and transformation requirements.
Works closely with data analysts on physical database design and logical modeling which are driven by business requirements and is capable of providing a reasoned, experienced voice to contribute to design conversations.
Performs code reviews, analyzes query execution plans, and refactors inefficient code.
Conducts system tests and root cause analysis, troubleshoots issues and corrects database defects, responding quickly to bug fixes and enhancement requests.
Follows change management process to resolve application defects or to implement development enhancements. Provides assistance with ETL/ELT standards and design for future supportability and ease of enhancements. Assists with the creation of reusable components as they relate to the data pipeline framework. Assists with the management of ETL/ELT data pipeline scalability and system management. Creates technical documentation of design logic and ETL processes based on technology best practices, guidelines and repeatable processes.
Helps prepare and run unit, integration, UAT, regression, stress and performance plan documents and tests while documenting results. Analyzes daytoday functions and processes to ensure they are performing within predetermined guidelines, limits, and specifications. Working experience in Agile Scrum process
Understands and complies with all Bank policies and procedures, and federal and state laws and regulations pertinent to this position; stays informed and shares updates on changes with management. Required to successfully complete all required Compliance training. Continuously supports the Banks Mission Statement and Core Values.