Azure Data Engineer

Skills

Description

Connect and Collect data exploration and preparation.
Transform and Enrich data representation and transformation.
Publish and Serve Publish data.
Monitor data pipelines and solutions.
Developing, building, maintaining, and managing data pipelines work with large dataset, databases and software used to analyze them.
Fluent with Azure data tools and component.
Primary focus to ensure that data flows smoothly from its source to its destination efficiently and securely.
Demonstrate experience in programming scripting (e.g. Python, SQL).
Demonstrate experience Analytics/data product solution architecture on Azure (Azure data Factory, Data bricks).
Handson experience in data extract, load and transformation techniques and tools including orchestration of needed azure resources.
Ensuring the accuracy of data and promoting data quality.
Building, testing, and maintaining database pipeline Architecture.
Demonstrated experience in Data and Software Engineering tools and Agile methodologies (e.g. Agile, ADO,Ansible,G/T)
Demonstrated experience in Analytica Data framework and Azure Analysis Services. Skills:
Modern Data Warehousing
Data flow transformations
Implement and design data engineering and integration patterns: messaging, shared databases, file, service based.
Data security design authorization, sharding, allocations, authentication
Database systems and large scale processing systems
Consume and develop data driven APIs.