ADF(Azure Data Factory) Engineer

Skills

Description

Experience in data warehousing, data lifecycle management, and computer programming experience

MS Azure: Azure Data Lake Store, Azure Synapse

Azure Data Factory/SSIS or related tool

Business visualization tools, Semantic Layer – Views and Dimensional Modeling – Power BI knowledge is a plus

Experience in database design and data modeling

Experience with structured query language (SQL)

Strong learning orientation and curiosity; comfortable learning new systems/software applications

Responsibilities

• Responsible for the development and management of a Microsoft Azure cloud data platform leveraging Azure Data Lake Storage Gen2, Azure Synapse Analytics, and Azure Data Factory
• Create and maintain optimal data pipeline architecture
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader
• Work with data and analytics experts to strive for greater functionality in our data systems.