Azure ADF Engineer With Databricks

Description

1. Candidate must have at least 4-6 yrs experience in design and development of ETL solutions in Azure stack
2. Strong understanding of Azure service components like ADF, Data Bricks, SQL DB / SQL Server, Azure Blob storage, AAS and Power BI. Should be able to show working experience across all these technologies.
3. Should be experienced in migrating on-prem and legacy DWH to Azure stack
4. Must have a working experience in Azure DevOps and CI/CD tools at each phase of the SDLC cycle. All project management and test coordination will happen through DevOps and should be able to manage and drive deliverables and report status through DevOps.
5. Candidate must be familiar with Azure security model and Storage accounts
6. Candidate must have Azure Databrick expertise with Python / Spark (Scala would be great). Strong understanding of Data Bricks background architecture, and advanced concepts like Security and productionalization.
7. Should be able to develop end to end automations in Azure stack – for ETL workflows, data quality validations and reporting, SIT automations through DevOps etc,
8. Must have good understanding of understanding of provisioning of Databricks and Azure resources
9. Good understanding of coding standards (code modularization, refactoring), testing automation
10. Familiarity with Airflow will be an added advantage.
11. Candidate must have at least 2-3 yrs experience in productionized applications