Azure Databricks Developer

Skills

Design build and test data pipelines leveraging Azure Databricks. Have a deep understanding of Cloud platforms and data engineering technologies preferably MS Azure. Working knowledge of Azure Databricks Cluster Management Apache Spark and Python Strong SQL skills to perform data analysis and understanding of source data. Highly proficient with Python and PySpark. Familiarity with NoSQL databases and JSON formats preferably CosmosDB.

Description

Data is at the core of our business. The Azure Data Bricks Consultant serves as a key resource in building different types of Cosmos collection reading from common data definition table. This individual will work with key IT stakeholders to gather requirements, identify source data, assist with high level data extraction designs, create code to load data from data warehouse to azure cosmos collection.
The ideal candidate for this role is a self-starter who will take ownership of your projects and deliver high-quality technical solution. You are adept at solving diverse business problems by utilizing a variety of different tools, strategies, and methodologies. You should be comfortable working with data in varying technology platforms, data types, and formats.

Responsibilities

• Python
• PySpark
• SQL
• Azure Databricks
• Azure Synapse Analytics Dedicated SQL Pools (SQLDW)
• Relational Databases and NoSQL Databases
• JSON
• 5+ Years of experience
• Strong technical skill to write databricks cod e in Python/Pyspark to read data from SQLDW and write in Json structure to cosmos collection.
• Technical degree ( for e.g. Bachelor of engineering ), Azure databricks certifications etc.