Azure Databricks Developer
Chubb Group of Insurance Companies
Full Time Whitehouse Station, New Jersey, United States Posted 1 year ago
About Position
Azure Databricks Developer (Full Time)
$0.00 / Hourly
Whitehouse Station, New Jersey, United States
Azure Databricks Developer
Full Time Whitehouse Station, New Jersey, United States Posted 1 year ago
Skills
Design build and test data pipelines leveraging Azure Databricks. Have a deep understanding of Cloud platforms and data engineering technologies preferably MS Azure. Working knowledge of Azure Databricks Cluster Management Apache Spark and Python Strong SQL skills to perform data analysis and understanding of source data. Highly proficient with Python and PySpark. Familiarity with NoSQL databases and JSON formats preferably CosmosDB.Description
Data is at the core of our business. The Azure Data Bricks Consultant serves as a key resource in building different types of Cosmos collection reading from common data definition table. This individual will work with key IT stakeholders to gather requirements, identify source data, assist with high level data extraction designs, create code to load data from data warehouse to azure cosmos collection.
The ideal candidate for this role is a self-starter who will take ownership of your projects and deliver high-quality technical solution. You are adept at solving diverse business problems by utilizing a variety of different tools, strategies, and methodologies. You should be comfortable working with data in varying technology platforms, data types, and formats.
Responsibilities
- Python
- PySpark
- SQL
- Azure Databricks
- Azure Synapse Analytics Dedicated SQL Pools (SQLDW)
- Relational Databases and NoSQL Databases
- JSON
- 5+ Years of experience
- Strong technical skill to write databricks cod e in Python/Pyspark to read data from SQLDW and write in Json structure to cosmos collection.
- Technical degree ( for e.g. Bachelor of engineering ), Azure databricks certifications etc.
By applying to a job using PingJob.com you are agreeing to comply with and be subject to the PingJob.com Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.