Azure Databricks Administrator

Description

As a Senior Azure Databricks Administrator, you will lead the installation, configuration, maintenance, and optimization of our Azure Databricks environment at Circle K. Collaborating closely with data engineers, data scientists, and stakeholders, you'll ensure the seamless operation of our data analytics platform.

Responsibilities

• 1. Install, configure, and maintain Azure Databricks clusters and workspaces.
• 2. Monitor system performance and troubleshoot issues to ensure high availability and reliability.
• 3. Implement security best practices and ensure compliance with data governance policies.
• 4. Optimize and fine-tune Databricks clusters for performance and cost efficiency.
• 5. Lead the migration of existing legacy workspaces, schemas, and data to new Unity Catalog Environments.
• 6. Manage the Azure Databricks platform, ensuring availability, reliability, and performance.
• 7. Implement and maintain security measures to protect sensitive data and ensure compliance with regulations like GDPR or HIPAA.
• 8. Integrate Databricks with other systems and tools in the data ecosystem, such as data lakes, databases, and visualization tools.
• 9. Collaborate with data engineers and data scientists to design and implement data pipelines and workflows.
• 10. Provide technical support and guidance to users and stakeholders.
• 11. Stay current with Azure Databricks updates, new features, and best practices.