Databricks Quality Specialist

Description

· Data Quality Management:

Develop and implement data quality standards, policies, and procedures.

Monitor and improve data quality across various data sources and platforms.

Utilize Databricks to perform data cleansing, validation, and transformation.

Conduct regular data quality assessments and audits.

· Data Governance:

Establish and maintain a data governance framework to ensure data integrity and compliance.

Define data ownership, stewardship, and accountability roles.

Implement data governance tools and technologies, including Databricks.

Ensure compliance with regulatory requirements and industry standards.

· Collaboration and Communication:

Work closely with data engineers, data scientists, and business stakeholders to understand data requirements and ensure data quality.

Communicate data quality and governance metrics to stakeholders through reports and dashboards.

Provide training and support to teams on data governance best practices.

· Training and Support:

Conduct training sessions for staff on data governance and quality best practices.

Provide ongoing support and guidance to ensure compliance.

· Regulatory Compliance:

Ensure that data management practices comply with relevant regulations and standards, such as GDPR, CCPA, and HIPAA.

Responsibilities

• 5+ year of experience in in data governance, data quality management, or a related role
• 2+ Experience with Databricks