Data Engineer

Skills

Description

Designs, codes, tests, and implements data movement, dashboarding and analytical assets; develops system documentation according to SAFe Agile principles and industry standards.
Evaluates architectural options and defines overall architecture of enterprise Data Lake and Data Warehouse.
Providing subject matter expertise and technical consulting support on either vendor or internal applications and interfaces including Azure - Data Factory, Log Analytics, Databricks, Synapse, Power BI, ADLS Gen2.
Defines functional and non-functional requirements including performance monitoring, alerting and code management and ensuring alignment with technology best practices and SLAs.
Partnering with all areas of the business to gather requirements for Data and Analytics and designing solutions.
Determines major elements and subsystems and defines interfaces as well as architectural runway.
Mentoring and coaching other members of the agile and\or Run team.
Driving engagement with ITS Security and Infrastructure teams to ensure secure development and deployment of solutions.
Interfaces with the Product Manager and IT partners at the Program level and within other Release Trains to define and estimate features for agile teams.
Conducting industry research, facilitates new product and vendor evaluations, and assists in vendor selection.

Responsibilities

• 6+ years industry experience (business application design, development, implementation, and/or solution architecture)
• Understanding of architecture practices and execution for large projects / programs.
• Experience building and designing data and analytics on enterprise solutions such as Azure - Data Factory, Log Analytics, Databricks, Synapse, Power BI, ADLS Gen2.
• Databricks experience is required.
• Experience designing data pipelines, ingestion, storage, prep-train, model and serve using above technologies, Automating Azure Workloads, Data quality, Governance/standards, Security and legal compliance in the Azure architecture
• Bachelor’s degree in Computer Science, Computer Information Systems, Business Information Systems, Engineering or related discipline or equivalent work experience and technical training is required.
• Excellent written and oral communications skills.
• Previous experience in Power BI, Data Modeling, Data Classification and zones, data movement, Data architecture and reporting
• In-depth understanding of computer, storage, network components including backup, monitoring and DR environment requirements
• Experience with multiple, diverse technical configurations, technologies, and processing environments.
• Exceptional interpersonal skills, including teamwork, facilitation, and negotiation
• Must have marketing domain experience or any digital media experience
• Data factory, databricks, python, spark, synapse, API experience
• Power BI is a plus