Data Engineer

Skills

1. Develop construct test and maintain architectures such as databases and large-scale data processing systems. 2. Ensure systems meet business requirements and industry practices. 3. Research opportunities for data acquisition and new uses for existing data. 4. Employ a variety of languages and tools to marry systems together. 5. Recommend ways to improve data reliability efficiency and quality. 6. Collaborate with data architects modelers and IT team members on project goals.

Description

The Mid Data Engineer will play a pivotal role in operationalizing the most-urgent data and analytics initiatives for our company. The primary focus will be on choosing optimal solutions to use for these purposes, then implementing, maintaining, and monitoring them. In addition, the Senior Data Engineer will be responsible for integrating them with the architecture used across the company.

Responsibilities

• 1. Proven experience with data warehousing solutions, particularly with Snowflake and AWS Redshift.
• 2. Hands-on experience with cloud-based data warehouses such as Snowflake on Azure or AWS Redshift.
• 3. Extensive experience in developing, maintaining, and testing data infrastructures in cloud environments such as Microsoft Azure and AWS.
• 4. Experience handling and extracting value from large, disconnected, and/or unstructured datasets using tools available on Azure and AWS.
• 5. Proficiency with ETL tools and SQL in cloud environments, particularly with Azure Data Factory and AWS Glue.
• 6. Strong programming skills with languages such as Python or Java, specifically for cloud environments like Azure and AWS.
• 7. Experience with big data tools like Azure HDInsight (for Hadoop, Spark), AWS EMR (for Hadoop) and Amazon MSK (for Kafka).
• 8. Proficiency with data pipeline and workflow management tools such as Azure Data Factory, AWS Step Functions, and AWS Glue.
• 9. Experience with object-oriented/object function scripting languages like Python, Java, or Scala for cloud-based applications on Azure or AWS.
• 10. Strong organizational skills with the ability to manage projects in a cloud environment.
• 11. Ability to work independently and collaborate with team members from different backgrounds, in particular within a cloud-based workspace.
• 12. Excellent communication and collaboration skills, with experience in tools like Salesforce for customer relationship management and Microsoft Teams for team collaboration.