Data Engineer

Description

Role . This individual will provide data engineering on modern, cloudbased and legacy data processing technology stacks and contribute to overall architecture, framework, and design patterns to store and process high data volumes. Strong AWS experience is a MUST. Also, we are looking for a data engineer, not someone who does machine learning. Responsibilities Provide data engineering on modern, cloudbased and legacy data processing technology stacks. Build data pipelines, data validation frameworks, job schedules with emphasis on automation and scale. Contribute to overall architecture, framework, and design patterns to store and process high data volumes. Ensure product and technical features are delivered to spec and ontime. Design and implement features in collaboration with product owners, reporting analysts / data analysts, and business partners within an Agile / Scrum methodology. Proactively support product health by building solutions that are automated, scalable, and sustainable be relentlessly focused on minimizing defects and technical debt. Design, documentation, testing, creation or modification of computer programs related to machine operating systems. Qualifications 5+ years of experience in largescale software development with emphasis on data analytics and high volume data processing. 3+ years of experience in data engineering development. 2+ years of experience implementing scalable data architectures. 2+ years of experience with AWS and related services (e.g., EC2, S3, DynamoDB, Elastic Search, SQS, SNS, Lambda, Airflow, Snowflake). Experience in datacentric programming languages (e.g., Python, GO, Ruby, Javascript, Scala). Proficiency with ETL tools and techniques. Knowledge of and experience with RDBMS platforms, such as MS SQL Server, Oracle, DB2, IMS, MySQL, Postgres, SAP HANA, and Teradata. Experience with participating in projects in a highly collaborative, multidiscipline team environment. Education Masters' or Bachelors' degree in Computer Science or a related field. Work settings Requires frequent sitting and walking. Availability to work oncall 24 hours/day for emergencies. Position could be required to minimal traveling up to 20%.