Data Ops Engineer

Description

Job Description As a senior member of the DataOps team, your primary goals are to respond to production issues affecting data pipelines. You will need to work directly with Suppliers and Consumers as well as the internal Engineering teams to triage and remediate issue and restore service. You should have a solid understanding of how to access and extract data through various means, have worked on cloud hosted platforms such as GCP or AWS and have the soft skills to work with technical teams at different levels.
Responsibilities Provide Level 2 production support for data pipelines, working with the platform team as well as data suppliers and consumers to understand use cases respond to any issue raised
Working in shifts you will be responsible for live monitoring of production systems and incident management of reported issues during business hours and a rotating on call coverage
Continual Service Improvement (CSI) for the support processes through performance reporting and metrics that can help forecast and proactively address issues
Qualifications Must Have
10+ years of experience in a support or operations role, preferable in a technology or financial services company supporting production environments with enterprise users
ITSM literate with strong documentation instincts
Experience working in a cloudbased environment, such as GCP or the AWS
Working knowledge of OO Python, RDBMS
Experience working as part of a cross function matrixed support team
Strong problem solving and troubleshooting skills
Ability to exercise judgment to make sound decisions
Strong communications skills, interpersonal skills, and a sense of humor
Even Better
Data skills RDBMS SQL and NOSQL, structured and unstructured data, BigQuery
Experience in Airflow, GitHub and working with ETL tools
Big data and cloud processing experience, e.g. HDFS, Spark
Experience working with Market Data
Person should be
Naturally helpful and enjoy supporting business users and resolving technical issues
Bring experience of cloud application architecture and data life cycle
Enjoy analyzing networks, system services, operating systems and backend production systems, specifically in Python, and skilled at quickly identifying issues and remediating them
Love working on highperforming teams, collaborating with team members, and improving ability to deliver delightful experiences to clients
Excited by the opportunity to solve challenging technical problems, and find learning about data fascinating
Understand Server, Network, and Hosting Environments, RESTful and other common APIs, common data distribution, and hosted storage solutions.