Data Engineer

Description

Basic Qualifications Job Description SENIOR DATA ENGINEER, PRODUCT (LOS GATOS, CA) The product data engineering team is responsible for nearly all the large, webscale datasets used at Netflix for analyzing the product experience. This means that we build datasets for the purpose of analysis and collaborate with predictive modeling experts to build production data pipelines. The ideal candidate will have a background in a quantitative/technical field and experience with using Java/Scala to process large data sets. Responsibilities Support Migrations. This role will be supporting several major migrations. In this position youll be expected to provide the following support. ETL Pipeline Deprecation. Replace existing Pig jobs with corresponding Spark jobs. Creating Analytical Datasets. Youll need to create datasets that can be used by analytical partners to track the customer experience in the Netflix product. Requirements A Bachelor's Degree (masters Preferred) from an accredited college or university with a major in Computer Science, Information Systems, Engineering, Business, or other related scientific or technical discipline. Senior developer with 4 years of hands on experience in the Spark/Hadoop ecosystem. Proven expertise, and experience, in building production data pipelines (using Hadoop, Hive, Pig, Spark, etc.) on webscale datasets. Programming proficiency in at least two major languages (e.g. Java, Scala, Python). Excellent written communication skills. Hands on experience with schema design and data modeling. Experience with data quality checks/validation to verify datasets. Ability to work independently and drive solutions end to end, leveraging various technologies to solve data problems.