Data Engineer
Pinterest Inc
Contract San Francisco, California, United States Posted 4 years ago
About Position
Data Engineer (Contract)
$90.00 / Hourly
San Francisco, California, United States
Data Engineer
Contract San Francisco, California, United States Posted 4 years ago
Description
Pinterest is building a reliable platform for Pinterest Engineers to produce and consume signals about pins, boards, and users. These signal power critical Pinterest product features, such as home feed, search, recommendations, ads and trust & safety. The signal platform is also the foundation for our unified ML feature store. It provides a uniform way to access batch, incremental, and realtime generated data, and complete data governance capabilities quality and freshness, monitoring, lineage tracking, ownership, cost attribution and lifecycle management. You'll be owning and improving the batch signal platform which produces 150+ critical signals and processes hundreds of TB of data each day, including the core Pinterest index of pins, boards and users.
You'll consolidate the ways signals are produced and consumed. This involves building a data platform and moving from the legacy systems into a more centralized signal. It will provide fresher data to consumers that will be used for discovery, adds, growth & trust/safety. Must haves Strong Java Experience Ability to create algorithms and data structures
Big Data/Hadoop Knowledge This would be to create some workflows (although most workflows are inhouse)
MapReduce This is for data processing and writing batch jobs. You should know how MapReduce works and flows with data
Interview schedule 1.) Phone Interview with a CoderPad Test in Java data structures/algorithms
By applying to a job using PingJob.com you are agreeing to comply with and be subject to the PingJob.com Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.