Bigdata lead/Engineer
Palo Alto Networks
Contract Santa Clara, California, United States Posted 4 years ago
About Position
Bigdata lead/Engineer (Contract)
$86.00 / Hourly
Santa Clara, California, United States
Bigdata lead/Engineer
Contract Santa Clara, California, United States Posted 4 years ago
Description
8 + Years of experiences a Big Data Engineer, you will be an integral member of our Big Data & Analytics team responsible for Leading design and development scalable data processing and storage systems.
Partner with data analyst, product owners and data scientists, to better understand requirements, finding bottlenecks, resolutions, etc.
Suggest and implement improvements to development tools and processes.
Build data pipelines and ETL using heterogeneous sources
You will build data ingestion from various source systems to Hadoop using Kafka, Flume, Sqoop, Spark Streaming etc.
You will transform data using data mapping and data processing capabilities like MapReduce, Spark SQL Expands and grows data platform capabilities to solve new data problems and challenges
Supports Big Data and batch/real time analytical solutions leveraging transformational technologies like Apache Beam
You will have the ability to research and assess open source technologies and components to recommend and integrate into the design and implementation
You will work with development and QA teams to design Ingestion Pipelines, Integration APIs, and provide Hadoop ecosystem services
By applying to a job using PingJob.com you are agreeing to comply with and be subject to the PingJob.com Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.