Big Data Engineer
PacifiCorp
Contract Portland, Oregon, United States Posted 3 years ago
About Position
Big Data Engineer (Contract)
$86.00 / Hourly
Portland, Oregon, United States
Big Data Engineer
Contract Portland, Oregon, United States Posted 3 years ago
Description
1. Design & develop batch and complex event processing applications
2. Design and develop Spark Streaming jobs to consume data from Messaging queues (like Kafka) and persist in HDFS/HBASE/Hive
3. Design and develop text parsers (XML and JSON)
4. Design data models in HBase to store non-relational data such as XML JSON etc.
5. Design and develop access layer in Phoenix for HBase tables
6. Performance tune Batch and Streaming applications to meet the required SLAs
7. Design and develop ETL jobs to load data into Hive using Java/Python/HiveQL
8. Design and develop ETL jobs to process data in Spark and load it into Hive/HBase
9. Develop Sqoop jobs to load data from relational databases into HDFS/Hive
10 .Support Production activities
By applying to a job using PingJob.com you are agreeing to comply with and be subject to the PingJob.com Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.
