Azure Data Engineer
Rent-A-Center
Contract Plano , Texas, United States Posted 3 years ago
About Position
Azure Data Engineer (Contract)
$55.00 / Hourly
Plano , Texas, United States
Azure Data Engineer
Contract Plano , Texas, United States Posted 3 years ago
Description
7+ yrs of hands on experience on Databricks - sizing, mounting, database, schema, RBAC
Hands on experience on scripting tools like Python & Shell
Hands on experience on Delta Lake
Knowledge of Spark - Dataframes, PySQL, Spark Libraries
Knowledge of AWS S3, AWS Kinesis, AWS DMS
Well versed in concepts around logging, monitoring, re-startability etc
Strong knowledge of Data Management principles
Experience in building ETL / data warehouse transformation processes
Direct experience of building data pipelines using AWS/Azure Data Factory and Apache Spark (preferably Databricks).
Experience using geospatial frameworks on Apache Spark and associated design and development patterns
Hands on experience designing and delivering solutions
Experience with Apache Kafka / Nifi for use with streaming data / event-based data
Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
Experience working with structured and unstructured data including imaging & geospatial data.
Experience working in a Dev/Ops environment with tools
Strong communication skills
By applying to a job using PingJob.com you are agreeing to comply with and be subject to the PingJob.com Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.
