Data Engineer

Lowe's

Contract Charlotte, North Carolina, United States Posted 1 month ago

 Write a Review Add Vendor   Add Contact  

About Position

Data Engineer (Contract)

$70.00 / Hourly

Charlotte, North Carolina, United States

Data Engineer

Contract Charlotte, North Carolina, United States Posted 1 month ago

Skills
Airflow Druid Superset
Description

PySPark

Scala

Automation of Pipelines

Airflow/Autosys

Spark

Monitoring/Alerts

GCP DataProc/Composer/BQ

Data modelling



TOP SKILLS AND REQUIRED EXPERIENCE

10+ years of Data Engineering

8+ years of PySpark/Scala

7 years of Scala

5+ years of experience hosting application on GCP



Scala, PySpark, Spark, GCP (DataProc/Composer/BQ), Airflow, Grafana

Responsibilities
  • As a Data Engineer on the team, you’ll be either building new data pipelines or enhancing and supporting existing data pipelines to ingest and transform Marketing data that’d help our business partners make data driven and informed decisions.

By applying to a job using PingJob.com you are agreeing to comply with and be subject to the PingJob.com Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.

Questions / Comments:

Display Questions / Comments:

No Questions / comments

Lowe's Vendors

( Login to see all the 14 vendors)
TEK Systems
Write a Review

971 Corporate Boulevard
Linthicum
Maryland
www.teksystems.com ( 85 vendors)

HCL Technologies America Inc
Write a Review

330 Potrero Avenue
Sunnyvale
California
www.hcltech.com ( 34 vendors)

RCG Global Services
Write a Review

170 South Wood Avenue, 4th Floor
Iselin
New Jersey
www.rcgit.com ( 6 vendors)

Job Summary

$70.00 / Hourly

Contract

Charlotte, North Carolina, United States

Experience Level : Medium

Experience Required : 9 Year/s

Only Any

Posted : 1 month ago

Deadline : March 10, 2025 1 month ago

Job ID : Job0000016280

Lowe's

1000 Lowe's Blvd

www.lowes.com

Request history8.1.32PHP Version2.25sRequest Duration695MBMemory UsageGET {slug}Route
    • Booting (1.76s)time
    • Application (487ms)time
    • 1 x Booting (78.34%)
      1.76s
      1 x Application (21.66%)
      487ms
      3 templates were rendered
      • frontend.job-viewjob-view.blade.php#?blade
      • admin.flash_msgflash_msg.blade.php#?blade
      • layouts.themetheme.blade.php#?blade
      uri
      GET {slug}
      middleware
      web
      controller
      App\Http\Controllers\JobController@view
      namespace
      prefix
      where
      as
      job_view
      file
      app/Http/Controllers/JobController.php:482-507
      11 statements were executed215ms
      • JobController.php#484clientfyi_final13.93msselect * from `jobs` where `job_slug` = 'data-engineer-89' limit 1
        Bindings
        • 0: data-engineer-89
        Backtrace
        • app/Http/Controllers/JobController.php:484
        • vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • User.php#78clientfyi_final93.54msselect `id`, `company` from `users` where `user_type` in ('employer', 'agent') order by `id` desc
        Bindings
        • 0: employer
        • 1: agent
        Backtrace
        • app/Models/User.php:78
        • app/Http/Controllers/JobController.php:491
        • vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
      • JobController.php#493clientfyi_final590μsselect * from `users` where `users`.`id` = 3305 limit 1
        Bindings
        • 0: 3305
        Backtrace
        • app/Http/Controllers/JobController.php:493
        • vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • Vendor.php#57clientfyi_final600μsselect count(*) as aggregate from `vendors` inner join `users` on `vendors`.`vendor_id` = `users`.`id` inner join `states` on `users`.`state_id` = `states`.`id` inner join `countries` on `states`.`country_id` = `countries`.`id` where `vendors`.`approve_status` = 1 and `vendors`.`employer_id` = 3305
        Bindings
        • 0: 1
        • 1: 3305
        Backtrace
        • app/Models/Vendor.php:57
        • app/Http/Controllers/JobController.php:495
        • vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
      • Vendor.php#57clientfyi_final1.21msselect `vendors`.*, `users`.`website`, `users`.`company`, `users`.`address`, `users`.`city`, `states`.`state_name`, `countries`.`country_name`, (SELECT (SUM(ratings)/COUNT(id)) FROM reviews WHERE reviews.employer_id = vendors.vendor_id AND reviews.approve_status = 1) as review_rating, (SELECT COUNT(id) FROM reviews WHERE reviews.employer_id = vendors.vendor_id AND reviews.approve_status = 1) as review_count, (SELECT COUNT(id) FROM vendors as b WHERE b.employer_id = vendors.vendor_id) as vendor_count from `vendors` inner join `users` on `vendors`.`vendor_id` = `users`.`id` inner join `states` on `users`.`state_id` = `states`.`id` inner join `countries` on `states`.`country_id` = `countries`.`id` where `vendors`.`approve_status` = 1 and `vendors`.`employer_id` = 3305 order by `vendor_count` desc limit 3 offset 0
        Bindings
        • 0: 1
        • 1: 3305
        Backtrace
        • app/Models/Vendor.php:57
        • app/Http/Controllers/JobController.php:495
        • vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
      • JobController.php#500clientfyi_final320μsselect (sum(ratings)/count(id)) AS review_rating, count(id) as review_count from `reviews` where `approve_status` = 1 and `employer_id` = 3305
        Bindings
        • 0: 1
        • 1: 3305
        Backtrace
        • app/Http/Controllers/JobController.php:500
        • vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • job-view.blade.php#17clientfyi_final9.95msselect DISTINCT email from `job_applications` where `category_id` = 211 and `status` = 1
        Bindings
        • 0: 211
        • 1: 1
        Backtrace
        • view::frontend.job-view:17
        • vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:124
        • vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
        • vendor/laravel/framework/src/Illuminate/View/View.php:207
      • job-view.blade.php#450clientfyi_final390μsselect * from `comments` where `comments`.`commentable_type` = 'App\\Models\\Job' and `comments`.`commentable_id` = 16280 and `comments`.`commentable_id` is not null and `parent_id` is null
        Bindings
        • 0: App\Models\Job
        • 1: 16280
        Backtrace
        • view::frontend.job-view:450
        • vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:124
        • vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
        • vendor/laravel/framework/src/Illuminate/View/View.php:207
      • theme.blade.php#101clientfyi_final730μsselect * from `categories` where `job_count` >= 1 order by `job_count` desc
        Bindings
        • 0: 1
        Backtrace
        • view::layouts.theme:101
        • vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:124
        • vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
        • vendor/laravel/framework/src/Illuminate/View/View.php:207
      • theme.blade.php#102clientfyi_final45.49msSELECT jobs.state_id,jobs.state_name, COUNT(*) AS numberOfSales FROM jobs JOIN states ON states.id = jobs.state_id GROUP BY jobs.state_id,jobs.state_name ORDER BY COUNT(*) DESC limit 15
        Backtrace
        • view::layouts.theme:102
        • vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:124
        • vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
        • vendor/laravel/framework/src/Illuminate/View/View.php:207
      • theme.blade.php#103clientfyi_final48.15msSELECT jobs.city_id,jobs.city_name, COUNT(*) AS numberOfcities FROM jobs JOIN cities ON cities.id = jobs.city_id GROUP BY jobs.city_id,jobs.city_name ORDER BY COUNT(*) DESC limit 15
        Backtrace
        • view::layouts.theme:103
        • vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:124
        • vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
        • vendor/laravel/framework/src/Illuminate/View/View.php:207
      App\Models\Category
      138Category.php#?
      App\Models\Job
      1Job.php#?
      App\Models\User
      1User.php#?
          _token
          S6cYR5DyBXF55em7xF3eTJAQssmcHYqt8OUHGTX4
          _previous
          array:1 [ "url" => "https://pingjob.com/data-engineer-89" ]
          _flash
          array:2 [ "old" => [] "new" => [] ]
          path_info
          /data-engineer-89
          status_code
          200
          
          status_text
          OK
          format
          html
          content_type
          text/html; charset=UTF-8
          request_query
          []
          
          request_request
          []
          
          request_headers
          0 of 0
          array:18 [ "priority" => array:1 [ 0 => "u=0, i" ] "accept-encoding" => array:1 [ 0 => "gzip, deflate, br, zstd" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "connection" => array:1 [ 0 => "close" ] "x-accel-internal" => array:1 [ 0 => "/internal-nginx-static-location" ] "x-real-ip" => array:1 [ 0 => "3.20.206.27" ] "host" => array:1 [ 0 => "pingjob.com" ] ]
          request_cookies
          []
          
          response_headers
          0 of 0
          array:7 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "private, must-revalidate" ] "date" => array:1 [ 0 => "Sun, 27 Apr 2025 10:10:38 GMT" ] "pragma" => array:1 [ 0 => "no-cache" ] "expires" => array:1 [ 0 => "-1" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6ImNqYngxV3ZHYndBTmJtLy9pZUV0WXc9PSIsInZhbHVlIjoib1hCVEY3U0pFVjdVWWJYTmE0b1lBcjI2OVB4TXJFVDdTVGxGOUxEZ0NyUVJVVjZGUVJoaW13cDROb2ZEMEU5L0JFNmRiUDBjY3pJTExGNU91QktXL2UvQWJlT1JUSHo1T0lMYzVXK2dpSTZ2OTdJTGJObWVNZWo4QThDYWhQTGIiLCJtYWMiOiIyZWZlN2EwN2EwYzI0OTAwMDc3NzE2NTMyMmM5Y2NhYjIzNmJlN2M4ZjI2YzAxOTc2OWM0YWYyMzZjZWQ3YjEwIiwidGFnIjoiIn0%3D; expires=Sun, 27 Apr 2025 12:10:39 GMT; Max-Age=7200; path=/; secure; samesite=laxXSRF-TOKEN=eyJpdiI6ImNqYngxV3ZHYndBTmJtLy9pZUV0WXc9PSIsInZhbHVlIjoib1hCVEY3U0pFVjdVWWJYTmE0b1lBcjI2OVB4TXJFVDdTVGxGOUxEZ0NyUVJVVjZGUVJoaW13cDROb2ZEMEU5L0JFNmRiU" 1 => "laravel_session=eyJpdiI6IlBabTgrVnNIbUdyNVA1a1h6NUx2MlE9PSIsInZhbHVlIjoiOHZRaGt0VW9Bb1JMZWJ5NWQ3R09xRTFKRjZ5SEh0YVlLYTNYQ21RZk12T2srZGpJdzJFMldabW9wd3RsTU5wZC9DZEs0Y3BOK2ZjMFAwSkxqZXZLV0FUR2ZFeUZjeWZRZkFhRDIvOE9WTFp2SGovcGViMTNYVzc2TDBGeWJGQnEiLCJtYWMiOiIzNmJkODM4NTRiODRmMTdiMTU5ZDA1ZTAyM2Q0OWVhN2Q3NmQyMzRkY2ExYzY2OGFmYTkyYmM4ODRjOTYyMTdkIiwidGFnIjoiIn0%3D; expires=Sun, 27 Apr 2025 12:10:39 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6IlBabTgrVnNIbUdyNVA1a1h6NUx2MlE9PSIsInZhbHVlIjoiOHZRaGt0VW9Bb1JMZWJ5NWQ3R09xRTFKRjZ5SEh0YVlLYTNYQ21RZk12T2srZGpJdzJFMldabW9wd3RsTU5wZC9D" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6ImNqYngxV3ZHYndBTmJtLy9pZUV0WXc9PSIsInZhbHVlIjoib1hCVEY3U0pFVjdVWWJYTmE0b1lBcjI2OVB4TXJFVDdTVGxGOUxEZ0NyUVJVVjZGUVJoaW13cDROb2ZEMEU5L0JFNmRiUDBjY3pJTExGNU91QktXL2UvQWJlT1JUSHo1T0lMYzVXK2dpSTZ2OTdJTGJObWVNZWo4QThDYWhQTGIiLCJtYWMiOiIyZWZlN2EwN2EwYzI0OTAwMDc3NzE2NTMyMmM5Y2NhYjIzNmJlN2M4ZjI2YzAxOTc2OWM0YWYyMzZjZWQ3YjEwIiwidGFnIjoiIn0%3D; expires=Sun, 27-Apr-2025 12:10:39 GMT; path=/; secureXSRF-TOKEN=eyJpdiI6ImNqYngxV3ZHYndBTmJtLy9pZUV0WXc9PSIsInZhbHVlIjoib1hCVEY3U0pFVjdVWWJYTmE0b1lBcjI2OVB4TXJFVDdTVGxGOUxEZ0NyUVJVVjZGUVJoaW13cDROb2ZEMEU5L0JFNmRiU" 1 => "laravel_session=eyJpdiI6IlBabTgrVnNIbUdyNVA1a1h6NUx2MlE9PSIsInZhbHVlIjoiOHZRaGt0VW9Bb1JMZWJ5NWQ3R09xRTFKRjZ5SEh0YVlLYTNYQ21RZk12T2srZGpJdzJFMldabW9wd3RsTU5wZC9DZEs0Y3BOK2ZjMFAwSkxqZXZLV0FUR2ZFeUZjeWZRZkFhRDIvOE9WTFp2SGovcGViMTNYVzc2TDBGeWJGQnEiLCJtYWMiOiIzNmJkODM4NTRiODRmMTdiMTU5ZDA1ZTAyM2Q0OWVhN2Q3NmQyMzRkY2ExYzY2OGFmYTkyYmM4ODRjOTYyMTdkIiwidGFnIjoiIn0%3D; expires=Sun, 27-Apr-2025 12:10:39 GMT; path=/; httponlylaravel_session=eyJpdiI6IlBabTgrVnNIbUdyNVA1a1h6NUx2MlE9PSIsInZhbHVlIjoiOHZRaGt0VW9Bb1JMZWJ5NWQ3R09xRTFKRjZ5SEh0YVlLYTNYQ21RZk12T2srZGpJdzJFMldabW9wd3RsTU5wZC9D" ] ]
          session_attributes
          0 of 0
          array:3 [ "_token" => "S6cYR5DyBXF55em7xF3eTJAQssmcHYqt8OUHGTX4" "_previous" => array:1 [ "url" => "https://pingjob.com/data-engineer-89" ] "_flash" => array:2 [ "old" => [] "new" => [] ] ]
          ClearShow all
          Date ↕MethodURLData
          #12025-04-27 10:10:39GET/data-engineer-89311140