Data Engineer

Optum

Contract Minnetonka , Minnesota, United States Posted 2 months ago

 Write a Review Add Vendor   Add Contact  

About Position

Data Engineer (Contract)

$75.00 / Hourly

Minnetonka , Minnesota, United States

Data Engineer

Contract Minnetonka , Minnesota, United States Posted 2 months ago

Skills
5+ years of Data engineering experience with a focus on Data Warehousing 2+ years of experience creating pipelines in Azure Data Factory (ADF) 5+ years developing ETL using Informatica PowerCenter SSIS Azure Data Factory or similar tools. 5+ years of experience with Relational Databases such as Oracle Snowflake SQL Server etc. 3+ years of experience creating stored procedures with Oracle PL/SQL SQL Server T-SQL or Snowflake SQL 2+ years of experience with GitHub SVN or similar source control systems 2+ years of experience processing structured and un-structured data. Experience with HL7 and FHIR standards and processing files in these formats. 3+ years analyzing project requirements and developing detailed specifications for ETL requirements. Excellent problem-solving and analytical skills with the ability to troubleshoot and optimize data pipelines. Ability to adapt to evolving technologies and changing business requirements. Bachelors or Advanced Degree in a related field such as Information Technology/Computer Science Mathematics/Statistics Analytics Business
Description

As a member of the Optum Data Management team, the Data Engineer supports the Alabama EDS by developing and maintaining workflows, identifying, and resolving data quality issues, and optimizing processes to improve performance. The Data Engineer will also support intrastate agencies by monitoring automated data extracts and working directly with state partners to create new extracts based on business specifications.

Responsibilities
  • Develop and manage effective working relationships with other departments, groups, and personnel with whom work must be coordinated or interfaced
  • Efficiently communicate with ETL architect while understanding the requirements and business process knowledge in order to transform the data in a way that’s geared towards the needs of end users
  • Assist in the overall architecture of the ETL Design, and proactively provide inputs in designing, implementing, and automating the ETL flows
  • Investigate and mine data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions
  • Developing ETL pipelines and data flows in and out of the data warehouse using a combination of Azure Data Factory and Snowflake toolsets
  • Developing idempotent ETL process design so that interrupted, incomplete, or failed processes can be rerun without errors using ADF dataflows and Pipelines
  • Ability to work in Snowflake Virtual Warehouses as needed in Snowflake and automate data pipelines using Snowpipe for tedious ETL problems
  • Capturing changes in data dimensions and maintaining versions of them using Stream sets in snowflake and scheduling them using Tasks
  • Optimize every step of the data movement not only limited to source and during travel but also when it's at rest in the database for accelerated responses
  • Must have the ability to build a highly efficient orchestrator that can schedule jobs, execute workflows, perform Data quality checks, and coordinate dependencies among tasks
  • Responsible for testing of ETL system code, data design, and pipelines and data flows. Root cause analysis on all processes and resolving production issues are also a part of the process and routine tests on databases and data flow and pipeline testing
  • Responsible for documenting the implementations, and test cases as well as responsible for building deployment documents needed for CI/CD
  • Ideal Background: Data Engineer with Healthcare (Medicaid) and Microsoft Azure based experience with Snowflake and Azure Data Factory
  • Top 3 Requirements:
  • 5+ years of Data engineering experience with a focus on Data Warehousing
  • 2+ years of experience creating pipelines in Azure Data Factory (ADF)
  • 3+ years of experience creating stored procedures with Oracle PL/SQL, SQL Server T-SQL, or Snowflake SQL

By applying to a job using PingJob.com you are agreeing to comply with and be subject to the PingJob.com Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.

Questions / Comments:

Display Questions / Comments:

No Questions / comments

Optum Vendors

( Login to see all the 6 vendors)
Wipro Technologies
Write a Review

1300 Crittenden Lane
Mountain View
California
www.wipro.com ( 61 vendors)

Cognizant Technology Solutions Corporation
Write a Review

500 Frank W. Burr Boulevard
Teaneck
New Jersey
www.Cognizant.com ( 50 vendors)

HCL Technologies America Inc
Write a Review

330 Potrero Avenue
Sunnyvale
California
www.hcltech.com ( 34 vendors)

Job Summary

$75.00 / Hourly

Contract

Minnetonka , Minnesota, United States

Experience Level : Medium

Experience Required : 10 Year/s

Only Any

Posted : 2 months ago

Deadline : February 3, 2025 2 months ago

Job ID : Job0000015956

Optum

11000 Optum Cir

www.optum.com

Share by E-Mail

Check all jobs of this employer

Flag this job

MessagesTimelineExceptionsViews3RouteQueries11Models140MailsGateSessionRequest
Request history8.1.32PHP Version1.96sRequest Duration695MBMemory UsageGET {slug}Route
    • Booting (1.7s)time
    • Application (267ms)time
    • 1 x Booting (86.4%)
      1.70s
      1 x Application (13.6%)
      267ms
      3 templates were rendered
      • frontend.job-viewjob-view.blade.php#?blade
      • admin.flash_msgflash_msg.blade.php#?blade
      • layouts.themetheme.blade.php#?blade
      uri
      GET {slug}
      middleware
      web
      controller
      App\Http\Controllers\JobController@view
      namespace
      prefix
      where
      as
      job_view
      file
      app/Http/Controllers/JobController.php:482-507
      11 statements were executed198ms
      • JobController.php#484clientfyi_final14.13msselect * from `jobs` where `job_slug` = 'data-engineer-84' limit 1
        Bindings
        • 0: data-engineer-84
        Backtrace
        • app/Http/Controllers/JobController.php:484
        • vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • User.php#78clientfyi_final81.68msselect `id`, `company` from `users` where `user_type` in ('employer', 'agent') order by `id` desc
        Bindings
        • 0: employer
        • 1: agent
        Backtrace
        • app/Models/User.php:78
        • app/Http/Controllers/JobController.php:491
        • vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
      • JobController.php#493clientfyi_final550μsselect * from `users` where `users`.`id` = 10940 limit 1
        Bindings
        • 0: 10940
        Backtrace
        • app/Http/Controllers/JobController.php:493
        • vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • Vendor.php#57clientfyi_final500μsselect count(*) as aggregate from `vendors` inner join `users` on `vendors`.`vendor_id` = `users`.`id` inner join `states` on `users`.`state_id` = `states`.`id` inner join `countries` on `states`.`country_id` = `countries`.`id` where `vendors`.`approve_status` = 1 and `vendors`.`employer_id` = 10940
        Bindings
        • 0: 1
        • 1: 10940
        Backtrace
        • app/Models/Vendor.php:57
        • app/Http/Controllers/JobController.php:495
        • vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
      • Vendor.php#57clientfyi_final1.15msselect `vendors`.*, `users`.`website`, `users`.`company`, `users`.`address`, `users`.`city`, `states`.`state_name`, `countries`.`country_name`, (SELECT (SUM(ratings)/COUNT(id)) FROM reviews WHERE reviews.employer_id = vendors.vendor_id AND reviews.approve_status = 1) as review_rating, (SELECT COUNT(id) FROM reviews WHERE reviews.employer_id = vendors.vendor_id AND reviews.approve_status = 1) as review_count, (SELECT COUNT(id) FROM vendors as b WHERE b.employer_id = vendors.vendor_id) as vendor_count from `vendors` inner join `users` on `vendors`.`vendor_id` = `users`.`id` inner join `states` on `users`.`state_id` = `states`.`id` inner join `countries` on `states`.`country_id` = `countries`.`id` where `vendors`.`approve_status` = 1 and `vendors`.`employer_id` = 10940 order by `vendor_count` desc limit 3 offset 0
        Bindings
        • 0: 1
        • 1: 10940
        Backtrace
        • app/Models/Vendor.php:57
        • app/Http/Controllers/JobController.php:495
        • vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
      • JobController.php#500clientfyi_final340μsselect (sum(ratings)/count(id)) AS review_rating, count(id) as review_count from `reviews` where `approve_status` = 1 and `employer_id` = 10940
        Bindings
        • 0: 1
        • 1: 10940
        Backtrace
        • app/Http/Controllers/JobController.php:500
        • vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • job-view.blade.php#17clientfyi_final10.63msselect DISTINCT email from `job_applications` where `category_id` = 211 and `status` = 1
        Bindings
        • 0: 211
        • 1: 1
        Backtrace
        • view::frontend.job-view:17
        • vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:124
        • vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
        • vendor/laravel/framework/src/Illuminate/View/View.php:207
      • job-view.blade.php#450clientfyi_final350μsselect * from `comments` where `comments`.`commentable_type` = 'App\\Models\\Job' and `comments`.`commentable_id` = 15956 and `comments`.`commentable_id` is not null and `parent_id` is null
        Bindings
        • 0: App\Models\Job
        • 1: 15956
        Backtrace
        • view::frontend.job-view:450
        • vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:124
        • vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
        • vendor/laravel/framework/src/Illuminate/View/View.php:207
      • theme.blade.php#101clientfyi_final810μsselect * from `categories` where `job_count` >= 1 order by `job_count` desc
        Bindings
        • 0: 1
        Backtrace
        • view::layouts.theme:101
        • vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:124
        • vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
        • vendor/laravel/framework/src/Illuminate/View/View.php:207
      • theme.blade.php#102clientfyi_final45.68msSELECT jobs.state_id,jobs.state_name, COUNT(*) AS numberOfSales FROM jobs JOIN states ON states.id = jobs.state_id GROUP BY jobs.state_id,jobs.state_name ORDER BY COUNT(*) DESC limit 15
        Backtrace
        • view::layouts.theme:102
        • vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:124
        • vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
        • vendor/laravel/framework/src/Illuminate/View/View.php:207
      • theme.blade.php#103clientfyi_final42.49msSELECT jobs.city_id,jobs.city_name, COUNT(*) AS numberOfcities FROM jobs JOIN cities ON cities.id = jobs.city_id GROUP BY jobs.city_id,jobs.city_name ORDER BY COUNT(*) DESC limit 15
        Backtrace
        • view::layouts.theme:103
        • vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:124
        • vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
        • vendor/laravel/framework/src/Illuminate/View/View.php:207
      App\Models\Category
      138Category.php#?
      App\Models\Job
      1Job.php#?
      App\Models\User
      1User.php#?
          _token
          UYNhPAu5fHyu7yqZ4sccl3GwiWrevRvl0IRjVvUx
          _previous
          array:1 [ "url" => "https://pingjob.com/data-engineer-84" ]
          _flash
          array:2 [ "old" => [] "new" => [] ]
          path_info
          /data-engineer-84
          status_code
          200
          status_text
          OK
          format
          html
          content_type
          text/html; charset=UTF-8
          request_query
          []
          request_request
          []
          request_headers
            0 of 0   
          array:18 [▼
  "priority" => array:1 [▶
    0 => "u=0, i"
  ]
  "accept-encoding" => array:1 [▶
    0 => "gzip, deflate, br, zstd"
  ]
  "sec-fetch-dest" => array:1 [▶
    0 => "document"
  ]
  "sec-fetch-user" => array:1 [▶
    0 => "?1"
  ]
  "sec-fetch-mode" => array:1 [▶
    0 => "navigate"
  ]
  "sec-fetch-site" => array:1 [▶
    0 => "none"
  ]
  "accept" => array:1 [▶
    0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7"
  ]
  "user-agent" => array:1 [▶
    0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
  ]
  "upgrade-insecure-requests" => array:1 [▶
    0 => "1"
  ]
  "sec-ch-ua-platform" => array:1 [▶
    0 => ""Windows""
  ]
  "sec-ch-ua-mobile" => array:1 [▶
    0 => "?0"
  ]
  "sec-ch-ua" => array:1 [▶
    0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129""
  ]
  "cache-control" => array:1 [▶
    0 => "no-cache"
  ]
  "pragma" => array:1 [▶
    0 => "no-cache"
  ]
  "connection" => array:1 [▶
    0 => "close"
  ]
  "x-accel-internal" => array:1 [▶
    0 => "/internal-nginx-static-location"
  ]
  "x-real-ip" => array:1 [▶
    0 => "3.138.151.162"
  ]
  "host" => array:1 [▶
    0 => "pingjob.com"
  ]
]
          request_cookies
          []
          response_headers
            0 of 0   
          array:7 [▼
  "content-type" => array:1 [▶
    0 => "text/html; charset=UTF-8"
  ]
  "cache-control" => array:1 [▶
    0 => "private, must-revalidate"
  ]
  "date" => array:1 [▶
    0 => "Wed, 23 Apr 2025 16:34:32 GMT"
  ]
  "pragma" => array:1 [▶
    0 => "no-cache"
  ]
  "expires" => array:1 [▶
    0 => "-1"
  ]
  "set-cookie" => array:2 [▶
    0 => "XSRF-TOKEN=eyJpdiI6InZsWi9ramtzbmJhOHBmZzF6RU56Smc9PSIsInZhbHVlIjoiakM2dVpQMDI3NXdtOHdHVVl1eElaT3Fod2hSbW5YaU9ub2JKbFV3SmNxTjltbDFyTmJUT3gwUjN4RWs1ZW1ZRUpsZlVQd1dsRVNqLzhxdmt5UmlYb2o2SGEwc0NNQVlKQlc2N2hIb0o3ZjFmRS9HOXlsTUV5aXBIM1RJNVUxeW0iLCJtYWMiOiIyMWVlYjZjZjE1OGMyNjMxNWFiY2Q4MDdjZmU3NmEwYTE0OTdiODRiMjAzY2IyNmM2MTBiODNhNzNhZWQ4YmI0IiwidGFnIjoiIn0%3D; expires=Wed, 23 Apr 2025 18:34:32 GMT; Max-Age=7200; path=/; secure; samesite=lax ◀XSRF-TOKEN=eyJpdiI6InZsWi9ramtzbmJhOHBmZzF6RU56Smc9PSIsInZhbHVlIjoiakM2dVpQMDI3NXdtOHdHVVl1eElaT3Fod2hSbW5YaU9ub2JKbFV3SmNxTjltbDFyTmJUT3gwUjN4RWs1ZW1ZRUpsZlVQd ▶"
    1 => "laravel_session=eyJpdiI6IkZ4cWNHRkliOHdkSlJDbXZsbmp4dnc9PSIsInZhbHVlIjoiUEh6VFl3WWVzUkxoWUdyUERkZTVKNmluODRkcGh2NHpaUHBPUWRveDZXcmFrcElqRVJTMGwxMWRsSmwyVkwzV3JWbndaTTdaZy80YTlRK2RDZUhNV2NhcXlEZ2hPNUxQSHJCSkl3SnZQRmJQODZIaTZ0eFVZemVteVZaeWY3blIiLCJtYWMiOiJkODJkNjE2MjIzMDllZDRhOTY5YWE4ZTQxMTcwOGJlYmE5YWNkY2ZjNmI5YTJlMjY3NmNjMjFhNDA5NWI4OTA1IiwidGFnIjoiIn0%3D; expires=Wed, 23 Apr 2025 18:34:32 GMT; Max-Age=7200; path=/; httponly; samesite=lax ◀laravel_session=eyJpdiI6IkZ4cWNHRkliOHdkSlJDbXZsbmp4dnc9PSIsInZhbHVlIjoiUEh6VFl3WWVzUkxoWUdyUERkZTVKNmluODRkcGh2NHpaUHBPUWRveDZXcmFrcElqRVJTMGwxMWRsSmwyVkwzV3JW ▶"
  ]
  "Set-Cookie" => array:2 [▶
    0 => "XSRF-TOKEN=eyJpdiI6InZsWi9ramtzbmJhOHBmZzF6RU56Smc9PSIsInZhbHVlIjoiakM2dVpQMDI3NXdtOHdHVVl1eElaT3Fod2hSbW5YaU9ub2JKbFV3SmNxTjltbDFyTmJUT3gwUjN4RWs1ZW1ZRUpsZlVQd1dsRVNqLzhxdmt5UmlYb2o2SGEwc0NNQVlKQlc2N2hIb0o3ZjFmRS9HOXlsTUV5aXBIM1RJNVUxeW0iLCJtYWMiOiIyMWVlYjZjZjE1OGMyNjMxNWFiY2Q4MDdjZmU3NmEwYTE0OTdiODRiMjAzY2IyNmM2MTBiODNhNzNhZWQ4YmI0IiwidGFnIjoiIn0%3D; expires=Wed, 23-Apr-2025 18:34:32 GMT; path=/; secure ◀XSRF-TOKEN=eyJpdiI6InZsWi9ramtzbmJhOHBmZzF6RU56Smc9PSIsInZhbHVlIjoiakM2dVpQMDI3NXdtOHdHVVl1eElaT3Fod2hSbW5YaU9ub2JKbFV3SmNxTjltbDFyTmJUT3gwUjN4RWs1ZW1ZRUpsZlVQd ▶"
    1 => "laravel_session=eyJpdiI6IkZ4cWNHRkliOHdkSlJDbXZsbmp4dnc9PSIsInZhbHVlIjoiUEh6VFl3WWVzUkxoWUdyUERkZTVKNmluODRkcGh2NHpaUHBPUWRveDZXcmFrcElqRVJTMGwxMWRsSmwyVkwzV3JWbndaTTdaZy80YTlRK2RDZUhNV2NhcXlEZ2hPNUxQSHJCSkl3SnZQRmJQODZIaTZ0eFVZemVteVZaeWY3blIiLCJtYWMiOiJkODJkNjE2MjIzMDllZDRhOTY5YWE4ZTQxMTcwOGJlYmE5YWNkY2ZjNmI5YTJlMjY3NmNjMjFhNDA5NWI4OTA1IiwidGFnIjoiIn0%3D; expires=Wed, 23-Apr-2025 18:34:32 GMT; path=/; httponly ◀laravel_session=eyJpdiI6IkZ4cWNHRkliOHdkSlJDbXZsbmp4dnc9PSIsInZhbHVlIjoiUEh6VFl3WWVzUkxoWUdyUERkZTVKNmluODRkcGh2NHpaUHBPUWRveDZXcmFrcElqRVJTMGwxMWRsSmwyVkwzV3JW ▶"
  ]
]
          session_attributes
            0 of 0   
          array:3 [▼
  "_token" => "UYNhPAu5fHyu7yqZ4sccl3GwiWrevRvl0IRjVvUx"
  "_previous" => array:1 [▶
    "url" => "https://pingjob.com/data-engineer-84"
  ]
  "_flash" => array:2 [▶
    "old" => []
    "new" => []
  ]
]
          ClearShow all
          Date ↕MethodURLData
          #12025-04-23 16:34:32GET/data-engineer-84311140