Spark Admin
Wells Fargo & Company 2 Reviews
Contract Charlotte, North Carolina, United States Posted 3 months ago
About Position
Spark Admin (Contract)
$80.00 / Hourly
Charlotte, North Carolina, United States
Spark Admin
Contract Charlotte, North Carolina, United States Posted 3 months ago
Description
We are seeking an Engineer specializing in Platform Support to ensure the seamless operation and optimization of our infrastructure. The ideal candidate will possess expertise managing Hadoop/Spark Clusters, Spark Application with an understanding of Helm and Kubernetes would be good. This role requires adept problem-solving skills, the ability to collaborate across teams, and a passion for maintaining high-performance systems.
Responsibilities
- • Provide advanced support for the company's platform infrastructure, focusing on Spark technologies.
- • Monitor system performance, diagnose, and troubleshoot issues, and implement solutions to maintain high availability and reliability.
- • Manage Hadoop clusters, including HDFS, YARN, and related ecosystem components, to support big data processing and analytics workloads.
- •Configure and fine-tune Spark clusters for optimal performance and resource utilization, including memory management, scheduling, and data locality optimizations.
- •Monitor cluster health and performance metrics using tools like Cloudera Manager, Ambari, or custom monitoring solutions, and proactively address any issues that may arise.
- • Conduct regular performance assessments, identify areas for improvement, and implement optimizations to enhance platform scalability and stability.
- • Exposure to HELM, Kubernetes is good to have.
- • Participate in on-call rotation to provide timely resolution of critical incidents and ensure 24/7 system availability.
- Document procedures, configurations, and best practices to facilitate knowledge sharing and ensure operational continuity.
- • Stay updated on emerging technologies and industry trends related to platform support and distributed computing.
By applying to a job using PingJob you are agreeing to comply with and be subject to the PingJob Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.