Kafka /SSIS Engineer
Builders FirstSource
Contract Irving , Texas, United States Posted 1 week ago
About Position
Kafka /SSIS Engineer (Contract)
$0.00 / Hourly
Irving , Texas, United States
Kafka /SSIS Engineer
Contract Irving , Texas, United States Posted 1 week ago
Skills
· Develop robust SSIS packages to extract data from source systems (e.g. ERP CRM databases) using appropriate connectors. · Perform data cleansing transformation and aggregation within SSIS packages to prepare data for analysis and downstream applications. · Implement data quality checks and validation rules within SSIS workflows to ensure data integrity. Data Pipeline Management: · Design and architect data pipelines that leverage both Kafka and SSIS to efficiently move data between systems. · Monitor data pipeline performance identify bottlenecks and implement optimization strategies. · Implement error handling mechanisms to address data failures and ensure data recovery. Collaboration: · Work closely with business stakeholders to understand data requirements and translate them into effective data pipelines. · Collaborate with IT teams to ensure seamless integration with existing infrastructure and applications.Description
· Design and implement Kafka producer and consumer applications to ingest and distribute data streams from various internal and external sources across the Builders FirstSource ecosystem.
· Manage Kafka topics, partitions, and consumer groups to optimize data flow and performance.
· Monitor Kafka cluster health and troubleshoot potential issues related to data delivery.
Responsibilities
- · Proficient in Apache Kafka concepts (producers, consumers, topics, partitioning, etc.)
- · Expertise in developing SSIS packages using the visual designer and advanced transformation components.
- · Familiarity with SQL and database management systems (e.g., SQL Server)
- · Understanding of data warehousing concepts (if applicable)
- Soft Skills:
- · Strong analytical and problem-solving abilities
- · Excellent communication skills to collaborate with cross-functional teams
- · Ability to work independently and manage multiple projects simultaneously
- · Attention to detail and commitment to data quality
By applying to a job using PingJob.com you are agreeing to comply with and be subject to the PingJob.com Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.
