Data Streaming Engineer

Data Streaming Engineer job vacancy in Cape Town.

Are you a skilled Data Streaming Engineer passionate about real-time data processing and cutting-edge technology? Join our PBT team and play a pivotal role in shaping data streaming architecture.

This position offers the opportunity to work with industry-leading tools like Kafka and Flink, collaborating with talented development and data engineering teams to deliver efficient and scalable solutions.

Key Responsibilities:

1. Build and Maintain: Design, develop, and manage robust streaming pipelines using Kafka and Flink.
2. Real-Time Processing: Handle data integration, transformation, and processing in real-time environments.
3. Collaboration: Work closely with engineering teams to integrate streaming solutions into the broader data ecosystem.
4. Reliability: Implement monitoring and alerting systems to ensure the reliability and performance of data pipelines.
5. Optimization: Develop fault-tolerant systems and optimize data flows for scalability and efficiency.

Key Requirements:

1. Expertise in Kafka and Flink: Proven experience with these technologies is essential.
2. Real-Time Data Processing: Strong background in distributed systems and real-time data solutions.
3. Data Engineering Experience: Skilled in building scalable and maintainable data pipelines.
4. Programming Proficiency: Advanced knowledge of Python, Java, or Scala.
5. Cloud Platforms: Experience with AWS, GCP, or Azure is a significant advantage.
6. DevOps Familiarity: Understanding of DevOps tools and principles.

Additional Skills:

1. Problem-Solving: Analytical mindset with the ability to tackle complex challenges.
2. Independence: Ability to work autonomously while managing intricate projects.
3. Communication: Strong verbal and written communication skills for effective collaboration with cross-functional teams.