Kafka Architect @ Wissen Technology

• Lead the architecture, setup, configuration, and maintenance of Kafka clusters in high-availability production environments.
  
• Design and implement Kafka Connect integrations with various source and sink systems.
  
• Optimize Kafka cluster performance including tuning producer/consumer settings, partitions, replication, and broker configurations.
  
• Implement Kafka Streams applications for real-time data processing.
  
• Ensure robust security, fault tolerance, and scalability of Kafka infrastructure.
  
• Establish best practices for message schema design, error handling, and data retention policies.
  
• Collaborate with development, DevOps, and data engineering teams to integrate Kafka with microservices, data lakes, and analytics platforms.
  
• Proactively monitor and manage the health of Kafka infrastructure using monitoring tools.
  
• Provide technical leadership, documentation, and mentorship to development and operations teams.
  
• Participate in incident management and root cause analysis for Kafka-related issues.
  

Required Skills & Qualifications:

• Proven experience as a Kafka Architect or Senior Kafka Engineer in large-scale production environments.
  
• Hands-on expertise with:
  
• Kafka Connect (custom and pre-built connectors)
  
• Kafka performance tuning and monitoring
  
• Kafka setup, upgrades, patching , and day-to-day cluster maintenance
  
• Kafka Streams for real-time data processing
  
• Strong understanding of distributed systems, fault tolerance, and scalability principles.
  
• Experience integrating Kafka with various systems (databases, data lakes, cloud platforms, etc.).
  
• Proficient in one or more programming languages such as Java, Scala, or Python.
  
• Familiarity with monitoring tools like Prometheus, Grafana, Confluent Control Center, or similar.
  
• Strong problem-solving skills and ability to work under pressure in complex environments.