In this talk we provide a short introduction to Apache Kafka and walk you through the steps to deploy Apache Kafka with Strimzi Kafka Operator on Kubernetes and show you how you can manage it using native Kubernetes tools.
Apache Kafka is used for building real-time data pipelines and streaming apps. It is horizontally scalable, fault-tolerant, and can be used for Stream Processing, as a Storage or Messaging System and more. Running and operating Stateful apps on Kubernetes is not easy, at least if you’re going to deal with replication and have to take care of syncing and re-balancing your streaming data on different nodes and / or different clusters in different regions. Kubernetes is about Resiliency and Scale, Kafka too! Kafka is Stateful, Kubernetes' support for Statefulsets has reached a mature state!
Speakers: Anatoly Zelenin