1 Why KRaft Exists Apache Kafka Distributed Systems · 3:39 Discover why Apache Kafka moved away from its longtime dependency on ZooKeeper, exploring the critical roles ZooKeeper once played in managing broker registration, metadata storage, and controller election within Kafka's architecture.
3 The Raft Consensus Protocol Primer Apache Kafka Distributed Systems · 4:10 A deep dive into the Raft consensus protocol, exploring how distributed systems achieve coordination through leader election and the roles nodes play in maintaining safety and reliability across a cluster.
1 Node Roles Apache Kafka Distributed Systems · 3:21 Explore the three distinct node roles in Apache Kafka's KRaft architecture — controller, broker, and combined — and learn how each contributes to managing metadata and handling client requests within a cluster.
1 The KRaft Protocol (Raft Implementation) Apache Kafka Distributed Systems · 3:55 Dive into KRaft, Apache Kafka's modern consensus protocol that eliminates the dependency on ZooKeeper, and discover how leader election and key RPCs like Vote and BeginQuorumEpoch work together to manage distributed coordination natively within Kafka itself.
2 What is KRaft? Apache Kafka Distributed Systems · 3:06 Exploring Kafka's internal metadata management system, KRaft replaces the long-standing ZooKeeper dependency by building consensus and cluster state management directly into Kafka's core architecture.
4 Broker Lifecycle in KRaft Apache Kafka Distributed Systems · 4:29 Explore the complete lifecycle of a Kafka broker in KRaft mode, from initial registration and epoch assignment to heartbeats, fencing states, and graceful or unexpected shutdowns.
2 The Metadata Log (`__cluster_metadata` topic) Apache Kafka Distributed Systems · 3:40 Dive into the heart of Apache Kafka's cluster management with an exploration of the `__cluster_metadata` topic, a special single-partition, replicated log that records every metadata change flowing through the system.
3 The Quorum Controller Apache Kafka Distributed Systems · 3:20 Dive into the heart of Kafka's leadership architecture as the Quorum Controller uses Raft consensus to elect a single leader from a group of nodes, ensuring every member has a voice in the decision.
3 Why Strimzi? Apache Kafka Distributed Systems · 4:54 Discover why running Apache Kafka on Kubernetes requires more than standard pod deployments, exploring the unique challenges of stateful workloads, persistent storage, and stable network identity that make a dedicated operator like Strimzi essential.
3 Metadata Records & Versioning Apache Kafka Distributed Systems · 4:37 Dive into the architecture of KRaft's metadata layer, where eight distinct record types work together to track topics, partitions, and broker registrations in a Kafka cluster.
2 Custom Resource Definitions (CRDs) Apache Kafka Distributed Systems · 4:39 Dive into the world of Kubernetes Custom Resource Definitions as they apply to Apache Kafka, exploring the eight essential CRDs that enable seamless Kafka cluster deployment and management within a Kubernetes environment.