Apache Kafka with Kubernetes

11 chapters

Chapters

  1. 1 Listener Types
    Apache Kafka with Kubernetes · 5:12
    Covering the six listener types available in a Kafka cluster running on Kubernetes, this track breaks down how each listener controls the way clients connect to your streaming data, starting with internal listeners that keep communication safely within the cluster.
  2. Official Documentation
    Apache Kafka with Kubernetes · 3:53
    Dive into Kafka's evolution away from ZooKeeper dependency as KIP-500 introduces KRaft mode, where controllers use the Raft consensus protocol to manage metadata independently and more efficiently.
  3. 2 Configuring External Access
    Apache Kafka with Kubernetes · 3:09
    Dive into the essentials of making your Kafka cluster accessible from outside Kubernetes, covering how advertised listeners, bootstrap discovery, and address resolution work together to connect external clients to your brokers.
  4. 4 Lab: External Access
    Apache Kafka with Kubernetes · 4:19
    Hands-on lab experience awaits as you configure LoadBalancer listeners to expose your Kafka cluster to the outside world, enabling external clients to connect to individual brokers through their own public endpoints.
  5. 1 Kafka Broker Configuration
    Apache Kafka with Kubernetes · 4:39
    Dive into the essential configuration options for Kafka brokers running on Kubernetes with Strimzi, covering everything from log retention and compression settings to JVM heap memory and CPU resource management.
  6. 4 The Road Ahead
    Apache Kafka with Kubernetes · 4:48
    A forward-looking exploration of Kafka's evolution beyond ZooKeeper, covering the KRaft controller architecture and how dynamic quorum management enables seamless broker additions and removals without the disruption of system restarts.
  7. 4 Storage Strategies
    Apache Kafka with Kubernetes · 4:47
    Covering the essential storage strategies for running Kafka on Kubernetes, this track breaks down JBOD (Just a Bunch of Disks) configuration and how multiple independent drives can optimize your broker setup without the overhead of RAID complexity.
  8. 2 Managing Connectors Declaratively
    Apache Kafka with Kubernetes · 3:22
    Dive into the world of declarative connector management using the KafkaConnector custom resource definition (CRD), where you'll learn how to configure and manage Kafka connectors through YAML specifications instead of manual REST API calls.
  9. 3 Common Connector Patterns
    Apache Kafka with Kubernetes · 7:07
    Dive into three essential Kafka connector patterns, including how change data capture tools like Debezium track and stream real-time database changes from PostgreSQL, MySQL, and MongoDB directly into your pipelines.
  10. Talks & Articles
    Apache Kafka with Kubernetes · 4:04
    Exploring the evolution of Apache Kafka's architecture, this song traces the journey from ZooKeeper dependency to the streamlined KIP-500 proposal, revealing how Colin McCabe's vision helped solve critical scaling and metadata management challenges.
  11. 2 Strimzi MirrorMaker 2 Configuration
    Apache Kafka with Kubernetes · 4:34
    Dive into the configuration of Strimzi MirrorMaker 2 and learn how to use the KafkaMirrorMaker2 custom resource definition to set up cross-cluster Kafka replication, connecting source and target clusters to keep your data flowing seamlessly.