Strimzi : Apache Kafka sur Kubernetes — Programme de formation complet

Subject: Strimzi : Apache Kafka sur Kubernetes — Programme de formation complet

62 chapters

Chapters

  1. 1 Rappels Kubernetes
    dark merengue, acoustic blues glitch hop, city pop symphonic metal · 3:45
    Learn the fundamental building blocks of Kubernetes through an exploration of Pods, Deployments, StatefulSets, and Services that form the foundation for deploying Apache Kafka. Master how these core components work together to create stable, scalable container orchestration essential for Kafka management.
  2. 2 Fondamentaux d'Apache Kafka
    dark merengue, acoustic blues glitch hop, city pop symphonic metal · 3:13
    Learn the core building blocks of Apache Kafka architecture, including brokers that store data, topics divided into partitions, and how producers send messages while consumers read them in organized sequences. This foundation episode covers essential concepts like data replication for security and the choreographed flow of information through Kafka's distributed system.
  3. 3 Pourquoi Strimzi ?
    dark merengue, acoustic blues glitch hop, city pop symphonic metal · 3:39
    Discover why Apache Kafka's stateful nature makes it challenging to deploy on Kubernetes and learn how Strimzi operator solves complex issues around persistent storage, networking, and pod coordination that traditional Kubernetes struggles to handle.
  4. 1 Les opérateurs Strimzi
    dark merengue, acoustic blues glitch hop, city pop symphonic metal · 3:17
    Learn about Strimzi's four essential Kubernetes operators - Cluster, Topic, User, and Entity - and discover how they work together through reconciliation loops to seamlessly deploy and manage Apache Kafka clusters.
  5. 2 Définitions de ressources personnalisées (CRDs)
    dream pop, bengali barbershop, dark salsa, gnawa funk · 3:27
    Learn how Strimzi leverages eight custom resource definitions (CRDs) in Kubernetes to orchestrate Apache Kafka clusters through declarative configuration. Discover the fundamental role of the Kafka CRD as the primary resource that serves as the foundation for your entire cluster deployment.
  6. 3 Comment Strimzi fait correspondre Kafka aux primitives Kubernetes
    alternative r&b, american primitivism bedroom pop, griot · 3:06
    Discover how Strimzi cleverly maps Kafka brokers to Kubernetes primitives like StatefulSets and StrimziPodSets, ensuring each broker maintains its unique identity and ordered deployment. Learn the technical foundations that enable Kafka's distributed architecture to seamlessly integrate with Kubernetes orchestration.
  7. 1 Prérequis
    dream pop, bengali barbershop, dark salsa, gnawa funk · 2:37
    Learn the essential prerequisites for deploying Apache Kafka on Kubernetes, from setting up local development environments with Minikube and Docker Desktop to selecting production-ready cloud platforms like Amazon EKS and Microsoft AKS. This foundational overview prepares you to build the proper infrastructure needed before diving into Strimzi implementation.
  8. 2 Installation de Strimzi
    dark merengue, acoustic blues glitch hop, city pop symphonic metal · 3:33
    Learn the three essential deployment methods for installing Strimzi on Kubernetes clusters, comparing Helm charts, YAML manifests, and OperatorHub approaches. Discover which installation path best fits your Apache Kafka infrastructure needs and technical requirements.
  9. 3 Déploiement de votre premier cluster Kafka
    trap, electropop grunge, swamp blues, tabla hawaiian · 2:21
    Learn the essential steps for deploying your first Kafka cluster on Kubernetes using Strimzi, from creating YAML configuration files to monitoring the reconciliation process and checking cluster status.
  10. 4 Atelier pratique : Bonjour Strimzi
    dream pop, bengali barbershop, dark salsa, gnawa funk · 3:34
    Learn hands-on deployment of Apache Kafka clusters using Strimzi on a local Kubernetes environment, covering three-broker configurations with persistent storage and declarative YAML management. Master the practical steps for setting up Kafka infrastructure through Kubernetes orchestration and Strimzi operator automation.
  11. 1 Configuration des courtiers Kafka
    alternative r&b, american primitivism bedroom pop, griot · 2:56
    Learn how to configure Kafka brokers in Strimzi through the essential four pillars of configuration, JVM settings, storage, and listeners. Master the spec.kafka.config approach to ensure your Kafka cluster runs smoothly on Kubernetes.
  12. 2 Configuration de ZooKeeper
    dark merengue, acoustic blues glitch hop, city pop symphonic metal · 3:48
    Learn the essential requirements for deploying ZooKeeper in Kubernetes environments, including minimum node configurations, resource allocation strategies, and performance optimization techniques to ensure high availability and system stability.
  13. 3 Mode KRaft (Kafka sans ZooKeeper)
    dreamy tango, drill raga, dembow balkan brass band · 3:21
    Explore Kafka's revolutionary KRaft mode that eliminates ZooKeeper dependency, learning the three essential configuration patterns for controllers in modern Kubernetes deployments. Discover how Strimzi implements this architectural shift and the practical implications for your Kafka infrastructure.
  14. 4 Stratégies de stockage
    alternative r&b, american primitivism bedroom pop, griot · 3:25
    Explore four essential data storage strategies for Apache Kafka on Kubernetes using Strimzi, learning how to configure JBOD setups and optimize disk allocation for maximum broker performance.
  15. 5 Optimisation des ressources
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Learn how to properly allocate and optimize CPU and memory resources for Kafka brokers and ZooKeeper in Kubernetes environments. Discover essential JVM heap configuration techniques including Xms/Xmx settings and garbage collection optimization for peak performance.
  16. 1 Types d'écouteurs (Listeners)
    dark merengue, acoustic blues glitch hop, city pop symphonic metal
    Explore the six essential Kafka listener types on Kubernetes, from internal ClusterIP configurations to external access methods like Routes, LoadBalancers, and NodePorts that enable seamless communication between your applications and Kafka clusters.
  17. 2 Configuration de l'accès externe
    dreamy tango, drill raga, dembow balkan brass band · 3:37
    Learn how to configure external access to Kafka brokers running in Kubernetes, focusing on advertised listeners as the essential mechanism for enabling client connections from outside the cluster.
  18. 3 Politiques réseau
    alternative r&b, american primitivism bedroom pop, griot
    Learn how to secure your Kafka deployment on Kubernetes through three essential network policies that control broker traffic and isolate ZooKeeper components. Master the critical security configurations needed to protect your Strimzi-managed Apache Kafka clusters from unauthorized network access.
  19. 4 Atelier pratique : Accès externe
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Learn how to configure Strimzi listeners and external services to expose your Kafka cluster beyond Kubernetes boundaries using LoadBalancer types and port 9042. Master the essential YAML configurations needed to make your Kafka deployment accessible from external networks and applications.
  20. 1 Chiffrement TLS
    alternative r&b, american primitivism bedroom pop, griot
    Learn how Strimzi's integrated certificate authority automatically generates and manages TLS certificates to secure Apache Kafka clusters running on Kubernetes, ensuring encrypted data flows and robust cluster protection.
  21. 2 Authentification
    dark merengue, acoustic blues glitch hop, city pop symphonic metal
    Explore three essential authentication methods in Strimzi - mutual TLS certificates, SCRAM-SHA-512, and OAuth 2.0 - to secure your Apache Kafka clusters running on Kubernetes. Learn how each method protects your messaging infrastructure and when to implement each authentication strategy for optimal security.
  22. 3 Autorisation
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Learn how to implement authorization in Strimzi using KafkaUser resources and Access Control Lists (ACLs) to define read and write permissions for Apache Kafka on Kubernetes. This technical guide covers the fundamental authorization specifications needed to secure your Kafka cluster deployment.
  23. 4 Chiffrement des données au repos
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Learn how to secure dormant data in Kubernetes environments through encryption at rest, covering etcd protection and CSI driver storage security techniques. Discover essential methods for transforming secrets and sensitive information into encrypted code that safeguards your Apache Kafka deployments.
  24. 5 Atelier pratique : Sécuriser un cluster Strimzi
    surf acoustic blues, grime reggaeton, acoustic blues glitch hop
    Learn hands-on security implementation for Strimzi clusters by configuring TLS encryption, authentication mechanisms, and certificate management through YAML configurations. Discover how to protect Kafka message transit and secure all cluster listeners to ensure data travels safely across your Kubernetes environment.
  25. 1 Kafka Connect sur Strimzi
    dark merengue, acoustic blues glitch hop, city pop symphonic metal
    Learn how to deploy and configure Kafka Connect on Kubernetes using Strimzi's KafkaConnect custom resource, including cluster setup and custom connector integration. This foundational lesson covers the essential concepts for managing data streaming connections in a cloud-native Apache Kafka environment.
  26. 2 Gestion déclarative des connecteurs
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Learn how to manage Kafka connectors declaratively in Kubernetes using Strimzi's KafkaConnector CRDs, eliminating complex REST API calls in favor of simple YAML configurations. Discover how this modern approach automatically orchestrates connector deployment and stores configuration directly in your cluster.
  27. 3 Patrons de connecteurs courants
    dark merengue, acoustic blues glitch hop, city pop symphonic metal
    Explore three essential Kafka connector patterns including Debezium for real-time change data capture from databases like PostgreSQL, MySQL, and MongoDB, plus learn efficient data synchronization techniques for streaming architectures.
  28. 4 Atelier pratique : Pipeline CDC avec Debezium
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Learn to implement a complete Change Data Capture pipeline using Debezium and KafkaConnect on Kubernetes, transforming every database modification into real-time events. This hands-on workshop guides you through deploying PostgreSQL connectors and capturing live data changes as they happen.
  29. 1 Architecture de MirrorMaker 2
    alternative r&b, american primitivism bedroom pop, griot
    Learn how MirrorMaker 2 creates seamless data bridges between Kafka clusters through its three essential connectors that enable real-time replication from source to target environments. Discover the foundational architecture that transforms distant data centers into synchronized mirror systems working hand in hand.
  30. 2 Configuration de MirrorMaker 2 avec Strimzi
    dreamy tango, drill raga, dembow balkan brass band
    Learn how to configure MirrorMaker 2 on Strimzi using the KafkaMirrorMaker2 Custom Resource Definition to set up seamless data replication between Kafka clusters. Discover the straightforward process of establishing both unidirectional and bidirectional replication patterns for your distributed Kafka infrastructure.
  31. 3 Patrons multi-régions / reprise après sinistre
    dreamy tango, drill raga, dembow balkan brass band
    Learn how to configure multi-region Kafka deployments with three broker patterns for disaster recovery, covering active-passive failover and active-active replication strategies. Discover essential techniques for maintaining data survival and automatic switchover when datacenters fail unexpectedly.
  32. 4 Atelier pratique : Réplication multi-clusters
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Learn to implement multi-cluster Kafka replication using MirrorMaker2 to connect independent Kafka instances across separate Kubernetes namespaces in an active-passive configuration. This practical workshop demonstrates how to create resilient, distributed Kafka architectures that can seamlessly replicate data between clusters for disaster recovery and high availability.
  33. 1 Métriques avec Prometheus
    alternative r&b, american primitivism bedroom pop, griot
    Learn how to configure comprehensive monitoring for your Strimzi-managed Kafka clusters using Prometheus metrics collection, including JMX exporter setup and MetricsConfig resource configuration. Discover how to transform raw Kafka operational data into actionable monitoring insights that keep your distributed streaming platform running smoothly.
  34. 2 Tableaux de bord avec Grafana
    dark merengue, acoustic blues glitch hop, city pop symphonic metal
    Learn how to implement Grafana dashboards for monitoring Strimzi-deployed Kafka clusters on Kubernetes, including importing provided dashboard templates to visualize live metrics. This technical guide transforms complex monitoring concepts into an unexpectedly melodic journey through dashboard configuration and metrics visualization.
  35. 3 Traçage distribué
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Learn how to implement distributed tracing in Strimzi Kafka clusters using OpenTelemetry to gain critical observability into microservice communications. Master the essential techniques for tracking message flows and debugging complex distributed systems running on Kubernetes.
  36. 4 Journalisation
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Explore Kafka logging configuration within Strimzi environments, learning how to set up and manage log levels for brokers, operators, and Kafka Connect components. Master the essential logging properties and Log4j settings needed to effectively monitor and troubleshoot your Kubernetes-based Apache Kafka deployments.
  37. 5 Alertes
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Learn to configure five critical Prometheus alerts that will keep your Kafka clusters running smoothly by monitoring broker health, partition status, and data flow issues. Master the essential monitoring setup that prevents costly downtime and ensures reliable message streaming in your Kubernetes environment.
  38. 6 Atelier pratique : Pile d'observabilité complète
    dreamy tango, drill raga, dembow balkan brass band
    Learn to build a complete observability stack for Apache Kafka on Kubernetes by deploying Prometheus Operator and Grafana to monitor your Strimzi clusters. This hands-on workshop guides you through setting up comprehensive surveillance tools to track the performance and health of your Kafka infrastructure.
  39. 1 Mises à jour progressives et montées de version
    trap, electropop grunge, swamp blues, tabla hawaiian
    Learn how Strimzi orchestrates seamless progressive updates and version upgrades across Kafka clusters on Kubernetes, ensuring zero-downtime deployments through intelligent pod restart sequencing. Discover the operator's precision in maintaining broker availability while systematically updating each cluster node.
  40. 2 Mise à l'échelle
    alternative r&b, american primitivism bedroom pop, griot
    Learn the essential techniques for dynamically scaling your Kafka clusters on Kubernetes, including how to add and remove brokers based on workload demands. Master the art of adaptation through practical strategies for horizontal scaling and workload redistribution in distributed streaming environments.
  41. 3 Cruise Control pour le rééquilibrage
    alternative r&b, american primitivism bedroom pop, griot
    Learn how Kafka's Cruise Control component automatically optimizes partition distribution and workload balancing across Kubernetes clusters through three distinct rebalancing modes. Discover the KafkaRebalance resource and how it ensures optimal broker performance by intelligently managing data assignment.
  42. 4 Sauvegarde et restauration
    trap, electropop grunge, swamp blues, tabla hawaiian
    Learn essential backup and restoration strategies for protecting Kafka data, topics, configurations, and consumer offsets within Kubernetes environments. Discover how to safeguard your streaming infrastructure against crashes and data loss through comprehensive backup protocols.
  43. 5 Résolution des problèmes courants
    alternative r&b, american primitivism bedroom pop, griot
    Learn to diagnose and fix the most common Kafka deployment issues on Kubernetes, from pod crashes and resource constraints to certificate problems and network configuration errors. Master systematic troubleshooting techniques to resolve CrashLoopBackOff states, storage issues, and partition management problems that can derail your Strimzi implementations.
  44. 6 Atelier pratique : Montée de version et rééquilibrage du cluster
    trap, electropop grunge, swamp blues, tabla hawaiian
    Learn the essential steps for upgrading your Kafka cluster version and rebalancing partitions through hands-on practice with YAML configurations and rolling updates. Master the critical process of safely transitioning from one version to the next while maintaining data integrity and cluster stability.
  45. 1 Haute disponibilité
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Learn the essential configuration requirements for achieving high availability in Apache Kafka deployments on Kubernetes, including minimum broker counts, replica synchronization settings, and pod disruption budgets. Discover how to properly configure your Kafka cluster with three brokers and two in-sync replicas to ensure resilient, fault-tolerant messaging infrastructure.
  46. 2 Optimisation des performances
    surf acoustic blues, grime reggaeton, acoustic blues glitch hop
    Learn advanced Kafka performance tuning techniques including batch sizing, compression settings, and thread optimization to maximize throughput and efficiency in Kubernetes environments. Master the critical parameters that transform sluggish data streams into high-performance messaging powerhouses.
  47. 3 Planification de la capacité
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Learn the essential formula for calculating Kafka storage requirements on Kubernetes by understanding how retention periods, data throughput, and replication factors work together to determine your cluster's capacity needs.
  48. 4 GitOps et infrastructure en tant que code
    alternative r&b, american primitivism bedroom pop, griot
    Explore GitOps principles and infrastructure as code practices for deploying Strimzi on Kubernetes, featuring tools like ArgoCD, Flux, Helm, and Kustomize. Learn how declarative deployments stored in Git repositories eliminate manual configuration errors and create synchronized, reliable Apache Kafka infrastructures.
  49. 5 Multi-locataires (Multi-Tenancy)
    alternative r&b, american primitivism bedroom pop, griot
    Learn how to implement multi-tenancy strategies in Kafka deployments on Kubernetes, exploring namespace isolation and resource partitioning techniques that allow multiple teams to safely share the same cluster infrastructure. Discover best practices for organizing and securing tenant separation while maintaining operational efficiency across different organizational units.
  50. 1 Strimzi sur OpenShift
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Learn how to deploy and configure Strimzi Apache Kafka on OpenShift using essential components like Routes, Security Context Constraints (SCCs), and Operator Lifecycle Management (OLM). Discover the differences between open-source Strimzi and Red Hat's commercial AMQ Streams solution for enterprise Kafka deployments.
  51. 2 Kafka Bridge (API HTTP)
    dreamy tango, drill raga, dembow balkan brass band
    Learn how to deploy and configure Kafka Bridge as a Custom Resource Definition in Kubernetes, creating a REST API gateway that seamlessly connects Kafka clusters with applications through YAML configuration and bootstrap server setup.
  52. 3 Intégration du Schema Registry
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Learn how to integrate Schema Registry solutions like Apicurio and Confluent into your Kubernetes-based Kafka ecosystem using Strimzi for better data schema management and message structure control. Discover deployment strategies and best practices for maintaining data consistency across your streaming applications.
  53. 4 Kafka Streams et ksqlDB sur Kubernetes
    surf acoustic blues, grime reggaeton, acoustic blues glitch hop
    Learn how to deploy and orchestrate Kafka Streams and ksqlDB applications on Kubernetes using Strimzi, covering pod management, data processing topologies, and microservices architecture. Discover the integration patterns between KafkaConnect transformations and production-ready streaming applications in containerized environments.
  54. 5 Extensions personnalisées de l'opérateur
    surf acoustic blues, grime reggaeton, acoustic blues glitch hop
    Learn how to extend Strimzi operators with custom reconcilers written in Java that automatically observe and correct differences between desired and actual cluster states. Discover the technical process of building custom extensions that enhance Kafka cluster management capabilities on Kubernetes.
  55. 1 Gouvernance des données
    surf acoustic blues, grime reggaeton, acoustic blues glitch hop
    Learn how to implement proper data governance in Apache Kafka on Kubernetes through systematic topic labeling and metadata management. Discover essential techniques for classifying data as sensitive, public, or confidential to establish clear organizational control over your streaming data architecture.
  56. 2 Journalisation d'audit
    surf acoustic blues, grime reggaeton, acoustic blues glitch hop
    Learn how Kafka's authorization system meticulously tracks and logs every user action, creating comprehensive audit trails that capture who accessed what data, when, and how. Discover the essential mechanisms for maintaining security compliance and monitoring data access patterns in your Kubernetes-deployed Kafka clusters.
  57. 3 Chiffrement et gestion des clés
    surf acoustic blues, grime reggaeton, acoustic blues glitch hop
    Learn how to implement end-to-end encryption and sophisticated key management in Apache Kafka deployments on Kubernetes, covering application-level security measures and integration with Vault and KMS systems. This technical deep-dive reveals the essential practices for protecting data in transit and maintaining robust certificate rotation protocols.
  58. 4 Documentation du contrôle d'accès
    dream pop, bengali barbershop, dark salsa, gnawa funk
    Learn how to properly document and manage access control in Strimzi by mapping Kafka user roles to organizational permissions and implementing ACLs for developers, administrators, and readers. This essential security practice ensures each user has appropriate access levels while maintaining clear documentation of permissions across your Kubernetes-based Kafka deployment.
  59. Annexe A : Aide-mémoire des CRDs Strimzi
    dreamy tango, drill raga, dembow balkan brass band
    Learn the nine essential Custom Resource Definitions (CRDs) that Strimzi uses to deploy and orchestrate Apache Kafka clusters within Kubernetes environments. This comprehensive reference guide covers each CRD's specific role, from launching Kafka clusters with ZooKeeper to managing brokers and their configurations.
  60. Annexe B : Ressources d'apprentissage recommandées
    alternative r&b, american primitivism bedroom pop, griot
    Discover the essential learning resources and documentation needed to master Strimzi and Apache Kafka deployment on Kubernetes. Learn where to find reliable configuration guides, practical examples, and comprehensive documentation to accelerate your container orchestration journey.
  61. Annexe C : Configuration de l'environnement de laboratoire
    dark merengue, acoustic blues glitch hop, city pop symphonic metal
    Learn how to set up your Kubernetes laboratory environment with three practical options: lightweight local Docker with Kind, Minikube with 8GB RAM requirements, or managed cloud services like EKS, AKS, and GKE. This technical guide provides the foundational setup knowledge needed before diving into Apache Kafka deployment on Kubernetes clusters.
  62. Annexe D : Parcours de certification
    alternative r&b, american primitivism bedroom pop, griot
    Explore three essential certification paths for Kafka and Kubernetes professionals, covering developer skills with CCDAK and administrator competencies with CKA and CKAD to advance your technical career.