Administration of Confluent Apache Kafka Training Course

Module 1: Overview of Confluent Apache Kafka Cluster Architecture and Configuration

• The role of Kafka in contemporary data pipelines
• Distinctions between Apache Kafka and Confluent Kafka
• Core elements: producers, consumers, brokers, topics, and partitions
• Deployment models for Kafka clusters and scaling best practices

Module 2: Configuring Zookeeper Quorums

• Introduction to Zookeeper
• The function of Zookeeper within a Kafka cluster
• Determining the appropriate Zookeeper Quorum size
• Zookeeper configuration essentials
• Implementing SSH on server environments
• Practical exercise: Configuring Zookeeper as a team and service
• Utilizing the Zookeeper Command Line Interface (CLI)
• Practical exercise: Setting up Zookeeper Quorums
• The Zookeeper internal file system
• Performance considerations impacting Zookeeper
• Demonstration of management tools, including Zookeeper and Zoonavigator

Module 3: Kafka Cluster Configuration

• Fundamental Kafka concepts
• General Kafka configuration
• Practical exercise: Configuring Kafka brokers
• Practical exercise: Running Kafka commands
• Practical exercise: Setting up a Kafka Multi-Broker Cluster
• Practical exercise: Testing the Kafka cluster
• Verifying connectivity to your Kafka cluster
• Advertised.listeners configuration: a critical setting
• Topic-specific configuration
• Configuring message downloading and ingestion within topics
• Practical exercise: Demonstrating Kafka resilience
• Kafka performance: I/O operations
• Kafka performance: Network (RED)
• Kafka performance: RAM utilization
• Kafka performance: CPU usage
• Kafka performance: Operating System (OS) interactions
• Kafka performance: Other factors
• Practical exercise: Modifying Kafka broker configurations

Module 4: Advanced Kafka Configurations

• Configuring the Landoop Kafka topic user interface, Confluent REST Proxy, and Confluent Schema Registry
• Message sending and receiving methods (via CLI, Java, and the Spring framework)
• Monitoring metrics and tools (such as Confluent Control Center and Elasticsearch)
• Managing log files and offsets
• High availability and disaster recovery frameworks
• Ensuring high availability through replication
• Optimizing producer and consumer performance
• Disaster recovery strategies
• Failover control and data recovery procedures
• Connector configuration
• Implementing Kafka Connect
• Enhancing Kafka security features

Summary and Recommended Next Steps