Course Outline
Introduction
- Fundamentals of Apache Kafka
- Overview of event streaming and real-time data processing concepts
- Detailed look at Apache Kafka features and capabilities
- Exploring use cases and the benefits of Kafka in modern development
Kafka Architecture and Core Concepts
- Understanding the Kafka architecture: brokers, topics, partitions, and replicas
- Roles of producers and consumers in publishing and consuming messages
- The function of ZooKeeper within the Kafka ecosystem
Topics and Partitions in Kafka
- Creating and configuring topics effectively
- Implications of partitioning and how it affects data distribution
- Ensuring replication and fault-tolerance in Kafka systems
Building Kafka Producers
- Implementing Kafka producers across various programming languages
- Techniques for message serialization and deserialization
- Key producer configurations and industry best practices
Developing Kafka Consumers
- Building Kafka consumers using different programming languages
- Managing consumer groups and offset management
- Strategies for message processing and ensuring delivery guarantees
External Integration via Kafka Connect
- Overview of Kafka Connect and its connector ecosystem
- Configuring and utilizing Kafka Connect for seamless data integration
- Connecting Kafka with diverse external systems
Streaming Applications with Kafka Streams & ksqlDB
- Introduction to Kafka Streams and its processing capabilities
- Developing robust stream processing applications with Kafka Streams
- Leveraging ksqlDB for real-time data processing and analytics
Cloud Integration with Confluent Cloud
- Overview of Confluent Cloud features and benefits
- Setting up and connecting Kafka client applications to Confluent Cloud
Kafka Security
- Introduction to security features within Kafka
- Configuring SSL/TLS for secure communication channels
- Implementing authentication and authorization mechanisms
Monitoring and Operations
- Utilizing metrics and tools to monitor Kafka performance
- Managing Kafka clusters and resource allocation
- Troubleshooting common issues and optimizing performance
Best Practices and Real-World Applications
- Best practices for designing efficient Kafka-based applications
- Case studies showcasing Kafka implementations across various industries
- Strategies for building scalable and fault-tolerant Kafka architectures
Summary and Next Steps
Requirements
- Fundamental programming knowledge
Target Audience
- Developers
- Programmers
Testimonials (2)
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
Georgi - BMW SA
Course - Apache Kafka for Developers
The labs and the slides combine well with Jorge's knowledge and love for Kafka.