English | MP4 | AVC 1920×1080 | AAC 48KHz 2ch | 5h 06m | 2.13 GB
Explore the Apache Kafka ecosystem and architecture, and learn client API programming in Java
This course is designed to get you up and running with the fundamentals and the working of Apache Kafka with the help of practical examples. You will also delve into client API programming in Java. As you progress, you will not only cover the Apache Kafka stack, but also the architecture of Kafka components and Kafka client APIs (Producers and Consumers). The course will even guide you on how to apply the knowledge you’ve gained through the course to create efficient Kafka programs in Java.
This course is based on Apache Kafka 2.x. All the source code and examples used in this course on Apache Kafka 2.3 open-source distribution have been tested. Several examples in this course also make use of the Confluent Community Version of Kafka. The course will focus on the Confluent Community Version to explain and demonstrate functionalities that are only available in the Confluent Platform, such as Schema Registry and Avro Serdes.
This course will be making extensive use of IntelliJ IDEA as the preferred development IDE. However, based on your prior experience, you should be able to work with any other IDE designed for Java application development.
Although the course will be using Apache Maven as the preferred build tool, based on your prior experience, you should be able to use any other build tool designed for Java applications.
In addition to this, the course will use Log4j2 to teach you industry-standard log implementation in your applications.
This course is fully example-driven and several examples will be created in the class.
By the end of this course, you will have gained the skills you need to confidently build Kafka programs in Java.
Learn
- Delve into the multi-node Confluent Community of Kafka
- Discover the Kafka Storage architecture
- Gain insights into the Kafka Cluster architecture
- Understand Kafka Consumer API programming in Java
- Get up to speed with JSON and AVRO Serialization
Table of Contents
Kafka Ecosystem – The Big Picture
1 What is Apache Kafka
2 Apache Kafka Core Concepts
3 Kafka Connect Core Concepts
4 Kafka Streams Core Concepts
5 Kafka SQL Core Concepts
6 When to use what
Apache Kafka- Getting Started
7 Kafka Quick Start
8 Installing Single Node Kafka Cluster
9 Using Command-Line Producer and Consumer
10 Installing a Multi-Node Kafka Cluster
11 Using Consumer Groups
12 Configuring your development IDE
Apache Kafka- Storage Architecture
13 Understanding Kafka Storage Architecture
14 Kafka Topics and Partitions
15 Kafka Topic Replication
16 Partition Leaders and Followers
17 Kafka Log Segments
18 Kafka Message Offsets
19 Kafka Message Index
Apache Kafka- Cluster Architecture
20 Understanding Kafka Cluster
21 Zookeeper in Kafka
22 Kafka Cluster Controller
23 Partition Allocation and Fault Tolerance
24 Partition Leader Vs Partition Follower
25 The ISR List – In Sync Replica
26 Committed Vs Un-Committed Records
27 Minimum ISR List
Apache Producer Internals
28 Introducing Kafka Producers
29 Creating your first Kafka Producer
30 Producer Record
31 Producer Serializer
32 Producer Partitioner
33 Message Timestamp
34 Producer Message Buffer
35 Producer IO Thread and Retires
36 Summarizing Producer Internals
Advanced Kafka Producers
37 Horizontal Vs. Vertical Scalability
38 Producer Multi-Threading Scenario
39 Creating Multi-Threaded Kafka Producer
40 At Least Once Vs. At Most Once
41 Exactly Once – Producer Idempotence
42 Transactions in Kafka Producer
Types and Serialization
43 Working with Types and Serialization
44 Using JSON Schema
45 Using AVRO Schema
Micro Project- Summing up the Producers
46 POS Simulator using JSON Serialized Invoices
47 POS Simulator using AVRO Serialized Invoices
Kafka Consumers
48 Introducing Kafka Consumers
49 Creating Kafka Consume – Transform – Produce Pipeline
50 Consumer Group and Scalability
51 Consumer Positions – Current Offset Vs. Committed Offset
Where to go Next
52 Challenges with Kafka Consumers
Resolve the captcha to access the links!