Apache Kafka Series – Learn Apache Kafka for Beginners

Apache Kafka Series – Learn Apache Kafka for Beginners

English | MP4 | AVC 1280×720 | AAC 44KHz 2ch | 4h 02m | 1.02 GB

Learn the Apache Kafka ecosystem, core concepts, operations, Kafka API, and build your own producers and consumers

Apache Kafka has become the leading data-streaming enterprise technology. Kafka is used in production by over 2000 companies like Netflix, Airbnb, Uber and LinkedIn. To learn Kafka easily, step-by-step, you have come to the right place!

Apache Kafka and its ecosystem: In this section, we will learn about the Apache Kafka ecosystem, and see how some target architectures may look. This high-level section helps you to set context around Kafka!

Apache Kafka Core Concepts: In this section, we will learn about all the fundamental concepts of Kafka like topics, partitions, replication, brokers, producers, consumers, consumer groups, Zookeeper, delivery semantics, and more!

Docker and Kafka Setup: In this section, we will learn how to install Docker on your machine and get started with Apache Kafka, in the simplest way possible.

Apache Kafka Hands-on Practice: In this section, we will gain some practical experience by learning how the various command lines tool work, as well as how to use the Kafka Topics UI, and create your very first producer and consumer in Java.

Code Examples – Libraries Integrations: In this section, we will learn about some more advanced code examples, and understand where to find the libraries to integrate with frameworks such as Spark, Spark Streaming, Akka Streams, Scala, Actors, Apache NiFi.

Advanced Topic Configuration: In this section, we will understand the main configurations for your topics, learn about log compaction, and understand exactly what your partitions are made of!

Learning and getting hands-on experience with Apache Kafka helps you to enhance your career opportunities and helps to boost your income. An investment in your career is an investment in yourself. Don’t procrastinate. There is no time like the present to take charge of your career. Take your career to the next level by learning Apache Kafka today!

What You Will Learn

  • Learn about the Apache Kafka ecosystem, architecture, core concepts and operations.
  • Master the fundamental concepts behind Apache Kafka such as topics, partitions, brokers, producers, consumers, and many more.
  • Start a personal Kafka Cluster for development purposes (we’ll install and use Docker for this).
  • Create and configure topics and start writing data to and reading data from topics.
  • Integrate with popular programming frameworks, such as Spark, Spark Streaming, Akka Actors, Akka Stream, Scala, and Apache NiFi.
Table of Contents

01 Course Objectives
02 Pre-requisites before getting started
03 What is Apache Kafka
04 Kafka and the Kafka ecosystem – high level overview
05 Kafka Architecture within the enterprise
06 How to ask questions in the Q&A
07 Topics and Partitions
08 Brokers and Data Replication
09 Producers
10 Consumers and Consumer Groups
11 Zookeeper
12 Kafka Guarantees, Message Ordering
13 Delivery Semantics – At least once, at most once, exactly once
14 Pre-requisite – Docker on Mac (recent versions)
15 Pre-requisite – Docker Toolbox on Mac (older versions)
16 Pre-requisite – Docker on Linux (Ubuntu as an example)
17 Pre-requisite – Docker on Windows 10 64bit
18 Pre-requisite – Docker Toolbox on Windows (other versions)
19 Starting Kafka!
20 Topic operations – create, list, delete, describe
21 Publishing data to a topic using the console producer
22 Consuming data from a topic using the console consumer
23 Kafka Topics UI
24 Writing your own producer
25 Writing your own consumer
26 Kafka Producer and Consumer Examples
27 Spark & Spark Streaming Integration
28 Akka Streams Integration
29 Scala Library & Actor Model Integration
30 Apache NiFi Integration
31 Why should I care about Topic Configuration
32 Hands on – Changing Topic Configurations
33 Partitions Count & Replication Factor
34 Segments and Indexes
35 Log Cleanup Policy – Overview
36 Log Cleanup Policy – ‘delete’ based on Time and Bytes
37 Log Cleanup Policy – Log Compaction – Theory
38 Hands On – Log Compaction
39 Log Compression
40 What’s next