English | MP4 | AVC 1280×720 | AAC 44KHz 2ch | 48 lectures (4h 4m) | 1.00 GB
Hands-On Training on ZooKeeper Quorum Setup, Kafka Cluster Setup and Administration in AWS.
Attention all struggling System Administrators, Architects or even Developers! Here is course on how to set up and deploy Apache Kafka in Cluster mode.
Do you want to learn how to setup a Kafka Cluster on multiple servers and stop struggling with it?
Do you want to understand all the steps to perform a Kafka setup and Kafka Deployment in Production?
Have you been trying endlessly to deploy a Kafka Cluster, but haven’t had any luck?
If you have answered YES, then you are at the right place.
Learn from Stephane Maarek, the Best-Selling Instructor on Udemy in Apache Kafka and Big Data!
This course is designed for System Administrators, Architects and Developers. It includes a step by step guide for installing a ZooKeeper Quorum and a Kafka Cluster. Hands-on training on Kafka Administration is also provided.
This course has Amazon Web Services for our cloud environment, which is used by many companies around the world. AWS Knowledge is a pre-requisite.
In this course, we will cover what ZooKeeper is, its architecture, its role in Apache Kafka, and the setup, installation and configuration on multiple machines!
This course reveals exactly how your Kafka Cluster on multiple machines should be setup and configured. We will start with understanding the Kafka basics, cluster size and the configuration. We will also have a hands-on learning on AWS Setup, Single Broker Setup, Multi Broker Setup, Testing the Cluster, Kafka Manager (Cluster Management), Demonstrating Kafka Resiliency etc. We will enlighten you on Kafka Performance with respect to I/Os, Network, RAM, CPU, OS (Operating System) etc. You will have hands on learning on how to run Kafka in Production on AWS, how to change a Kafka Broker Configuration and we will also cover the Advanced Kafka Configurations.
Section 1 – Course Introduction: In this section, we will have introduction to the course. We will talk about what are the course pre-requisites, course objectives, who are the targeted students for this course. You will also have course material for download in this section!
Section 2 – Target Architecture: In this section, we will see the cloud providers such as AWS and explore other alternatives for AWS. We will also cover ZooKeeper Quorum Architecture and Kafka Cluster Architecture in this section.
Section 3 – Zookeeper Quorum Setup: In this sections, we will learn what is ZooKeeper, the Zookeeper role in Kafka Cluster, and ZooKeeper Configuration. We will have hands-on labs on AWS Setup, Zookeeper Single Machine Setup and Zookeeper Quorum Setup.
Section 4 – Kafka Cluster Setup: In this section, we will gain some practical hands-on experience on further AWS Setup, Single Kafka Broker Setup, Multi Kafka Broker Setup etc. Before that we will see Apache Kafka Basics on Kafka Configurations. We will have a demonstration on how to change the Kafka Broker configuration and we will also cover advanced Kafka configurations in this section.
After taking this course, you will become proficient in deploying Kafka in production! You will know all the required setups and installations and Kafka production settings and will be able to set-up Kafka in cluster mode in your own environment!
What you’ll learn
- Setup a Zookeeper and Kafka cluster on three machines in AWS
- Learn how to deploy Kafka in Production and understand the target architecture for clusters in AWS
- Setup ZooKeeper Cluster, learn its role for Kafka and usage
- Setup Kafka in Cluster Mode with 3 brokers, including configuration, usage and maintenance
- Shutdown and Recover Kafka brokers, to overcome the common Kafka broker problems
- Configure Kafka Cluster with production settings and optimisations for better performances based on your workload
- Setup web administration tools using Docker: ZooNavigator, Kafka Manager, Confluent Schema Registry,
- Confluent REST Proxy, Landoop Kafka Topics UI
- Administer Kafka using Kafka Manager
Table of Contents
Course Introduction & Architecture
1 Kafka Cluster Setup Introduction
2 Cloud Provider & Target Architecture
3 Cost of the tutorial
4 Important Message
Code Download
5 Code Download
Zookeeper Quorum Setup
6 What is Zookeeper
7 Zookeeper Role in a Kafka Cluster
8 Zookeeper Quorum Sizing
9 Zookeeper Configuration
10 Hands-On Zookeeper AWS Setup
11 How to SSH Into our Servers
12 Hands-On Single Zookeeper Machine Setup
13 Hands-On Zookeeper Service Setup
14 Using the Zookeeper Command Line Interface (CLI)
15 Hands-On Zookeeper Quorum setup – Part 1 AWS
16 Hands-On Zookeeper Quorum Setup – Part 2 Zookeeper
17 Zookeeper Four Letter Words
18 Zookeeper Internal File System
19 Factors impacting Zookeeper Peformance
20 Note Zookeeper in AWS
21 Hands-On Web tools AWS machine Docker setup
22 Management Tools for Zookeeper & Zoonavigator demo
Kafka Cluster Setup
23 Kafka Basics
24 Kafka Cluster Size Discussions
25 Kafka Configuration
26 Hands-On Kafka AWS Setup
27 Hands-On Single Kafka Broker Setup
28 Hands-On Running Kafka Commands
29 Hands-On Kafka Multi Broker (Cluster) Setup
30 Hands-On Testing the Kafka Cluster
31 Can I connect to my Kafka cluster
32 advertised.listeners setting – most important setting
33 Hands-On Kafka Manager (Cluster Management)
34 Hands-On Demonstrating Kafka Resiliency
35 Kafka Performance I O
36 Kafka Performance Network
37 Kafka Performance RAM
38 Kafka Performance CPU
39 Kafka Performance OS (Operating System)
40 Kafka Performance Other
41 Running Kafka in Production on AWS
42 Hands-On How to change a Kafka Broker Configuration
43 Advanced Kafka Configuration
44 Landoop Kafka Topics UI, Confluent REST Proxy, Confluent Schema Registry Setup
Next steps
45 What’s Next Learning further
46 Congratulations
47 THANK YOU
48 Bonus Lecture – Coupons For My Other Courses – Student Special Offer
Resolve the captcha to access the links!