Logging in Kubernetes with EFK Stack | The Complete Guide

Logging in Kubernetes with EFK Stack | The Complete Guide

English | MP4 | AVC 1280×720 | AAC 48KHz 2ch | 2 Hours | 795 MB

Learn how to set up K8s cluster from scratch and configure logging with ElasticSearch, Fluentd and Kibana

You will learn how to:

  • set up a Kubernetes cluster from scratch
  • configure fully functioning logging in Kubernetes cluster with EFK Stack

With following steps:

  • configure Java and NodeJS applications to produce logs, package them into Docker images and push into a Docker private repository.
  • create Kubernetes cluster on a cloud platform (Linode Kubernetes Engine)
  • deploy these application Docker images in the cluster
  • deploy ElasticSearch, Kibana and Fluentd in the cluster
  • configure Fluentd to start collecting and processing the logs and sending them to ElasticSearch
  • configure Kibana to visualise the log data stored in ElasticSearch

What you’ll learn

  • Set up logging in Kubernetes
  • Create Kubernetes cluster from scratch
  • ElasticSearch, Kibana, FluentD
  • Set up Docker private repository
  • StatefulSet, DaemonSet, Helm
  • Build, tag, push Docker images to private repository
Table of Contents

1 Overview of complete setup we’ll build step-by-step

Build Docker images Docker private registry
2 Overview
3 Build Nodejs app Docker image
4 Build Java app Docker image
5 Create private Docker registry and push images

Set up Kubernetes cluster on Cloud – LKE
6 Overview
7 Create Kubernetes cluster in LKE
8 Connect to remote cluster with Kubectl
9 Deploy Kubernetes Dashboard
10 Kubernetes Dashboard Overview

Deploy the apps from private Docker registry in K8s cluster
11 Overview
12 Configure private Docker registry credentials in k8s
13 Deploy Java app in cluster from registry
14 Deploy Nodejs app in cluster from registry
15 Container logs in k8s cluster

ElasticSearch Kibana Logstash Fluentd Overview
16 Overview
17 Elastic stack explained Logstash alternative Fluentd
18 StatefulSet vs Deployment briefly explained
19 Helm and Helm Chart briefly explained

Deploy ElasticSearch and Kibana
20 Overview
21 Install Helm
22 Deploy ElasticSearch in K8s
23 Deploy Kibana in K8s

Configure Ingress for Kibana Access from browser
24 Overview
25 Ingress explained
26 Deploy Ingress Controller in K8s
27 Create Ingress for Kibana Access Kibana from browser

Deploy Fluentd Configure collecting and visualising logs
28 Overview
29 Fluentd explained
30 Deploy Fluentd in K8s
31 Fluentd DaemonSet & Fluentd config file explained
32 Configure Fluentd Collect application logs
33 Configure Fluentd Send logs to ElasticSearch Kibana UI
34 Configure Fluentd Parse log entries Kibana UI
35 Visualizing logs in Kibana Final notes

End Notes
36 End Notes