DevOps Monitoring, Logging and Tracing on Kubernetes

Einleitung

Observability is hard, everybody knows! It is one of the hardest principle to realise, whether introducing it in an existing architecture or building it together with a new one from scratch. But a well implemented observability gives you complete control over your system, leaving no dark corners and helping identifying all possible edge cases and hidden latencies.
Observability is not made only by the 3 well known pillars: monitoring, logging and tracing. Implementing these principles is really important, but it matters also (or even more) HOW you realise them. The main goal is to give the maximum available context without exposing sensitive information.
An observability infrastructure could be even harder to prepare and use… especially in the cloud… especially in Kubernetes!
Join me in a journey inside observability. We will learn the basics, deploy an example of observability infrastructure, deploy an observable architecture and analyse it searching for hidden gems.
Everything following DevOps/GitOps principles on Kubernetes! Because nowadays if you are not in cloud, nobody can observe you 😉

Programm

Introduction to observability:
– observability in general
– monitoring (theory and standard tools)
– logging (theory and standard tools)
– tracing (theory and standard tools)
– observability in the cloud
– observability in Kubernetes

Hands-on lab:
1. configure missing tools on your laptop
2. spin up a kubernetes cluster in the cloud
3. describe an example of observability infrastructure
4. deploy the observability infrastructure on Kubernetes
5. describe an example of observable architecture
6. look at codebase of the observable architecture
7. deploy the observable architecture on Kubernetes
8. analyse the architecture using observability infrastructure
9. (optional) a little challenge to close the day

Kursziel

– Learn the basis of general observability
– Learn the basis of monitoring (theory and standard tools)
– Learn the basis of logging (theory and standard tools)
– Learn the basis of tracing (theory and standard tools)
– Understand an example of observability infrastructure
– Learn how to deploy an observability infrastructure in a DevOps/GitOps way on Kubernetes
– Understand an example of observable architecture
– Learn how to use the observability infrastructure
– Understand how to find possible edge cases

Adressaten

– Every enthusiast learner
– Everybody interested in observability
– Cloud Solution Experts/Engineers/Architects
– Kubernetes Engineers
– DevOps/Infrastructure Engineers
– DevOps/Infrastructure enthusiasts

Voraussetzungen

– Software already installed locally:
– git (https://git-scm.com/book/en/v2/Getting-Started-Installing-Git)
– Docker (https://docs.docker.com/get-docker/)
– kubectl (https://kubernetes.io/docs/tasks/tools/)
– (if not using Minikube) gcloud SDK (https://cloud.google.com/sdk/docs/install)
– (optional) k9s (https://k9scli.io/)
– (optional) Lens (https://k8slens.dev/)
– (if not using Minikube) Google account, with GCP already activated with 300$ free-evaluation

PLEASE NOTE:

– Minikube is a potential alternative, but I discourage them unless you have a really powerfull machine with AT LEAST 8 CPUs and 32 GB of RAM
– Unfortunately MicroK8s, KinD and K3s ARE NOT a valid alternatives

Infrastruktur