SlideShare a Scribd company logo
#Perform2017
with Heapster, Grafana, Fluentd, Elastic Stack, Jolokia and OpenTracing
Martin Etmajer @metmajer
Dynatrace, Technology Lead
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
Wolfgang Amadeus Mozart
1756 – 1791
The „Jay Z“ of classical music
Mike Grabner
Schwarzenegger
Schnitzel
#Perform2017
Monitoring
with Kubernetes Dashboard, Heapster, influxdb & Grafana
Monitoring, Logging and Tracing on Kubernetes
$ git clone https://github.com/kubernetes/dashboard.git
$ kubectl create –f src/deploy/kubernetes-dashboard.yaml
Example: Deploy Kubernetes Dashboard
likely to be present in your kube-system already
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
We metrics!♥
Monitoring, Logging and Tracing on Kubernetes
collects resources usage, etc.
collects resources usage, etc.
exposed
via REST
Heapster runs in a Pod
Heapster
source
Kubernetes
REST client
sinks
influxdb
GCL
kafkaelasticsearch
GCM
graphite
Kubernetes
Dashboard
via built-in client
Example: Heapster (standalone)
source
Kubernetes
REST client
Kubernetes
Dashboard
via built-in client
Monitoring, Logging and Tracing on Kubernetes
Example: Deploy Heapster (standalone)
$ git clone https://github.com/kubernetes/heapster.git
$ kubectl create –f heapster/deploy/kube-config/standalone/
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
Example: Heapster (with influxdb and Grafana)
source
Kubernetes
sinks
influxdb grafana
query
Monitoring, Logging and Tracing on Kubernetes
Example: Deploy Heapster (with influxdb and Grafana)
$ git clone https://github.com/kubernetes/heapster.git
$ kubectl create –f heapster/deploy/kube-config/influxdb/
Monitoring, Logging and Tracing on Kubernetes
#Perform2017
Logging
with Fluentd and Elastic Stack
continuous stream of log data for each container
unified logging
Monitoring, Logging and Tracing on Kubernetes
Fluentd
runs on
each host
Example: Fluentd (for container logs to elasticsearch)
watch container logs
elasticsearch kibana
queryingest
via configuration
Monitoring, Logging and Tracing on Kubernetes
Example: Deploy Fluentd (for container logs to elasticsearch)
$ git clone https://github.com/kubernetes/kubernetes.git
$ kubectl create –f kubernetes/cluster/addons/fluentd-elasticsearch/
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
#Perform2017
Monitoring
with Jolokia
remote access to JMX MBeans
remote access to JMX MBeans
exposed via REST
Java Management Extensions (JMX)
to manage and monitor applications
Source: https://en.wikipedia.org/wiki/Java_Management_Extensions
Dynamic
MBean MXBean
Standard
MBean
Instrumentation
Level
instrument resources
MBeanServerAgent Level
agent for registered MBeans
Connectors Adaptors
Remote
Management
Level
provides access to MBeanServerRMI, HTTP/SOAP HTML, SNMP
Example: Jolokia (get list of accessible MBeans)
$ curl http://localhost:8080/jolokia/list
includes memory, threading, gc, etc.
Monitoring, Logging and Tracing on Kubernetes
Example: Jolokia (read memory usage data)
$ curl http://localhost:8080/jolokia/read/java.lang:type=Memory
name of MBean
Monitoring, Logging and Tracing on Kubernetes
Example: Jolokia (read threading data)
$ curl http://localhost:8080/jolokia/read/java.lang:type=Threading
name of MBean
Monitoring, Logging and Tracing on Kubernetes
#Perform2017
Tracing
with OpenTracing
a formally specified standard API for reporting
with various API implementations
Monitoring, Logging and Tracing on Kubernetes
design
goals
Why distributed (end-to-end) tracing?
Source: https://research.google.com/pubs/pub36356.html
initiator
services
remote calls
Why distributed (end-to-end) tracing?
Source: https://research.google.com/pubs/pub36356.html
initiator
services
remote calls
What does the architecture look like?What does the architecture look like?
Why distributed (end-to-end) tracing?
Source: https://research.google.com/pubs/pub36356.html
initiator
services
remote calls
Where is most of the time spent?
Why distributed (end-to-end) tracing?
Source: https://research.google.com/pubs/pub36356.html
initiator
services
remote calls
How are services invoked?
Why distributed (end-to-end) tracing?
Source: https://research.google.com/pubs/pub36356.html
initiator
services
remote calls
Which services aren’t invoked?
Monitoring, Logging and Tracing on Kubernetes
#Perform2017
...and else?
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
Thank you.

More Related Content

What's hot (20)

PPTX
Prometheus and Grafana
Lhouceine OUHAMZA
 
PDF
Slide DevSecOps Microservices
Hendri Karisma
 
PDF
OpenShift 4 installation
Robert Bohne
 
PPTX
Terraform
Pathum Fernando ☁
 
PPSX
Docker Kubernetes Istio
Araf Karsh Hamid
 
PDF
Introduction to Docker Compose
Ajeet Singh Raina
 
PDF
Crystal Hirschorn_Building Internal Developer Platforms that will make the en...
VMware Tanzu
 
PDF
Introduction to Docker - VIT Campus
Ajeet Singh Raina
 
PPTX
Kubernetes Introduction
Martin Danielsson
 
PPTX
Kubernetes #2 monitoring
Terry Cho
 
PPTX
Firebase Introduction
9xdot
 
PDF
Monitoring Kubernetes with Prometheus
Grafana Labs
 
PPTX
An Introduction to Maven
Vadym Lotar
 
PPTX
Kubernetes PPT.pptx
ssuser0cc9131
 
PPTX
Docker introduction
dotCloud
 
PDF
Kubernetes Architecture and Introduction
Stefan Schimanski
 
PDF
Kubernetes Basics
Eueung Mulyana
 
PDF
OpenShift 4, the smarter Kubernetes platform
Kangaroot
 
PDF
Microservices, Containers and Docker
Ioannis Papapanagiotou
 
PDF
Introduction to Kubernetes Workshop
Bob Killen
 
Prometheus and Grafana
Lhouceine OUHAMZA
 
Slide DevSecOps Microservices
Hendri Karisma
 
OpenShift 4 installation
Robert Bohne
 
Docker Kubernetes Istio
Araf Karsh Hamid
 
Introduction to Docker Compose
Ajeet Singh Raina
 
Crystal Hirschorn_Building Internal Developer Platforms that will make the en...
VMware Tanzu
 
Introduction to Docker - VIT Campus
Ajeet Singh Raina
 
Kubernetes Introduction
Martin Danielsson
 
Kubernetes #2 monitoring
Terry Cho
 
Firebase Introduction
9xdot
 
Monitoring Kubernetes with Prometheus
Grafana Labs
 
An Introduction to Maven
Vadym Lotar
 
Kubernetes PPT.pptx
ssuser0cc9131
 
Docker introduction
dotCloud
 
Kubernetes Architecture and Introduction
Stefan Schimanski
 
Kubernetes Basics
Eueung Mulyana
 
OpenShift 4, the smarter Kubernetes platform
Kangaroot
 
Microservices, Containers and Docker
Ioannis Papapanagiotou
 
Introduction to Kubernetes Workshop
Bob Killen
 

Similar to Monitoring, Logging and Tracing on Kubernetes (20)

PDF
Log aggregation: using Elasticsearch, Fluentd/Fluentbit and Kibana (EFK)
Lee Myring
 
PDF
Monitoring&Logging - Stanislav Kolenkin
Kuberton
 
PDF
Kubernetes Logging
Denys Havrysh
 
PDF
Download full Managing Kubernetes operating Kubernetes clusters in the real w...
duduhasikul
 
PDF
DevOpsDays Houston 2019 - Dan Kirkpatrick - My Kubernetes Tool Chain: Open-So...
DevOpsDays Houston
 
PDF
Building a modern SaaS in 2020
Nikolay Stoitsev
 
PDF
Cloud Native Logging / Fluentd Summit Tokyo
Eduardo Silva Pereira
 
PPTX
Production ready tooling for microservices on kubernetes
Chandresh Pancholi
 
PDF
Challenges in a Microservices Age: Monitoring, Logging and Tracing on Red Hat...
Martin Etmajer
 
PDF
Implementing Observability for Kubernetes.pdf
Jose Manuel Ortega Candel
 
PDF
Presentación11.pdf
PabloCanesta
 
PDF
The elastic stack on docker
SmartWave
 
PDF
Kubernetes: The Next Research Platform
Bob Killen
 
PDF
Dynamic infrastructure for development
Balázs Rostás
 
PDF
Logging in Action: With Fluentd, Kubernetes and more 1st Edition Phil Wilkins
roarxhaarexg
 
PDF
The App Developer's Kubernetes Toolbox
Nebulaworks
 
PDF
kubernetesssssssssssssssssssssssssss.pdf
bchiriamina2
 
PDF
Mulesoft ELK
Integration Assistance
 
PDF
Kubernetes Architecture - beyond a black box - Part 1
Hao H. Zhang
 
PDF
Elasticsearch on Kubernetes
Joerg Henning
 
Log aggregation: using Elasticsearch, Fluentd/Fluentbit and Kibana (EFK)
Lee Myring
 
Monitoring&Logging - Stanislav Kolenkin
Kuberton
 
Kubernetes Logging
Denys Havrysh
 
Download full Managing Kubernetes operating Kubernetes clusters in the real w...
duduhasikul
 
DevOpsDays Houston 2019 - Dan Kirkpatrick - My Kubernetes Tool Chain: Open-So...
DevOpsDays Houston
 
Building a modern SaaS in 2020
Nikolay Stoitsev
 
Cloud Native Logging / Fluentd Summit Tokyo
Eduardo Silva Pereira
 
Production ready tooling for microservices on kubernetes
Chandresh Pancholi
 
Challenges in a Microservices Age: Monitoring, Logging and Tracing on Red Hat...
Martin Etmajer
 
Implementing Observability for Kubernetes.pdf
Jose Manuel Ortega Candel
 
Presentación11.pdf
PabloCanesta
 
The elastic stack on docker
SmartWave
 
Kubernetes: The Next Research Platform
Bob Killen
 
Dynamic infrastructure for development
Balázs Rostás
 
Logging in Action: With Fluentd, Kubernetes and more 1st Edition Phil Wilkins
roarxhaarexg
 
The App Developer's Kubernetes Toolbox
Nebulaworks
 
kubernetesssssssssssssssssssssssssss.pdf
bchiriamina2
 
Kubernetes Architecture - beyond a black box - Part 1
Hao H. Zhang
 
Elasticsearch on Kubernetes
Joerg Henning
 
Ad

More from Martin Etmajer (10)

PDF
Continuous Delivery 101
Martin Etmajer
 
PDF
User Story Mapping 101
Martin Etmajer
 
PPTX
Monitoring Microservices at Scale on OpenShift (OpenShift Commons Briefing #52)
Martin Etmajer
 
PPTX
Test-Driven Infrastructure with Puppet, Test Kitchen, Serverspec and RSpec
Martin Etmajer
 
PPTX
(R)Evolutionize APM - APM in Continuous Delivery and DevOps
Martin Etmajer
 
PPTX
Test-Driven Infrastructure with Ansible, Test Kitchen, Serverspec and RSpec
Martin Etmajer
 
PPTX
Automated Deployments with Ansible
Martin Etmajer
 
PPTX
Deploying On-Prem as SaaS: Why we go with Ansible
Martin Etmajer
 
PPTX
Introduction to Automated Deployments with Ansible
Martin Etmajer
 
PPTX
Automated Deployments
Martin Etmajer
 
Continuous Delivery 101
Martin Etmajer
 
User Story Mapping 101
Martin Etmajer
 
Monitoring Microservices at Scale on OpenShift (OpenShift Commons Briefing #52)
Martin Etmajer
 
Test-Driven Infrastructure with Puppet, Test Kitchen, Serverspec and RSpec
Martin Etmajer
 
(R)Evolutionize APM - APM in Continuous Delivery and DevOps
Martin Etmajer
 
Test-Driven Infrastructure with Ansible, Test Kitchen, Serverspec and RSpec
Martin Etmajer
 
Automated Deployments with Ansible
Martin Etmajer
 
Deploying On-Prem as SaaS: Why we go with Ansible
Martin Etmajer
 
Introduction to Automated Deployments with Ansible
Martin Etmajer
 
Automated Deployments
Martin Etmajer
 
Ad

Recently uploaded (20)

PPTX
New ThousandEyes Product Innovations: Cisco Live June 2025
ThousandEyes
 
PDF
How do you fast track Agentic automation use cases discovery?
DianaGray10
 
PDF
Future-Proof or Fall Behind? 10 Tech Trends You Can’t Afford to Ignore in 2025
DIGITALCONFEX
 
PDF
Agentic AI lifecycle for Enterprise Hyper-Automation
Debmalya Biswas
 
PPTX
COMPARISON OF RASTER ANALYSIS TOOLS OF QGIS AND ARCGIS
Sharanya Sarkar
 
PDF
POV_ Why Enterprises Need to Find Value in ZERO.pdf
darshakparmar
 
PDF
Staying Human in a Machine- Accelerated World
Catalin Jora
 
PDF
CIFDAQ Market Wrap for the week of 4th July 2025
CIFDAQ
 
PPTX
Mastering ODC + Okta Configuration - Chennai OSUG
HathiMaryA
 
PDF
Reverse Engineering of Security Products: Developing an Advanced Microsoft De...
nwbxhhcyjv
 
PDF
Peak of Data & AI Encore AI-Enhanced Workflows for the Real World
Safe Software
 
DOCX
Python coding for beginners !! Start now!#
Rajni Bhardwaj Grover
 
PPTX
Agentforce World Tour Toronto '25 - Supercharge MuleSoft Development with Mod...
Alexandra N. Martinez
 
PPTX
Agentforce World Tour Toronto '25 - MCP with MuleSoft
Alexandra N. Martinez
 
PDF
UPDF - AI PDF Editor & Converter Key Features
DealFuel
 
PDF
Go Concurrency Real-World Patterns, Pitfalls, and Playground Battles.pdf
Emily Achieng
 
PDF
Transcript: Book industry state of the nation 2025 - Tech Forum 2025
BookNet Canada
 
PDF
AI Agents in the Cloud: The Rise of Agentic Cloud Architecture
Lilly Gracia
 
PPTX
The Project Compass - GDG on Campus MSIT
dscmsitkol
 
PDF
“Voice Interfaces on a Budget: Building Real-time Speech Recognition on Low-c...
Edge AI and Vision Alliance
 
New ThousandEyes Product Innovations: Cisco Live June 2025
ThousandEyes
 
How do you fast track Agentic automation use cases discovery?
DianaGray10
 
Future-Proof or Fall Behind? 10 Tech Trends You Can’t Afford to Ignore in 2025
DIGITALCONFEX
 
Agentic AI lifecycle for Enterprise Hyper-Automation
Debmalya Biswas
 
COMPARISON OF RASTER ANALYSIS TOOLS OF QGIS AND ARCGIS
Sharanya Sarkar
 
POV_ Why Enterprises Need to Find Value in ZERO.pdf
darshakparmar
 
Staying Human in a Machine- Accelerated World
Catalin Jora
 
CIFDAQ Market Wrap for the week of 4th July 2025
CIFDAQ
 
Mastering ODC + Okta Configuration - Chennai OSUG
HathiMaryA
 
Reverse Engineering of Security Products: Developing an Advanced Microsoft De...
nwbxhhcyjv
 
Peak of Data & AI Encore AI-Enhanced Workflows for the Real World
Safe Software
 
Python coding for beginners !! Start now!#
Rajni Bhardwaj Grover
 
Agentforce World Tour Toronto '25 - Supercharge MuleSoft Development with Mod...
Alexandra N. Martinez
 
Agentforce World Tour Toronto '25 - MCP with MuleSoft
Alexandra N. Martinez
 
UPDF - AI PDF Editor & Converter Key Features
DealFuel
 
Go Concurrency Real-World Patterns, Pitfalls, and Playground Battles.pdf
Emily Achieng
 
Transcript: Book industry state of the nation 2025 - Tech Forum 2025
BookNet Canada
 
AI Agents in the Cloud: The Rise of Agentic Cloud Architecture
Lilly Gracia
 
The Project Compass - GDG on Campus MSIT
dscmsitkol
 
“Voice Interfaces on a Budget: Building Real-time Speech Recognition on Low-c...
Edge AI and Vision Alliance
 

Monitoring, Logging and Tracing on Kubernetes

Editor's Notes

  • #10: get an overview of the applications running on the Kubernetes cluster create, modify and delete Kubernetes resources troubleshooting (logs) https://kubernetes.io/docs/user-guide/ui/
  • #20: https://github.com/kubernetes/heapster/blob/master/docs/source-configuration.md https://github.com/kubernetes/heapster/blob/master/docs/sink-configuration.md https://github.com/kubernetes/heapster/blob/master/docs/model.md