SlideShare a Scribd company logo
#Perform2017
with Heapster, Grafana, Fluentd, Elastic Stack, Jolokia and OpenTracing
Martin Etmajer @metmajer
Dynatrace, Technology Lead
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
Wolfgang Amadeus Mozart
1756 – 1791
The „Jay Z“ of classical music
Mike Grabner
Schwarzenegger
Schnitzel
#Perform2017
Monitoring
with Kubernetes Dashboard, Heapster, influxdb & Grafana
Monitoring, Logging and Tracing on Kubernetes
$ git clone https://github.com/kubernetes/dashboard.git
$ kubectl create –f src/deploy/kubernetes-dashboard.yaml
Example: Deploy Kubernetes Dashboard
likely to be present in your kube-system already
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
We metrics!♥
Monitoring, Logging and Tracing on Kubernetes
collects resources usage, etc.
collects resources usage, etc.
exposed
via REST
Heapster runs in a Pod
Heapster
source
Kubernetes
REST client
sinks
influxdb
GCL
kafkaelasticsearch
GCM
graphite
Kubernetes
Dashboard
via built-in client
Example: Heapster (standalone)
source
Kubernetes
REST client
Kubernetes
Dashboard
via built-in client
Monitoring, Logging and Tracing on Kubernetes
Example: Deploy Heapster (standalone)
$ git clone https://github.com/kubernetes/heapster.git
$ kubectl create –f heapster/deploy/kube-config/standalone/
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
Example: Heapster (with influxdb and Grafana)
source
Kubernetes
sinks
influxdb grafana
query
Monitoring, Logging and Tracing on Kubernetes
Example: Deploy Heapster (with influxdb and Grafana)
$ git clone https://github.com/kubernetes/heapster.git
$ kubectl create –f heapster/deploy/kube-config/influxdb/
Monitoring, Logging and Tracing on Kubernetes
#Perform2017
Logging
with Fluentd and Elastic Stack
continuous stream of log data for each container
unified logging
Monitoring, Logging and Tracing on Kubernetes
Fluentd
runs on
each host
Example: Fluentd (for container logs to elasticsearch)
watch container logs
elasticsearch kibana
queryingest
via configuration
Monitoring, Logging and Tracing on Kubernetes
Example: Deploy Fluentd (for container logs to elasticsearch)
$ git clone https://github.com/kubernetes/kubernetes.git
$ kubectl create –f kubernetes/cluster/addons/fluentd-elasticsearch/
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
#Perform2017
Monitoring
with Jolokia
remote access to JMX MBeans
remote access to JMX MBeans
exposed via REST
Java Management Extensions (JMX)
to manage and monitor applications
Source: https://en.wikipedia.org/wiki/Java_Management_Extensions
Dynamic
MBean MXBean
Standard
MBean
Instrumentation
Level
instrument resources
MBeanServerAgent Level
agent for registered MBeans
Connectors Adaptors
Remote
Management
Level
provides access to MBeanServerRMI, HTTP/SOAP HTML, SNMP
Example: Jolokia (get list of accessible MBeans)
$ curl http://localhost:8080/jolokia/list
includes memory, threading, gc, etc.
Monitoring, Logging and Tracing on Kubernetes
Example: Jolokia (read memory usage data)
$ curl http://localhost:8080/jolokia/read/java.lang:type=Memory
name of MBean
Monitoring, Logging and Tracing on Kubernetes
Example: Jolokia (read threading data)
$ curl http://localhost:8080/jolokia/read/java.lang:type=Threading
name of MBean
Monitoring, Logging and Tracing on Kubernetes
#Perform2017
Tracing
with OpenTracing
a formally specified standard API for reporting
with various API implementations
Monitoring, Logging and Tracing on Kubernetes
design
goals
Why distributed (end-to-end) tracing?
Source: https://research.google.com/pubs/pub36356.html
initiator
services
remote calls
Why distributed (end-to-end) tracing?
Source: https://research.google.com/pubs/pub36356.html
initiator
services
remote calls
What does the architecture look like?What does the architecture look like?
Why distributed (end-to-end) tracing?
Source: https://research.google.com/pubs/pub36356.html
initiator
services
remote calls
Where is most of the time spent?
Why distributed (end-to-end) tracing?
Source: https://research.google.com/pubs/pub36356.html
initiator
services
remote calls
How are services invoked?
Why distributed (end-to-end) tracing?
Source: https://research.google.com/pubs/pub36356.html
initiator
services
remote calls
Which services aren’t invoked?
Monitoring, Logging and Tracing on Kubernetes
#Perform2017
...and else?
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
Monitoring, Logging and Tracing on Kubernetes
Thank you.

More Related Content

What's hot (20)

PDF
Let's build Developer Portal with Backstage
Opsta
 
PDF
Infrastructure & System Monitoring using Prometheus
Marco Pas
 
PDF
CD using ArgoCD(KnolX).pdf
Knoldus Inc.
 
PDF
What Is Kubernetes | Kubernetes Introduction | Kubernetes Tutorial For Beginn...
Edureka!
 
PDF
How to Monitoring the SRE Golden Signals (E-Book)
Siglos
 
PPTX
Kubernetes for Beginners: An Introductory Guide
Bytemark
 
PPTX
Terraform modules restructured
Ami Mahloof
 
PDF
Kubernetes Application Deployment with Helm - A beginner Guide!
Krishna-Kumar
 
ODP
Monitoring With Prometheus
Knoldus Inc.
 
PDF
Prometheus Storage
Fabian Reinartz
 
PDF
쿠버네티스를 이용한 기능 브랜치별 테스트 서버 만들기 (GitOps CI/CD)
충섭 김
 
PDF
Prometheus and Docker (Docker Galway, November 2015)
Brian Brazil
 
PDF
Kubernetes GitOps featuring GitHub, Kustomize and ArgoCD
Sunnyvale
 
PDF
Hands-On Introduction to Kubernetes at LISA17
Ryan Jarvinen
 
PDF
Kubernetes Introduction
Peng Xiao
 
PDF
Docker Advanced registry usage
Docker, Inc.
 
PPTX
Introduction to kubernetes
Rishabh Indoria
 
PDF
Explore your prometheus data in grafana - Promcon 2018
Grafana Labs
 
PPSX
Service Mesh - Observability
Araf Karsh Hamid
 
PDF
Monitoring kubernetes wwith prometheus and grafana azure singapore - 19 aug...
Nilesh Gule
 
Let's build Developer Portal with Backstage
Opsta
 
Infrastructure & System Monitoring using Prometheus
Marco Pas
 
CD using ArgoCD(KnolX).pdf
Knoldus Inc.
 
What Is Kubernetes | Kubernetes Introduction | Kubernetes Tutorial For Beginn...
Edureka!
 
How to Monitoring the SRE Golden Signals (E-Book)
Siglos
 
Kubernetes for Beginners: An Introductory Guide
Bytemark
 
Terraform modules restructured
Ami Mahloof
 
Kubernetes Application Deployment with Helm - A beginner Guide!
Krishna-Kumar
 
Monitoring With Prometheus
Knoldus Inc.
 
Prometheus Storage
Fabian Reinartz
 
쿠버네티스를 이용한 기능 브랜치별 테스트 서버 만들기 (GitOps CI/CD)
충섭 김
 
Prometheus and Docker (Docker Galway, November 2015)
Brian Brazil
 
Kubernetes GitOps featuring GitHub, Kustomize and ArgoCD
Sunnyvale
 
Hands-On Introduction to Kubernetes at LISA17
Ryan Jarvinen
 
Kubernetes Introduction
Peng Xiao
 
Docker Advanced registry usage
Docker, Inc.
 
Introduction to kubernetes
Rishabh Indoria
 
Explore your prometheus data in grafana - Promcon 2018
Grafana Labs
 
Service Mesh - Observability
Araf Karsh Hamid
 
Monitoring kubernetes wwith prometheus and grafana azure singapore - 19 aug...
Nilesh Gule
 

Similar to Monitoring, Logging and Tracing on Kubernetes (20)

PDF
Log aggregation: using Elasticsearch, Fluentd/Fluentbit and Kibana (EFK)
Lee Myring
 
PDF
Monitoring&Logging - Stanislav Kolenkin
Kuberton
 
PDF
Kubernetes Logging
Denys Havrysh
 
PPTX
Kubernetes #2 monitoring
Terry Cho
 
PDF
Download full Managing Kubernetes operating Kubernetes clusters in the real w...
duduhasikul
 
PDF
DevOpsDays Houston 2019 - Dan Kirkpatrick - My Kubernetes Tool Chain: Open-So...
DevOpsDays Houston
 
PDF
Building a modern SaaS in 2020
Nikolay Stoitsev
 
PDF
Cloud Native Logging / Fluentd Summit Tokyo
Eduardo Silva Pereira
 
PPTX
Production ready tooling for microservices on kubernetes
Chandresh Pancholi
 
PDF
Challenges in a Microservices Age: Monitoring, Logging and Tracing on Red Hat...
Martin Etmajer
 
PDF
Implementing Observability for Kubernetes.pdf
Jose Manuel Ortega Candel
 
PDF
Presentación11.pdf
PabloCanesta
 
PDF
The elastic stack on docker
SmartWave
 
PDF
Kubernetes: The Next Research Platform
Bob Killen
 
PDF
Dynamic infrastructure for development
Balázs Rostás
 
PDF
Logging in Action: With Fluentd, Kubernetes and more 1st Edition Phil Wilkins
roarxhaarexg
 
PDF
The App Developer's Kubernetes Toolbox
Nebulaworks
 
PDF
kubernetesssssssssssssssssssssssssss.pdf
bchiriamina2
 
PDF
Mulesoft ELK
Integration Assistance
 
PDF
Kubernetes Architecture - beyond a black box - Part 1
Hao H. Zhang
 
Log aggregation: using Elasticsearch, Fluentd/Fluentbit and Kibana (EFK)
Lee Myring
 
Monitoring&Logging - Stanislav Kolenkin
Kuberton
 
Kubernetes Logging
Denys Havrysh
 
Kubernetes #2 monitoring
Terry Cho
 
Download full Managing Kubernetes operating Kubernetes clusters in the real w...
duduhasikul
 
DevOpsDays Houston 2019 - Dan Kirkpatrick - My Kubernetes Tool Chain: Open-So...
DevOpsDays Houston
 
Building a modern SaaS in 2020
Nikolay Stoitsev
 
Cloud Native Logging / Fluentd Summit Tokyo
Eduardo Silva Pereira
 
Production ready tooling for microservices on kubernetes
Chandresh Pancholi
 
Challenges in a Microservices Age: Monitoring, Logging and Tracing on Red Hat...
Martin Etmajer
 
Implementing Observability for Kubernetes.pdf
Jose Manuel Ortega Candel
 
Presentación11.pdf
PabloCanesta
 
The elastic stack on docker
SmartWave
 
Kubernetes: The Next Research Platform
Bob Killen
 
Dynamic infrastructure for development
Balázs Rostás
 
Logging in Action: With Fluentd, Kubernetes and more 1st Edition Phil Wilkins
roarxhaarexg
 
The App Developer's Kubernetes Toolbox
Nebulaworks
 
kubernetesssssssssssssssssssssssssss.pdf
bchiriamina2
 
Kubernetes Architecture - beyond a black box - Part 1
Hao H. Zhang
 
Ad

More from Martin Etmajer (10)

PDF
Continuous Delivery 101
Martin Etmajer
 
PDF
User Story Mapping 101
Martin Etmajer
 
PPTX
Monitoring Microservices at Scale on OpenShift (OpenShift Commons Briefing #52)
Martin Etmajer
 
PPTX
Test-Driven Infrastructure with Puppet, Test Kitchen, Serverspec and RSpec
Martin Etmajer
 
PPTX
(R)Evolutionize APM - APM in Continuous Delivery and DevOps
Martin Etmajer
 
PPTX
Test-Driven Infrastructure with Ansible, Test Kitchen, Serverspec and RSpec
Martin Etmajer
 
PPTX
Automated Deployments with Ansible
Martin Etmajer
 
PPTX
Deploying On-Prem as SaaS: Why we go with Ansible
Martin Etmajer
 
PPTX
Introduction to Automated Deployments with Ansible
Martin Etmajer
 
PPTX
Automated Deployments
Martin Etmajer
 
Continuous Delivery 101
Martin Etmajer
 
User Story Mapping 101
Martin Etmajer
 
Monitoring Microservices at Scale on OpenShift (OpenShift Commons Briefing #52)
Martin Etmajer
 
Test-Driven Infrastructure with Puppet, Test Kitchen, Serverspec and RSpec
Martin Etmajer
 
(R)Evolutionize APM - APM in Continuous Delivery and DevOps
Martin Etmajer
 
Test-Driven Infrastructure with Ansible, Test Kitchen, Serverspec and RSpec
Martin Etmajer
 
Automated Deployments with Ansible
Martin Etmajer
 
Deploying On-Prem as SaaS: Why we go with Ansible
Martin Etmajer
 
Introduction to Automated Deployments with Ansible
Martin Etmajer
 
Automated Deployments
Martin Etmajer
 
Ad

Recently uploaded (20)

PDF
What’s my job again? Slides from Mark Simos talk at 2025 Tampa BSides
Mark Simos
 
PPTX
The Project Compass - GDG on Campus MSIT
dscmsitkol
 
PPTX
Digital Circuits, important subject in CS
contactparinay1
 
PDF
Agentic AI lifecycle for Enterprise Hyper-Automation
Debmalya Biswas
 
PDF
The Rise of AI and IoT in Mobile App Tech.pdf
IMG Global Infotech
 
PPTX
From Sci-Fi to Reality: Exploring AI Evolution
Svetlana Meissner
 
PDF
How do you fast track Agentic automation use cases discovery?
DianaGray10
 
PPTX
Agentforce World Tour Toronto '25 - MCP with MuleSoft
Alexandra N. Martinez
 
PDF
“Squinting Vision Pipelines: Detecting and Correcting Errors in Vision Models...
Edge AI and Vision Alliance
 
PDF
NLJUG Speaker academy 2025 - first session
Bert Jan Schrijver
 
PDF
Transforming Utility Networks: Large-scale Data Migrations with FME
Safe Software
 
PDF
LOOPS in C Programming Language - Technology
RishabhDwivedi43
 
PDF
UPDF - AI PDF Editor & Converter Key Features
DealFuel
 
PDF
Transcript: Book industry state of the nation 2025 - Tech Forum 2025
BookNet Canada
 
PDF
Staying Human in a Machine- Accelerated World
Catalin Jora
 
PPTX
Seamless Tech Experiences Showcasing Cross-Platform App Design.pptx
presentifyai
 
PPTX
Agentforce World Tour Toronto '25 - Supercharge MuleSoft Development with Mod...
Alexandra N. Martinez
 
PPTX
Designing_the_Future_AI_Driven_Product_Experiences_Across_Devices.pptx
presentifyai
 
PPTX
AI Penetration Testing Essentials: A Cybersecurity Guide for 2025
defencerabbit Team
 
PDF
“Computer Vision at Sea: Automated Fish Tracking for Sustainable Fishing,” a ...
Edge AI and Vision Alliance
 
What’s my job again? Slides from Mark Simos talk at 2025 Tampa BSides
Mark Simos
 
The Project Compass - GDG on Campus MSIT
dscmsitkol
 
Digital Circuits, important subject in CS
contactparinay1
 
Agentic AI lifecycle for Enterprise Hyper-Automation
Debmalya Biswas
 
The Rise of AI and IoT in Mobile App Tech.pdf
IMG Global Infotech
 
From Sci-Fi to Reality: Exploring AI Evolution
Svetlana Meissner
 
How do you fast track Agentic automation use cases discovery?
DianaGray10
 
Agentforce World Tour Toronto '25 - MCP with MuleSoft
Alexandra N. Martinez
 
“Squinting Vision Pipelines: Detecting and Correcting Errors in Vision Models...
Edge AI and Vision Alliance
 
NLJUG Speaker academy 2025 - first session
Bert Jan Schrijver
 
Transforming Utility Networks: Large-scale Data Migrations with FME
Safe Software
 
LOOPS in C Programming Language - Technology
RishabhDwivedi43
 
UPDF - AI PDF Editor & Converter Key Features
DealFuel
 
Transcript: Book industry state of the nation 2025 - Tech Forum 2025
BookNet Canada
 
Staying Human in a Machine- Accelerated World
Catalin Jora
 
Seamless Tech Experiences Showcasing Cross-Platform App Design.pptx
presentifyai
 
Agentforce World Tour Toronto '25 - Supercharge MuleSoft Development with Mod...
Alexandra N. Martinez
 
Designing_the_Future_AI_Driven_Product_Experiences_Across_Devices.pptx
presentifyai
 
AI Penetration Testing Essentials: A Cybersecurity Guide for 2025
defencerabbit Team
 
“Computer Vision at Sea: Automated Fish Tracking for Sustainable Fishing,” a ...
Edge AI and Vision Alliance
 

Monitoring, Logging and Tracing on Kubernetes

Editor's Notes

  • #10: get an overview of the applications running on the Kubernetes cluster create, modify and delete Kubernetes resources troubleshooting (logs) https://kubernetes.io/docs/user-guide/ui/
  • #20: https://github.com/kubernetes/heapster/blob/master/docs/source-configuration.md https://github.com/kubernetes/heapster/blob/master/docs/sink-configuration.md https://github.com/kubernetes/heapster/blob/master/docs/model.md