SlideShare a Scribd company logo
ELKMétricas e monitoramento "real-time"
Sobre nós
Waldemar Neto @waldemarnt
http://walde.co/
Jefferson Stachelski @jeffhsta
https://jeffhsta.github.io/
2
Elastic.co
https://www.elastic.
co/
3
Elastic.co
Produtos
● Elasticsearch
● Logstash
● Kibana
● Beats
● Shield
● Marvel
● Graph
● Watcher
4
Serviços
● Suporte
● Treinamento
● Cloud
● Consultoria
ELK
● Elasticsearch
● Logstash
● Kibana
5
Elasticsearch
https://www.elastic.co/products/elasticsearch
6
Logstash
https://www.elastic.co/products/logstash
7
Kibana
https://www.elastic.co/products/kibana
8
PARSEARINDEXARVISUALIZAR
9 ELK Workflow
Etapa de log parsing com Logstash
Entrada
● Beats
● Couchdb_changes
● Heroku
● File
● Kafka
● TCP
● sqs
● Redis
● Rabbitmq
● Elasticsearch
Filtro
● Aggregate
● Mutate
● Alter
● CSV
● environment
● TCP
● JSON
● range
● grok
● geoip
Saída
● CSV
● Datadog
● Email
● Elasticsearch
● Exec
● File
● Graphite
● InfluxDB
● MongoDB
● s3
10
Etapa de indexar no Elasticsearch
● Normalização de texto
○ Acentos
○ Sinônimos
○ Linguística...
11
Etapa de visualizar com Kibana
● Dashboard em tempo real
○ Com varias visualizations
● Vários tipos de gráficos
○ Pie chart
○ Mapas
○ Barras
○ Gráfico de linhas
● Criação de vizualizations dinâmica
○ Suporte a queries do Elasticsearch
○ Suporte a agregações
12
Criando Visualization13
Monitorando servidor14
Monitoramento e métricas de APIs15
Métricas de negócio, BigData e anomalias16
Shield
Watcher
Elastalert
Alertas e proteção17
Na produção
● ELK as a service
○ Logz.io
○ Qbox.io
● Cloud
○ AWS
○ DigitalOcean
○ Elastic
18
Valeu!
Perguntas?
Referências20
http://walde.co/tag/elasticsearch/
https://github.com/guardian/elk-stack
http://techblog.netflix.com/2016/02/evolution-of-netflix-data-pipeline.html
http://www.front2backdev.com/2016/05/03/geo-temporal-anomaly/
https://dzone.com/articles/which-elk-stack-solution-is-right-for-you?
utm_content=buffer29ebc&utm_medium=social&utm_source=twitter.com&utm_campaign=buffer
http://blog.takipi.com/hosted-elasticsearch-the-future-of-your-elk-stack/
http://everythingshouldbevirtual.com/highly-available-elk-elasticsearch-logstash-kibana-setup

More Related Content

What's hot (20)

PDF
Elastic{ON} 2016 Review - 김종민 님
NAVER D2
 
PPTX
Attack monitoring using ElasticSearch Logstash and Kibana
Prajal Kulkarni
 
PDF
elk_stack_alexander_szalonnas
Alexander Szalonnas
 
PDF
Logs aggregation and analysis
Divante
 
PPTX
Logstash
Rajgourav Jain
 
PPTX
More kibana
琛琳 饶
 
PDF
Logstash + Elasticsearch + Kibana Presentation on Startit Tech Meetup
Startit
 
PPT
'Scalable Logging and Analytics with LogStash'
Cloud Elements
 
PDF
Machine Learning in a Twitter ETL using ELK
hypto
 
PDF
Logstash-Elasticsearch-Kibana
dknx01
 
PDF
Mobile Analytics mit Elasticsearch und Kibana
inovex GmbH
 
PDF
Journée DevOps : Des dashboards pour tous avec ElasticSearch, Logstash et Kibana
Publicis Sapient Engineering
 
PDF
Open Source Logging and Monitoring Tools
Phase2
 
PPTX
Elk stack
Jilles van Gurp
 
PPTX
ELK Ruminating on Logs (Zendcon 2016)
Mathew Beane
 
PPT
Logstash
琛琳 饶
 
PPT
Large Scale Log collection using LogStash & mongoDB
Gaurav Bhardwaj
 
PPTX
ELK Stack
Phuc Nguyen
 
PDF
Introducing ELK
AllBits BVBA (freelancer)
 
Elastic{ON} 2016 Review - 김종민 님
NAVER D2
 
Attack monitoring using ElasticSearch Logstash and Kibana
Prajal Kulkarni
 
elk_stack_alexander_szalonnas
Alexander Szalonnas
 
Logs aggregation and analysis
Divante
 
Logstash
Rajgourav Jain
 
More kibana
琛琳 饶
 
Logstash + Elasticsearch + Kibana Presentation on Startit Tech Meetup
Startit
 
'Scalable Logging and Analytics with LogStash'
Cloud Elements
 
Machine Learning in a Twitter ETL using ELK
hypto
 
Logstash-Elasticsearch-Kibana
dknx01
 
Mobile Analytics mit Elasticsearch und Kibana
inovex GmbH
 
Journée DevOps : Des dashboards pour tous avec ElasticSearch, Logstash et Kibana
Publicis Sapient Engineering
 
Open Source Logging and Monitoring Tools
Phase2
 
Elk stack
Jilles van Gurp
 
ELK Ruminating on Logs (Zendcon 2016)
Mathew Beane
 
Logstash
琛琳 饶
 
Large Scale Log collection using LogStash & mongoDB
Gaurav Bhardwaj
 
ELK Stack
Phuc Nguyen
 
Introducing ELK
AllBits BVBA (freelancer)
 

Viewers also liked (20)

PDF
Kibana Basics for Logfile Analysis at PhraseApp
PhraseApp
 
PDF
Shipping & Visualize Your Data With ELK
Adam Chen
 
PPTX
Pracital application logging and monitoring
Laurynas Tretjakovas
 
PPTX
SANS Ask the Expert: An Incident Response Playbook: From Monitoring to Opera...
AlienVault
 
PDF
Elasticsearch de dentro para fora
Waldemar Neto
 
PDF
Elasticsearch shards, index, filters and queries
Waldemar Neto
 
PPTX
Fluentdの使い方
Tomohiro Goya
 
PDF
Elasticsearch Aggregations
Waldemar Neto
 
ODP
Plugin Geolocalização - Prêmio Cidadania Eletrônica
aristotelesaraujo
 
PDF
Palestra Zabbix no 12 Geinfo (2013)
André Luis Boni Déo
 
ODP
Latinoware2013 - Implentando Plugin de Geolocalização no Zabbix
aristotelesaraujo
 
PDF
Projeto Zabbix: Conhecendo a ferramenta
Aécio Pires
 
PDF
Desenvolvendo com PHP e Docker
Waldemar Neto
 
PPTX
Zabbix - Alem da Infraestrutura - Parte 2
Luiz Sales
 
PDF
Zabbix meetup RJ: Integrações e opensource
Filipe Paternot
 
PDF
Zabbix meetup RJ: Infra, tuning e documentação
Filipe Paternot
 
PPTX
Gerenciamento de Redes com Zabbix
André Déo
 
PDF
Aula 009 de Gerenciamento de Redes - SNMP
Verdanatech Soluções em TI
 
PDF
Monitoramento Opensource com Zabbix
Renato Batista
 
PPTX
Elasticsearch 5.0
Matias Cascallares
 
Kibana Basics for Logfile Analysis at PhraseApp
PhraseApp
 
Shipping & Visualize Your Data With ELK
Adam Chen
 
Pracital application logging and monitoring
Laurynas Tretjakovas
 
SANS Ask the Expert: An Incident Response Playbook: From Monitoring to Opera...
AlienVault
 
Elasticsearch de dentro para fora
Waldemar Neto
 
Elasticsearch shards, index, filters and queries
Waldemar Neto
 
Fluentdの使い方
Tomohiro Goya
 
Elasticsearch Aggregations
Waldemar Neto
 
Plugin Geolocalização - Prêmio Cidadania Eletrônica
aristotelesaraujo
 
Palestra Zabbix no 12 Geinfo (2013)
André Luis Boni Déo
 
Latinoware2013 - Implentando Plugin de Geolocalização no Zabbix
aristotelesaraujo
 
Projeto Zabbix: Conhecendo a ferramenta
Aécio Pires
 
Desenvolvendo com PHP e Docker
Waldemar Neto
 
Zabbix - Alem da Infraestrutura - Parte 2
Luiz Sales
 
Zabbix meetup RJ: Integrações e opensource
Filipe Paternot
 
Zabbix meetup RJ: Infra, tuning e documentação
Filipe Paternot
 
Gerenciamento de Redes com Zabbix
André Déo
 
Aula 009 de Gerenciamento de Redes - SNMP
Verdanatech Soluções em TI
 
Monitoramento Opensource com Zabbix
Renato Batista
 
Elasticsearch 5.0
Matias Cascallares
 
Ad

Similar to Monitoramento com ELK - Elasticsearch - Logstash - Kibana (20)

PDF
Tomcat next
Jean-Frederic Clere
 
PPTX
Monitoring Docker with ELK
Daniel Berman
 
PDF
Logging with Elasticsearch, Logstash & Kibana
Amazee Labs
 
PDF
(Fios#02) 2. elk 포렌식 분석
INSIGHT FORENSIC
 
PDF
"How about no grep and zabbix?". ELK based alerts and metrics.
Vladimir Pavkin
 
KEY
Html 5 boot camp
Laurie Young
 
PDF
Jesse Olson - Nagios Log Server Architecture Overview
Nagios
 
PDF
Docker Logging and analysing with Elastic Stack
Jakub Hajek
 
PDF
Docker Logging and analysing with Elastic Stack - Jakub Hajek
PROIDEA
 
PPTX
Elk ruminating on logs
Mathew Beane
 
PDF
Choose Your Own Adventure to Get Started with Grafana Loki
Imma Valls Bernaus
 
PDF
State of integration with Apache Camel (ApacheCon 2019)
Claus Ibsen
 
PDF
Tomcat next
Jean-Frederic Clere
 
PPTX
Apache Camel K - Copenhagen v2
Claus Ibsen
 
PPTX
Apache Camel K - Copenhagen
Claus Ibsen
 
PDF
apachecamelk-april2019-190409093034.pdf
ssuserbb9f511
 
PDF
Elk for applications on k8s
Che-Chia Chang
 
PDF
Experiences building a distributed shared log on RADOS - Noah Watkins
Ceph Community
 
PDF
Into The Box 2018 Ortus Keynote
Ortus Solutions, Corp
 
ODP
Developing Microservices with Apache Camel
Claus Ibsen
 
Tomcat next
Jean-Frederic Clere
 
Monitoring Docker with ELK
Daniel Berman
 
Logging with Elasticsearch, Logstash & Kibana
Amazee Labs
 
(Fios#02) 2. elk 포렌식 분석
INSIGHT FORENSIC
 
"How about no grep and zabbix?". ELK based alerts and metrics.
Vladimir Pavkin
 
Html 5 boot camp
Laurie Young
 
Jesse Olson - Nagios Log Server Architecture Overview
Nagios
 
Docker Logging and analysing with Elastic Stack
Jakub Hajek
 
Docker Logging and analysing with Elastic Stack - Jakub Hajek
PROIDEA
 
Elk ruminating on logs
Mathew Beane
 
Choose Your Own Adventure to Get Started with Grafana Loki
Imma Valls Bernaus
 
State of integration with Apache Camel (ApacheCon 2019)
Claus Ibsen
 
Tomcat next
Jean-Frederic Clere
 
Apache Camel K - Copenhagen v2
Claus Ibsen
 
Apache Camel K - Copenhagen
Claus Ibsen
 
apachecamelk-april2019-190409093034.pdf
ssuserbb9f511
 
Elk for applications on k8s
Che-Chia Chang
 
Experiences building a distributed shared log on RADOS - Noah Watkins
Ceph Community
 
Into The Box 2018 Ortus Keynote
Ortus Solutions, Corp
 
Developing Microservices with Apache Camel
Claus Ibsen
 
Ad

More from Waldemar Neto (13)

PDF
12 Factor App Docker na Cloud e outras buzzwords
Waldemar Neto
 
PDF
12 Factor APPS, docker na cloud e outras buzzwords
Waldemar Neto
 
PDF
Construindo APIs testáveis com Node.js - RSJS
Waldemar Neto
 
PDF
Symfony2 e Elasticsearch com FosElasticaBundle
Waldemar Neto
 
PDF
O que é docker?
Waldemar Neto
 
PDF
No mundo das ap is com Restful webservices
Waldemar Neto
 
PDF
Cakephp 3.0 o bolo ainda serve muita gente
Waldemar Neto
 
PDF
No sql no mundo da persistencia poliglota
Waldemar Neto
 
PPTX
Android para padawns
Waldemar Neto
 
PPTX
Como o elasticsearch salvou minhas buscas
Waldemar Neto
 
PPTX
CakePHP workshop ifsul
Waldemar Neto
 
PPTX
O que é esteganografia
Waldemar Neto
 
PPTX
Divisão de conhecimento e open source
Waldemar Neto
 
12 Factor App Docker na Cloud e outras buzzwords
Waldemar Neto
 
12 Factor APPS, docker na cloud e outras buzzwords
Waldemar Neto
 
Construindo APIs testáveis com Node.js - RSJS
Waldemar Neto
 
Symfony2 e Elasticsearch com FosElasticaBundle
Waldemar Neto
 
O que é docker?
Waldemar Neto
 
No mundo das ap is com Restful webservices
Waldemar Neto
 
Cakephp 3.0 o bolo ainda serve muita gente
Waldemar Neto
 
No sql no mundo da persistencia poliglota
Waldemar Neto
 
Android para padawns
Waldemar Neto
 
Como o elasticsearch salvou minhas buscas
Waldemar Neto
 
CakePHP workshop ifsul
Waldemar Neto
 
O que é esteganografia
Waldemar Neto
 
Divisão de conhecimento e open source
Waldemar Neto
 

Recently uploaded (20)

PPT
Agilent Optoelectronic Solutions for Mobile Application
andreashenniger2
 
PPTX
L1A Season 1 Guide made by A hegy Eng Grammar fixed
toszolder91
 
PDF
BRKACI-1001 - Your First 7 Days of ACI.pdf
fcesargonca
 
PPTX
Orchestrating things in Angular application
Peter Abraham
 
PPTX
一比一原版(SUNY-Albany毕业证)纽约州立大学奥尔巴尼分校毕业证如何办理
Taqyea
 
PDF
AI_MOD_1.pdf artificial intelligence notes
shreyarrce
 
PPTX
Softuni - Psychology of entrepreneurship
Kalin Karakehayov
 
PPT
introduction to networking with basics coverage
RamananMuthukrishnan
 
PPTX
Optimization_Techniques_ML_Presentation.pptx
farispalayi
 
PPTX
ONLINE BIRTH CERTIFICATE APPLICATION SYSYTEM PPT.pptx
ShyamasreeDutta
 
PPTX
原版西班牙莱昂大学毕业证(León毕业证书)如何办理
Taqyea
 
PPT
introductio to computers by arthur janry
RamananMuthukrishnan
 
PPTX
PE introd.pptxfrgfgfdgfdgfgrtretrt44t444
nepmithibai2024
 
PDF
BRKACI-1003 ACI Brownfield Migration - Real World Experiences and Best Practi...
fcesargonca
 
PPTX
PM200.pptxghjgfhjghjghjghjghjghjghjghjghjghj
breadpaan921
 
DOCX
Custom vs. Off-the-Shelf Banking Software
KristenCarter35
 
PDF
The-Hidden-Dangers-of-Skipping-Penetration-Testing.pdf.pdf
naksh4thra
 
PDF
Apple_Environmental_Progress_Report_2025.pdf
yiukwong
 
PPTX
sajflsajfljsdfljslfjslfsdfas;fdsfksadfjlsdflkjslgfs;lfjlsajfl;sajfasfd.pptx
theknightme
 
PDF
Build Fast, Scale Faster: Milvus vs. Zilliz Cloud for Production-Ready AI
Zilliz
 
Agilent Optoelectronic Solutions for Mobile Application
andreashenniger2
 
L1A Season 1 Guide made by A hegy Eng Grammar fixed
toszolder91
 
BRKACI-1001 - Your First 7 Days of ACI.pdf
fcesargonca
 
Orchestrating things in Angular application
Peter Abraham
 
一比一原版(SUNY-Albany毕业证)纽约州立大学奥尔巴尼分校毕业证如何办理
Taqyea
 
AI_MOD_1.pdf artificial intelligence notes
shreyarrce
 
Softuni - Psychology of entrepreneurship
Kalin Karakehayov
 
introduction to networking with basics coverage
RamananMuthukrishnan
 
Optimization_Techniques_ML_Presentation.pptx
farispalayi
 
ONLINE BIRTH CERTIFICATE APPLICATION SYSYTEM PPT.pptx
ShyamasreeDutta
 
原版西班牙莱昂大学毕业证(León毕业证书)如何办理
Taqyea
 
introductio to computers by arthur janry
RamananMuthukrishnan
 
PE introd.pptxfrgfgfdgfdgfgrtretrt44t444
nepmithibai2024
 
BRKACI-1003 ACI Brownfield Migration - Real World Experiences and Best Practi...
fcesargonca
 
PM200.pptxghjgfhjghjghjghjghjghjghjghjghjghj
breadpaan921
 
Custom vs. Off-the-Shelf Banking Software
KristenCarter35
 
The-Hidden-Dangers-of-Skipping-Penetration-Testing.pdf.pdf
naksh4thra
 
Apple_Environmental_Progress_Report_2025.pdf
yiukwong
 
sajflsajfljsdfljslfjslfsdfas;fdsfksadfjlsdflkjslgfs;lfjlsajfl;sajfasfd.pptx
theknightme
 
Build Fast, Scale Faster: Milvus vs. Zilliz Cloud for Production-Ready AI
Zilliz
 

Monitoramento com ELK - Elasticsearch - Logstash - Kibana