SlideShare a Scribd company logo
Real-time observability with
Redis and Grafana
Mikhail Volkov
Customer Success Manager
Redis Labs
Alexey Smolyanyy
Customer Success Lead
Redis Labs
@mikhailvolkov @alexey-smolyanyy
We are going to talk about
3 Real-life
applications built
with Redis Data
Source for Grafana
New features
of Grafana 7
data frames,
transformations
and streaming
Demonstrate
the new Redis Data
Source and
Application plug-in
with a custom panel
and dashboards
Introduce
interactive way to
manipulate your
Redis data with CLI
panel in Grafana
Phone is ringing...
Hello!
Redis Labs party
to meet all the
new faces in the
company
The thing I’m
looking forward to
most after COVID
COVID19 Travel Map
RedisTimeSeries is a
Redis Module adding a
Time Series data
structure to Redis
https://oss.redislabs.com/redistimeseries
● High volume inserts, low latency reads
● Query by start time and end-time
● Aggregated queries (Min, Max, Avg, Sum,
Range, Count, etc) for any time bucket
● Configurable maximum retention period
● Downsampling/Compaction - automatically
updated aggregated time series
● Secondary index - each time series has
labels (field value pairs) which will allows to
query by labels
Grafana Transformations
Weather dashboard
Pop-up Store Demo
Visualizing data on Grafana dashboard
RedisGears
https://oss.redislabs.com/redisgears
# Add Time-Series
def tsAdd(x):
xlen = execute('XLEN', x['key'])
execute('TS.ADD', 'ts:len:'+x['key'],
'*', xlen)
execute('TS.ADD', 'ts:enqueue:' +
x['key'], '*', x['value'])
# Stream Reader for any Queue
gb = GearsBuilder('StreamReader')
gb.countby(lambda x: x['key']).map(tsAdd)
gb.register(prefix='queue:*',
duration=5000, batch=10000,
trimStream=False)
Redis Data Source plug-in
Redis Data Source
grafana-cli plugins install redis-datasource
docker run -d -p 3000:3000 --name=grafana
-e "GF_INSTALL_PLUGINS=redis-datasource"
grafana/grafana
Creating panel to display Redis data
Redis time Series commands
Query editor for Redis INFO command
Real-time Observability
Query editor with Streaming enabled
Redis Application plug-in
Redis CLI panel
Redis Data Source and Application
plug-in
Demo
We talked about
3 Real-life
applications built
with Redis Data
Source for Grafana
New features
of Grafana 7
data frames,
transformations
and streaming
Demonstrated
the new Redis Data
Source and
Application plug-in
with a custom panel
and dashboards
Introduced
interactive way to
manipulate your
Redis data with CLI
panel in Grafana
Learn more
● Redis Data Source and Application plug-ins
○ https://github.com/RedisGrafana/grafana-redis-datasource
○ https://github.com/RedisGrafana/grafana-redis-app
● Projects
○ https://github.com/RedisGrafana/redis-coronavirus-map
○ https://github.com/RedisTimeSeries/redis-weather
○ https://github.com/RedisTimeSeries/redis-pop-up-store
● Redis Labs Technical Blog
○ Introducing the Redis Data Source Plug-in for Grafana
○ How to Use the New Redis Data Source for Grafana Plug-in
○ 3 Real-Life Apps Built with Redis Data Source for Grafana
Mikhail Volkov
Customer Success Manager
Redis Labs
Alexey Smolyanyy
Customer Success Lead
Redis Labs
@mikhailvolkov @alexey-smolyanyy

More Related Content

PPTX
InfluxDb
Guamaral Vasil
 
PPTX
Serverless
Natan Deitch
 
PPTX
Jeremy Foran [BAI Communications] | Detecting Subway Overcrowding in Real Tim...
InfluxData
 
PPTX
Using Spatial Data Streams In Real-Time
Lars Schmitz
 
PDF
Grafana introduction
Rico Chen
 
PDF
Federated Graphite in Docker - Denver Docker Meetup
Phil Zimmerman
 
PDF
Neues in SQL Server 2016 – Evaluierung SQL Server 2016 CTP 3 für den BI Stack
inovex GmbH
 
PDF
Fall in Love with Graphs and Metrics using Grafana
torkelo
 
InfluxDb
Guamaral Vasil
 
Serverless
Natan Deitch
 
Jeremy Foran [BAI Communications] | Detecting Subway Overcrowding in Real Tim...
InfluxData
 
Using Spatial Data Streams In Real-Time
Lars Schmitz
 
Grafana introduction
Rico Chen
 
Federated Graphite in Docker - Denver Docker Meetup
Phil Zimmerman
 
Neues in SQL Server 2016 – Evaluierung SQL Server 2016 CTP 3 für den BI Stack
inovex GmbH
 
Fall in Love with Graphs and Metrics using Grafana
torkelo
 

What's hot (20)

PPTX
DECK36 - Log everything! and Realtime Datastream Analytics with Storm
Mike Lohmann
 
PDF
Zentral QueryCon 2018
Henry Stamerjohann
 
PDF
Map Analytics in Starcraft II
gy8
 
PPTX
Scaling graphite to handle a zerg rush
Daniel Ben-Zvi
 
PPTX
Apache Kafka
Maher TEBOURBI
 
PDF
Map Analytics in Starcraft II
gy8
 
PDF
Real-time analytics as a service at King
Gyula Fóra
 
PDF
Python and trending_data_ops
chase pettet
 
PDF
Selenium camp 2017. Alexander Chumakin
Alex Chumakin
 
PDF
Why Open Source Works for DevOps Monitoring
DevOps.com
 
DOCX
empirical analysis modeling of power dissipation control in internet data ce...
saadjamil31
 
PPTX
Stream Processing Live Traffic Data with Kafka Streams
Tim Ysewyn
 
PPTX
PlatformDay2013 발표자료
Tae Young Lee
 
PDF
Migrating from Monolithic to Serverless (Kostas Katsikas) - GreeceJS #22
GreeceJS
 
PDF
Cloud Capacity Planning Tooling - South Bay SRE Meetup Aug-09-2016
Coburn Watson
 
PDF
redBorder: Open or die
Nextel S.A.
 
PDF
Google Cloud Dataflow meets TensorFlow
Hayato Yoshikawa
 
PDF
Graphite cluster setup blueprint
Anatoliy Dobrosynets
 
PPTX
Inneractive - Spark meetup2
tsliwowicz
 
PPTX
Implementing Real-Time IoT Stream Processing in Azure
Chris Pietschmann (Microsoft MVP)
 
DECK36 - Log everything! and Realtime Datastream Analytics with Storm
Mike Lohmann
 
Zentral QueryCon 2018
Henry Stamerjohann
 
Map Analytics in Starcraft II
gy8
 
Scaling graphite to handle a zerg rush
Daniel Ben-Zvi
 
Apache Kafka
Maher TEBOURBI
 
Map Analytics in Starcraft II
gy8
 
Real-time analytics as a service at King
Gyula Fóra
 
Python and trending_data_ops
chase pettet
 
Selenium camp 2017. Alexander Chumakin
Alex Chumakin
 
Why Open Source Works for DevOps Monitoring
DevOps.com
 
empirical analysis modeling of power dissipation control in internet data ce...
saadjamil31
 
Stream Processing Live Traffic Data with Kafka Streams
Tim Ysewyn
 
PlatformDay2013 발표자료
Tae Young Lee
 
Migrating from Monolithic to Serverless (Kostas Katsikas) - GreeceJS #22
GreeceJS
 
Cloud Capacity Planning Tooling - South Bay SRE Meetup Aug-09-2016
Coburn Watson
 
redBorder: Open or die
Nextel S.A.
 
Google Cloud Dataflow meets TensorFlow
Hayato Yoshikawa
 
Graphite cluster setup blueprint
Anatoliy Dobrosynets
 
Inneractive - Spark meetup2
tsliwowicz
 
Implementing Real-Time IoT Stream Processing in Azure
Chris Pietschmann (Microsoft MVP)
 
Ad

Similar to Real time observability with Redis and Grafana (20)

PPTX
[PLCUG] Splunk - complete Citrix environment monitoring
Jaroslaw Sobel
 
PDF
GumGum: Multi-Region Cassandra in AWS
DataStax Academy
 
PDF
Redis+Spark Structured Streaming: Roshan Kumar
Redis Labs
 
PDF
Advanced kapacitor
InfluxData
 
PPTX
Tim Hall [InfluxData] | InfluxDB Roadmap | InfluxDays Virtual Experience Lond...
InfluxData
 
PDF
R the unsung hero of Big Data
Dhafer Malouche
 
PPTX
A Node.js Developer's Guide to Bluemix
ibmwebspheresoftware
 
PDF
Qlik and Confluent Success Stories with Kafka - How Generali and Skechers Kee...
HostedbyConfluent
 
PPTX
Writing New Relic Plugins: NSQ
lxfontes
 
PDF
GE Predix 新手入门 赵锴 物联网_IoT
Kai Zhao
 
PDF
iRODS Globus Connector
Globus
 
PDF
GraphQL the holy contract between client and server
Pavel Chertorogov
 
PPT
Virtualized Platform Migration On A Validated System
gazdagf
 
PDF
Monitoring CloudStack and components
ShapeBlue
 
PDF
Rescale.pdf
ChethanSharma16
 
PPT
The Database Environment Chapter 9
Jeanie Arnoco
 
PPTX
TIAD 2016 : Application delivery in a container world
The Incredible Automation Day
 
PDF
HMI Replacement_GE MARK V, ABB Procontrol 13, MHI MIDAS 8000, SIEMEN TXP
Hyemin Hwang
 
PDF
Time series database, InfluxDB & PHP
Corley S.r.l.
 
PPTX
MATLAB and Scientific Data: New Features and Capabilities
The HDF-EOS Tools and Information Center
 
[PLCUG] Splunk - complete Citrix environment monitoring
Jaroslaw Sobel
 
GumGum: Multi-Region Cassandra in AWS
DataStax Academy
 
Redis+Spark Structured Streaming: Roshan Kumar
Redis Labs
 
Advanced kapacitor
InfluxData
 
Tim Hall [InfluxData] | InfluxDB Roadmap | InfluxDays Virtual Experience Lond...
InfluxData
 
R the unsung hero of Big Data
Dhafer Malouche
 
A Node.js Developer's Guide to Bluemix
ibmwebspheresoftware
 
Qlik and Confluent Success Stories with Kafka - How Generali and Skechers Kee...
HostedbyConfluent
 
Writing New Relic Plugins: NSQ
lxfontes
 
GE Predix 新手入门 赵锴 物联网_IoT
Kai Zhao
 
iRODS Globus Connector
Globus
 
GraphQL the holy contract between client and server
Pavel Chertorogov
 
Virtualized Platform Migration On A Validated System
gazdagf
 
Monitoring CloudStack and components
ShapeBlue
 
Rescale.pdf
ChethanSharma16
 
The Database Environment Chapter 9
Jeanie Arnoco
 
TIAD 2016 : Application delivery in a container world
The Incredible Automation Day
 
HMI Replacement_GE MARK V, ABB Procontrol 13, MHI MIDAS 8000, SIEMEN TXP
Hyemin Hwang
 
Time series database, InfluxDB & PHP
Corley S.r.l.
 
MATLAB and Scientific Data: New Features and Capabilities
The HDF-EOS Tools and Information Center
 
Ad

Recently uploaded (20)

PDF
New Download FL Studio Crack Full Version [Latest 2025]
imang66g
 
PPTX
The-Dawn-of-AI-Reshaping-Our-World.pptxx
parthbhanushali307
 
PPTX
Visualising Data with Scatterplots in IBM SPSS Statistics.pptx
Version 1 Analytics
 
PDF
Generating Union types w/ Static Analysis
K. Matthew Dupree
 
PDF
On Software Engineers' Productivity - Beyond Misleading Metrics
Romén Rodríguez-Gil
 
PPTX
oapresentation.pptx
mehatdhavalrajubhai
 
PDF
Protecting the Digital World Cyber Securit
dnthakkar16
 
PDF
vAdobe Premiere Pro 2025 (v25.2.3.004) Crack Pre-Activated Latest
imang66g
 
PDF
New Download MiniTool Partition Wizard Crack Latest Version 2025
imang66g
 
PDF
Applitools Platform Pulse: What's New and What's Coming - July 2025
Applitools
 
PDF
49784907924775488180_LRN2959_Data_Pump_23ai.pdf
Abilash868456
 
PPTX
Presentation about Database and Database Administrator
abhishekchauhan86963
 
PDF
Appium Automation Testing Tutorial PDF: Learn Mobile Testing in 7 Days
jamescantor38
 
PDF
advancepresentationskillshdhdhhdhdhdhhfhf
jasmenrojas249
 
PPT
Why Reliable Server Maintenance Service in New York is Crucial for Your Business
Sam Vohra
 
PDF
ShowUs: Pharo Stream Deck (ESUG 2025, Gdansk)
ESUG
 
PDF
49785682629390197565_LRN3014_Migrating_the_Beast.pdf
Abilash868456
 
PDF
MiniTool Power Data Recovery Crack New Pre Activated Version Latest 2025
imang66g
 
PPTX
AI-Ready Handoff: Auto-Summaries & Draft Emails from MQL to Slack in One Flow
bbedford2
 
PDF
Adobe Illustrator Crack Full Download (Latest Version 2025) Pre-Activated
imang66g
 
New Download FL Studio Crack Full Version [Latest 2025]
imang66g
 
The-Dawn-of-AI-Reshaping-Our-World.pptxx
parthbhanushali307
 
Visualising Data with Scatterplots in IBM SPSS Statistics.pptx
Version 1 Analytics
 
Generating Union types w/ Static Analysis
K. Matthew Dupree
 
On Software Engineers' Productivity - Beyond Misleading Metrics
Romén Rodríguez-Gil
 
oapresentation.pptx
mehatdhavalrajubhai
 
Protecting the Digital World Cyber Securit
dnthakkar16
 
vAdobe Premiere Pro 2025 (v25.2.3.004) Crack Pre-Activated Latest
imang66g
 
New Download MiniTool Partition Wizard Crack Latest Version 2025
imang66g
 
Applitools Platform Pulse: What's New and What's Coming - July 2025
Applitools
 
49784907924775488180_LRN2959_Data_Pump_23ai.pdf
Abilash868456
 
Presentation about Database and Database Administrator
abhishekchauhan86963
 
Appium Automation Testing Tutorial PDF: Learn Mobile Testing in 7 Days
jamescantor38
 
advancepresentationskillshdhdhhdhdhdhhfhf
jasmenrojas249
 
Why Reliable Server Maintenance Service in New York is Crucial for Your Business
Sam Vohra
 
ShowUs: Pharo Stream Deck (ESUG 2025, Gdansk)
ESUG
 
49785682629390197565_LRN3014_Migrating_the_Beast.pdf
Abilash868456
 
MiniTool Power Data Recovery Crack New Pre Activated Version Latest 2025
imang66g
 
AI-Ready Handoff: Auto-Summaries & Draft Emails from MQL to Slack in One Flow
bbedford2
 
Adobe Illustrator Crack Full Download (Latest Version 2025) Pre-Activated
imang66g
 

Real time observability with Redis and Grafana

  • 1. Real-time observability with Redis and Grafana Mikhail Volkov Customer Success Manager Redis Labs Alexey Smolyanyy Customer Success Lead Redis Labs @mikhailvolkov @alexey-smolyanyy
  • 2. We are going to talk about 3 Real-life applications built with Redis Data Source for Grafana New features of Grafana 7 data frames, transformations and streaming Demonstrate the new Redis Data Source and Application plug-in with a custom panel and dashboards Introduce interactive way to manipulate your Redis data with CLI panel in Grafana
  • 4. Redis Labs party to meet all the new faces in the company The thing I’m looking forward to most after COVID
  • 6. RedisTimeSeries is a Redis Module adding a Time Series data structure to Redis https://oss.redislabs.com/redistimeseries ● High volume inserts, low latency reads ● Query by start time and end-time ● Aggregated queries (Min, Max, Avg, Sum, Range, Count, etc) for any time bucket ● Configurable maximum retention period ● Downsampling/Compaction - automatically updated aggregated time series ● Secondary index - each time series has labels (field value pairs) which will allows to query by labels
  • 10. Visualizing data on Grafana dashboard
  • 11. RedisGears https://oss.redislabs.com/redisgears # Add Time-Series def tsAdd(x): xlen = execute('XLEN', x['key']) execute('TS.ADD', 'ts:len:'+x['key'], '*', xlen) execute('TS.ADD', 'ts:enqueue:' + x['key'], '*', x['value']) # Stream Reader for any Queue gb = GearsBuilder('StreamReader') gb.countby(lambda x: x['key']).map(tsAdd) gb.register(prefix='queue:*', duration=5000, batch=10000, trimStream=False)
  • 12. Redis Data Source plug-in
  • 13. Redis Data Source grafana-cli plugins install redis-datasource docker run -d -p 3000:3000 --name=grafana -e "GF_INSTALL_PLUGINS=redis-datasource" grafana/grafana
  • 14. Creating panel to display Redis data
  • 15. Redis time Series commands
  • 16. Query editor for Redis INFO command
  • 18. Query editor with Streaming enabled
  • 21. Redis Data Source and Application plug-in Demo
  • 22. We talked about 3 Real-life applications built with Redis Data Source for Grafana New features of Grafana 7 data frames, transformations and streaming Demonstrated the new Redis Data Source and Application plug-in with a custom panel and dashboards Introduced interactive way to manipulate your Redis data with CLI panel in Grafana
  • 23. Learn more ● Redis Data Source and Application plug-ins ○ https://github.com/RedisGrafana/grafana-redis-datasource ○ https://github.com/RedisGrafana/grafana-redis-app ● Projects ○ https://github.com/RedisGrafana/redis-coronavirus-map ○ https://github.com/RedisTimeSeries/redis-weather ○ https://github.com/RedisTimeSeries/redis-pop-up-store ● Redis Labs Technical Blog ○ Introducing the Redis Data Source Plug-in for Grafana ○ How to Use the New Redis Data Source for Grafana Plug-in ○ 3 Real-Life Apps Built with Redis Data Source for Grafana
  • 24. Mikhail Volkov Customer Success Manager Redis Labs Alexey Smolyanyy Customer Success Lead Redis Labs @mikhailvolkov @alexey-smolyanyy