SlideShare a Scribd company logo
Event Stream
Processing
with Kafka
 Tim Lossen • @tlossen • Wooga
Kafka?
Event-Stream Processing with Kafka
1883 — 1924
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
high-throughput
persistent
publish-subscribe
messaging
high-throughput
persistent
publish-subscribe
messaging
producer
broker
consumer
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
high-throughput
persistent
publish-subscribe
messaging
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
high-throughput
persistent
publish-subscribe
messaging
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
high-throughput
persistent
publish-subscribe
messaging
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Case Study:
 Tracking
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
requests per second
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
installs per minute
Event-Stream Processing with Kafka
Kafkaesque
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
github.com/wooga/kafka-rb
github.com/wooga/kafka-erlang
github.com/wooga/kafkaesque
Questions?
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka
Event-Stream Processing with Kafka

More Related Content

What's hot (20)

PPTX
Mario Cartia - SMACK is the new LAMP! - Codemotion Milan 2017
Codemotion
 
PDF
Apache Kafkaとグラフデータベースによる成長するネットワークグラフを分析・可視化する基盤
Yoshiyasu SAEKI
 
PPTX
No Docker? No Problem: Automating installation and config with Ansible
Jeff Potts
 
PPT
DevOpsCon Cloud Workshop
Sascha Möllering
 
PDF
Kubernetes on AWS gone wild
Christian Jantz
 
PDF
Apache Kafka 0.11 の Exactly Once Semantics
Yoshiyasu SAEKI
 
PDF
Immutable Infrastructure: Rise of the Machine Images
C4Media
 
PDF
Real time stock processing with apache nifi, apache flink and apache kafka
Timothy Spann
 
PDF
Don’t Be Scared: Multi-Tenant Cluster Support at Scale (Kelly Attaway, Pandor...
confluent
 
PPTX
RedisConf17 - Pain-free Pipelining
Redis Labs
 
PDF
Livy: A REST Web Service For Apache Spark
Jen Aman
 
PPTX
Continuous Deployment to the Cloud using Spinnaker
Tim Ysewyn
 
PDF
Kafka Summit NYC 2017 - The Source of Truth: Why the New York Times Stores Ev...
confluent
 
PDF
Spinnaker Chadev
Ethan Rogers
 
PDF
2015-04-15 | Apache Kafka (Vienna Scala User Group)
Dominik Gruber
 
PPTX
Canary Releases on Kubernetes w/ Spinnaker, Istio, and Prometheus
Kublr
 
PDF
Fact-Based Monitoring - PuppetConf 2014
Puppet
 
PDF
E2E Data Pipeline - Apache Spark/Airflow/Livy
Rikin Tanna
 
PPTX
APPLICATIONS AND CONTAINERS AT SCALE: OpenShift + Kubernetes + Docker
Steven Pousty
 
PPTX
Mutating Admission Webhook creation
Victor Morales
 
Mario Cartia - SMACK is the new LAMP! - Codemotion Milan 2017
Codemotion
 
Apache Kafkaとグラフデータベースによる成長するネットワークグラフを分析・可視化する基盤
Yoshiyasu SAEKI
 
No Docker? No Problem: Automating installation and config with Ansible
Jeff Potts
 
DevOpsCon Cloud Workshop
Sascha Möllering
 
Kubernetes on AWS gone wild
Christian Jantz
 
Apache Kafka 0.11 の Exactly Once Semantics
Yoshiyasu SAEKI
 
Immutable Infrastructure: Rise of the Machine Images
C4Media
 
Real time stock processing with apache nifi, apache flink and apache kafka
Timothy Spann
 
Don’t Be Scared: Multi-Tenant Cluster Support at Scale (Kelly Attaway, Pandor...
confluent
 
RedisConf17 - Pain-free Pipelining
Redis Labs
 
Livy: A REST Web Service For Apache Spark
Jen Aman
 
Continuous Deployment to the Cloud using Spinnaker
Tim Ysewyn
 
Kafka Summit NYC 2017 - The Source of Truth: Why the New York Times Stores Ev...
confluent
 
Spinnaker Chadev
Ethan Rogers
 
2015-04-15 | Apache Kafka (Vienna Scala User Group)
Dominik Gruber
 
Canary Releases on Kubernetes w/ Spinnaker, Istio, and Prometheus
Kublr
 
Fact-Based Monitoring - PuppetConf 2014
Puppet
 
E2E Data Pipeline - Apache Spark/Airflow/Livy
Rikin Tanna
 
APPLICATIONS AND CONTAINERS AT SCALE: OpenShift + Kubernetes + Docker
Steven Pousty
 
Mutating Admission Webhook creation
Victor Morales
 

More from Tim Lossen (20)

PDF
Apocalypse Later
Tim Lossen
 
PDF
Embracing Failure
Tim Lossen
 
PDF
Embracing Failure
Tim Lossen
 
PDF
Enemy of the State?
Tim Lossen
 
PDF
Beyond Devops
Tim Lossen
 
PDF
All Your Core Are Belong To Us
Tim Lossen
 
PDF
Podularity FTW!
Tim Lossen
 
PDF
Cubic Foot Gardening
Tim Lossen
 
PDF
Into the Void
Tim Lossen
 
PDF
Treasure Island -- Concurrency in JRuby
Tim Lossen
 
PDF
Dashboard Mania
Tim Lossen
 
PDF
JRuby vs. Rubinius
Tim Lossen
 
PDF
Redis to the Rescue?
Tim Lossen
 
PDF
Redis to the Rescue?
Tim Lossen
 
PDF
The Smallest Cluster in the World
Tim Lossen
 
PDF
Announcing Euruko 2011
Tim Lossen
 
PDF
Memory: The New Disk
Tim Lossen
 
PDF
Key-Value-Stores -- The Key to Scaling?
Tim Lossen
 
PDF
Cassandra vs. Redis
Tim Lossen
 
PDF
An Introduction to Membase
Tim Lossen
 
Apocalypse Later
Tim Lossen
 
Embracing Failure
Tim Lossen
 
Embracing Failure
Tim Lossen
 
Enemy of the State?
Tim Lossen
 
Beyond Devops
Tim Lossen
 
All Your Core Are Belong To Us
Tim Lossen
 
Podularity FTW!
Tim Lossen
 
Cubic Foot Gardening
Tim Lossen
 
Into the Void
Tim Lossen
 
Treasure Island -- Concurrency in JRuby
Tim Lossen
 
Dashboard Mania
Tim Lossen
 
JRuby vs. Rubinius
Tim Lossen
 
Redis to the Rescue?
Tim Lossen
 
Redis to the Rescue?
Tim Lossen
 
The Smallest Cluster in the World
Tim Lossen
 
Announcing Euruko 2011
Tim Lossen
 
Memory: The New Disk
Tim Lossen
 
Key-Value-Stores -- The Key to Scaling?
Tim Lossen
 
Cassandra vs. Redis
Tim Lossen
 
An Introduction to Membase
Tim Lossen
 
Ad

Recently uploaded (20)

PPTX
From Sci-Fi to Reality: Exploring AI Evolution
Svetlana Meissner
 
PPTX
"Autonomy of LLM Agents: Current State and Future Prospects", Oles` Petriv
Fwdays
 
PDF
CIFDAQ Weekly Market Wrap for 11th July 2025
CIFDAQ
 
PPTX
AI Penetration Testing Essentials: A Cybersecurity Guide for 2025
defencerabbit Team
 
PDF
Empower Inclusion Through Accessible Java Applications
Ana-Maria Mihalceanu
 
PDF
Achieving Consistent and Reliable AI Code Generation - Medusa AI
medusaaico
 
PDF
Building Real-Time Digital Twins with IBM Maximo & ArcGIS Indoors
Safe Software
 
PDF
Transcript: New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
PDF
NewMind AI - Journal 100 Insights After The 100th Issue
NewMind AI
 
PDF
Exolore The Essential AI Tools in 2025.pdf
Srinivasan M
 
PDF
CIFDAQ Market Insights for July 7th 2025
CIFDAQ
 
PPTX
WooCommerce Workshop: Bring Your Laptop
Laura Hartwig
 
PDF
"Beyond English: Navigating the Challenges of Building a Ukrainian-language R...
Fwdays
 
PDF
DevBcn - Building 10x Organizations Using Modern Productivity Metrics
Justin Reock
 
PPTX
COMPARISON OF RASTER ANALYSIS TOOLS OF QGIS AND ARCGIS
Sharanya Sarkar
 
PDF
LLMs.txt: Easily Control How AI Crawls Your Site
Keploy
 
PDF
Chris Elwell Woburn, MA - Passionate About IT Innovation
Chris Elwell Woburn, MA
 
PDF
New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
PDF
The Builder’s Playbook - 2025 State of AI Report.pdf
jeroen339954
 
PDF
Newgen Beyond Frankenstein_Build vs Buy_Digital_version.pdf
darshakparmar
 
From Sci-Fi to Reality: Exploring AI Evolution
Svetlana Meissner
 
"Autonomy of LLM Agents: Current State and Future Prospects", Oles` Petriv
Fwdays
 
CIFDAQ Weekly Market Wrap for 11th July 2025
CIFDAQ
 
AI Penetration Testing Essentials: A Cybersecurity Guide for 2025
defencerabbit Team
 
Empower Inclusion Through Accessible Java Applications
Ana-Maria Mihalceanu
 
Achieving Consistent and Reliable AI Code Generation - Medusa AI
medusaaico
 
Building Real-Time Digital Twins with IBM Maximo & ArcGIS Indoors
Safe Software
 
Transcript: New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
NewMind AI - Journal 100 Insights After The 100th Issue
NewMind AI
 
Exolore The Essential AI Tools in 2025.pdf
Srinivasan M
 
CIFDAQ Market Insights for July 7th 2025
CIFDAQ
 
WooCommerce Workshop: Bring Your Laptop
Laura Hartwig
 
"Beyond English: Navigating the Challenges of Building a Ukrainian-language R...
Fwdays
 
DevBcn - Building 10x Organizations Using Modern Productivity Metrics
Justin Reock
 
COMPARISON OF RASTER ANALYSIS TOOLS OF QGIS AND ARCGIS
Sharanya Sarkar
 
LLMs.txt: Easily Control How AI Crawls Your Site
Keploy
 
Chris Elwell Woburn, MA - Passionate About IT Innovation
Chris Elwell Woburn, MA
 
New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
The Builder’s Playbook - 2025 State of AI Report.pdf
jeroen339954
 
Newgen Beyond Frankenstein_Build vs Buy_Digital_version.pdf
darshakparmar
 
Ad