Abstract image of a woman sitting on books and studying on a laptop

JavaBin: Reacting to an event driven world

Download as PPTX, PDF
G
Grace Jansen

The document discusses event-driven architecture and its implementation in microservices, emphasizing the use of Apache Kafka as a distributed streaming platform. It introduces concepts of reactive programming and architecture patterns that enhance application responsiveness and scalability. Additionally, it provides resources and frameworks for developing reactive systems with Kafka, including details on message retention, resiliency, and different libraries for effective integration.

Software
1 of 86
Download to read offline
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
Reacting to an Event- Driven World Grace Jansen IBM Developer Advocate @gracejansen27 © 2021 IBM Corporation Kate Stanley IBM Software Engineer @katestanley91
Let’s get some coffee… © 2020 IBM Corporation
Barista Example: © 2020 IBM Corporation Coffee Shop Barista Coffee Lovers HTTP HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo
Event Driven Architecture © 2020 IBM Corporation S1 S3 S2 S4 Event-driven messaging backbone Microservice publishing events Microservice consuming events Event-driven messaging backbone http://ibm.biz/AdvantagesOfEDA
Barista Example: © 2020 IBM Corporation Coffee Shop Coffee Shop Barista Barista Board Coffee Lovers Coffee Lovers HTTP Orders, Queue HTTP HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo Event Backbone
© 2020 IBM Corporation Apache Kafka is an open source, distributed streaming platform Stream history Immutable data Highly available Scalable Scalable consumption
© 2020 IBM Corporation Q: Is your coffee shop non-blocking and highly responsive?
© 2020 IBM Corporation Q: Is your microservice system non- blocking and highly responsive?
© 2020 IBM Corporation Q: Is your microservice system non- blocking and highly responsive? A:Yes I’m using Kafka!
© 2020 IBM Corporation Q: Is your microservice system non- blocking and highly responsive? A:Yes I’m using Kafka!
Reactive systems © 2020 IBM Corporation
Reactive Manifesto © 2020 IBM Corporation
Message-Driven Reactive Manifesto © 2020 IBM Corporation
Events “A signal emitted by a component upon reaching a given state.” © 2020 IBM Corporation A message can contain an encoded event in its payload. Messages “An item of data sent to a specific location.”
© 2020 IBM Corporation Apache Kafka is an open source, distributed streaming platform Publish and subscribe to streams of records Store records in durable way Process streams of records as they occur
Barista Example: © 2020 IBM Corporation Coffee Shop Barista Board Coffee Lovers Orders, Queue HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo Event Backbone
Barista Example: © 2020 IBM Corporation Coffee Shop Barista Board Coffee Lovers Orders, Queue HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo Event Backbone
Barista Example: © 2020 IBM Corporation Coffee Shop Barista Board Coffee Lovers Orders, Queue HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo Event Backbone
Elastic Message-Driven Reactive Manifesto © 2020 IBM Corporation
Barista Example: © 2020 IBM Corporation Coffee Shop Barista Board Coffee Lovers Orders, Queue HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo Event Backbone
Barista Example: © 2020 IBM Corporation Coffee Shop Barista Board Coffee Lovers Orders, Queue HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo Event Backbone
Barista Example: © 2020 IBM Corporation Coffee Shop Barista Board Coffee Lovers Orders, Queue HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo Event Backbone
Resilient Elastic Message-Driven Reactive Manifesto © 2020 IBM Corporation
Resilient Elastic Responsive Message-Driven Reactive Manifesto © 2020 IBM Corporation
Resilient Elastic Responsive Message-Driven Reactive Manifesto © 2020 IBM Corporation
Building reactive systems © 2020 IBM Corporation
How do we make a highly responsive app? Microservice 1 © 2020 IBM Corporation Microservice 2 Microservice 3
How do we make a highly responsive app? Microservice 1 © 2020 IBM Corporation Microservice 2 Microservice 3 Reactive Architecture Patterns
Reactive Architecture design patterns CQRS Circuit breaker Saga Back pressure © 2020 IBM Corporation APP WRITE API APP READ API APP APP APP APP APP APP APP APP
How do we make a highly responsive app? Microservice 1 © 2020 IBM Corporation Microservice 2 Microservice 3 Futures Reactive Streams Libraries Futures Reactive Streams Libraries Futures Reactive Streams Libraries Reactive Programming
Reactive Programming © 2020 IBM Corporation A subset of asynchronous programming and a paradigm where the availability of new information drives the logic forward rather than having control flow driven by a thread-of-execution.
Reactive Programming Patterns © 2020 IBM Corporation Futures: a promise to hold the result of some operation once that operation completes Reactive programming libraries: for composing asynchronous and event-based programs. (e.g. RxJava, SmallRye Mutiny) Reactive Streams: a programming concept for handling asynchronous data streams in a non-blocking manner while providing backpressure to stream publishers
Utilising Kafka in reactive systems © 2020 IBM Corporation
Resilient Elastic Responsive Message-Driven Message-Driven with Kafka © 2020 IBM Corporation
Resilient Elastic Responsive Message-Driven Resiliency in Kafka © 2020 IBM Corporation
Message Retention and Data Persistence © 2020 IBM Corporation Stream history Immutable Data
Resilient Kafka Clusters © 2020 IBM Corporation
© 2020 IBM Corporation Resilient Kafka Clusters
Resilient Kafka Clusters © 2021 IBM Corporation
Topic A Partition 1 Broker 1 Topic A Partition 1 Offline Leader Resilient Kafka Clusters © 2021 IBM Corporation
Resilient Producers Delivery guarantees: At most once At least once Configuration: Acks Retries © 2021 IBM Corporation
Resilient Consumers 0 1 2 3 4 5 Offset © 2021 IBM Corporation
Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte
Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Coffee
Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Coffee
Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte
Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Cappuccino
Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Cappuccino Latte
Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Cappuccino Latte Baristas with manual commit Coffee Cappuccino Latte TOPIC Barista
Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Cappuccino Latte Baristas with manual commit Coffee Cappuccino Latte TOPIC Barista Coffee
Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Cappuccino Latte Baristas with manual commit Coffee Cappuccino Latte TOPIC Barista Coffee
Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Cappuccino Latte Baristas with manual commit Coffee Cappuccino Latte TOPIC Barista Coffee Latte Cappuccino
Schemas and Schema Registries © 2020 IBM Corporation
Resilient Elastic Responsive Message-Driven Scalability in Kafka © 2021 IBM Corporation
Scalability in Kafka © 2021 IBM Corporation
Elasticity in Consumers © 2021 IBM Corporation
Consumer Groups Consumer groupA Topic 0 1 2 3 0 1 2 3 4 5 Partition 0 Partition 1 Partition 2 0 1 2 3 4 5 6 7 Consumer Consumer Consumer Consumer group B Consumer Consumer © 2021 IBM Corporation
Consumer Groups Consumer groupA p0, offset 7 p1, offset 3 p2, offset 5 Topic 0 1 2 3 0 1 2 3 4 5 Partition 0 Partition 1 Partition 2 0 1 2 3 4 5 6 7 Consumer Consumer Consumer Consumer group B Consumer Consumer © 2021 IBM Corporation
Consumer Groups Consumer groupA p0, offset 7 p1, offset 3 p2, offset 5 Topic 0 1 2 3 0 1 2 3 4 5 Partition 0 Partition 1 Partition 2 0 1 2 3 4 5 6 7 Consumer Consumer Consumer Consumer group B p0, offset 7 p1, offset 3 p2, offset 5 Consumer Consumer © 2021 IBM Corporation
Consumer Groups Consumer groupA p0, offset 7 p1, offset 3 p2, offset 5 Topic 0 1 2 3 0 1 2 3 4 5 Partition 0 Partition 1 Partition 2 0 1 2 3 4 5 6 7 Consumer Consumer Consumer Consumer Consumer group B p0, offset 7 p1, offset 3 p2, offset 5 Consumer Consumer © 2021 IBM Corporation
Writing reactive Kafka applications
© 2021 IBM Corporation
Reactive Frameworks for Kafka Alpakka Kafka Connector MicroProfile Reactive Messaging Vert.x Kafka Client © 2021 IBM Corporation
Alpakka Kafka Connector API © 2021 IBM Corporation
Eclipse MicroProfile An open-source community specification for Enterprise Java microservices A community of: individuals organizations vendors © 2021 IBM Corporation
MicroProfile 3.3 Stack Reactive Streams Operators 1.1 GraphQL 1.0 Standalone Projects JSON-B 1.0 JSON-P 1.1 CDI 2.0 Config 1.4 Fault Tolerance 2.1 JWT Propagation 1.1 Health Check 2.2 Metrics 2.3 OpenTracing 1.3 Open API 1.1 JAX-RS 2.1 Rest Client 1.4 Reactive Messaging 1.0 Context Propagation 1.0 Reactive Streams Not a MicroProfile spec © 2021 IBM Corporation
MicroProfile Reactive Messaging Application’s beans contain methods annotated with @Incoming and @Outgoing annotations The annotated methods are connected by named channels A channel is a name indicating which source or destination of messages is used. Channels are opaque Strings. @Incoming and @Outgoing annotations are matched up by channel names © 2021 IBM Corporation
What is Eclipse Vert.x? Polyglot Tool-kit Based on Reactor pattern Runs on the JVM Non-blocking Event-driven Includes distributed event-bus Code is single-threaded © 2021 IBM Corporation
Vert.x Demo App © 2020 IBM Corporation
Demo app © 2021 IBM Corporation https://github.com/ibm-messaging/kafka-java-vertx-starter Vert.x app produce consume
Demo app © 2021 IBM Corporation Vert.x app websocket produce consume https://github.com/ibm-messaging/kafka-java-vertx-starter
© 2021 IBM Corporation https://github.com/ibm-messaging/kafka-java-vertx-starter
© 2021 IBM Corporation
Producing Records © 2021 IBM Corporation Vert.x app websocket produce Start Stop
Producing Records © 2021 IBM Corporation
Consuming and Processing Records © 2021 IBM Corporation Apache Kafka Java Client:
© 2021 IBM Corporation Consuming and Processing Records Apache Kafka Java Client:
© 2021 IBM Corporation Consuming and Processing Records Apache Kafka Java Client:
© 2021 IBM Corporation Consuming and Processing Records Vert.x Kafka Client
© 2021 IBM Corporation Consuming and Processing Records Vert.x Kafka Client
© 2021 IBM Corporation Flow Control Vert.x Kafka Client
© 2021 IBM Corporation ibm.biz/ExperiencesWritingAReactiveKafkaApp
Summary Non-reactive + Kafka != reactive Consider Kafka configuration for the best reactive system The open-source reactive community is on hand to help! Reactive toolkits and frameworks can provide additional benefits © 2021 IBM Corporation
Reactive Systems Explained © 2021 IBM Corporation ibm.biz/ReactiveReport
MicroProfile Reactive labs ibm.biz/reactive-java-labs © 2021 IBM Corporation
Thank you Grace Jansen | @gracejansen27 Kate Stanley | @katestanley91 © 2021 IBM Corporation Reactive resources: https://ibm.biz/IntroToReactive https://ibm.biz/GettingStartedWithReactive Getting started with Kafka: https://kafka.apache.org/quickstart https://strimzi.io https://ibm.github.io/event-streams/schemas/overview/ Reactive Kafka libraries https://vertx.io/docs/vertx-kafka-client/java/ https://github.com/eclipse/microprofile-reactive- messaging https://projectreactor.io/docs/kafka https://github.com/akka/alpakka-kafka Open Liberty: https://openliberty.io

More Related Content

PPTX
VJUG - Reacting to an event driven world
Grace Jansen
 
PPTX
Jfokus - Reacting to an event-driven world
Grace Jansen
 
PPTX
DevNexus - Reacting to an event driven world
Grace Jansen
 
PPTX
GIDS Architecture Live: Reacting to an event-driven world
Grace Jansen
 
PPTX
JSpring Virtual 2020 - Reacting to an event-driven world
Grace Jansen
 
PPTX
Virtual Meetup Sweden - Reacting to an event driven world
Grace Jansen
 
PDF
DevOps for Mobile - DevOpsDays, NY, 2013
Sanjeev Sharma
 
PDF
Powering the digital economy with CICS and z/OS connect - at the "z Systems...
DevOps for Enterprise Systems
 
VJUG - Reacting to an event driven world
Grace Jansen
 
Jfokus - Reacting to an event-driven world
Grace Jansen
 
DevNexus - Reacting to an event driven world
Grace Jansen
 
GIDS Architecture Live: Reacting to an event-driven world
Grace Jansen
 
JSpring Virtual 2020 - Reacting to an event-driven world
Grace Jansen
 
Virtual Meetup Sweden - Reacting to an event driven world
Grace Jansen
 
DevOps for Mobile - DevOpsDays, NY, 2013
Sanjeev Sharma
 
Powering the digital economy with CICS and z/OS connect - at the "z Systems...
DevOps for Enterprise Systems
 

What's hot (18)

PDF
High Scalability Network Monitoring for Communications Service Providers
CA Technologies
 
PDF
Re Inventing Enterprise IT around APIs and Apps
WSO2
 
PDF
Systems Resource Management with NetIQ AppManager
Advanced Logic Industries
 
PPT
SuperConnectivity: One company’s heroic mission to deliver on the promises of...
4DK Technologies, Inc.
 
PDF
Path to Network Functions Virtualization (NFV) Nirvana 2013
Andrew Hendry
 
PPTX
#8311: Transform the Enterprise with IBM Cloud Private
Michael Elder
 
PDF
Cloud K5 Services_Description
Alessandro Guli
 
PDF
Virtualization case study
Mirza Adil
 
PDF
Domenico Maracci, Stefano Sali - Secure Continuous Delivery - Sicurezza e Dev...
Codemotion
 
PDF
An architect’s guide to leveraging your incumbency
Michael Elder
 
PPTX
The App Evolution Continues
Paula Peña (She, Her, Hers)
 
PPT
SHARE 2014 Pittsburgh, Managing multi version applications in cics
nick_garrod
 
PDF
Test Centre case studies - Cathal McGloin (FeedHenry)
NGN Test Centre
 
PDF
IBM Think 2020 Openshift on IBM Z and LinuxONE
Filipe Miranda
 
PDF
What Mobile Developers Should Know
MobiVentures
 
PDF
Demo to Prepare for “Hands-On Lab: Take a Deep Dive with Experts Who Have Int...
CA Technologies
 
PPTX
Twelve factor-app
José Javier Vélez Colón
 
PDF
EDI WS API ECGridOS Web Services
bizquirk
 
High Scalability Network Monitoring for Communications Service Providers
CA Technologies
 
Re Inventing Enterprise IT around APIs and Apps
WSO2
 
Systems Resource Management with NetIQ AppManager
Advanced Logic Industries
 
SuperConnectivity: One company’s heroic mission to deliver on the promises of...
4DK Technologies, Inc.
 
Path to Network Functions Virtualization (NFV) Nirvana 2013
Andrew Hendry
 
#8311: Transform the Enterprise with IBM Cloud Private
Michael Elder
 
Cloud K5 Services_Description
Alessandro Guli
 
Virtualization case study
Mirza Adil
 
Domenico Maracci, Stefano Sali - Secure Continuous Delivery - Sicurezza e Dev...
Codemotion
 
An architect’s guide to leveraging your incumbency
Michael Elder
 
The App Evolution Continues
Paula Peña (She, Her, Hers)
 
SHARE 2014 Pittsburgh, Managing multi version applications in cics
nick_garrod
 
Test Centre case studies - Cathal McGloin (FeedHenry)
NGN Test Centre
 
IBM Think 2020 Openshift on IBM Z and LinuxONE
Filipe Miranda
 
What Mobile Developers Should Know
MobiVentures
 
Demo to Prepare for “Hands-On Lab: Take a Deep Dive with Experts Who Have Int...
CA Technologies
 
Twelve factor-app
José Javier Vélez Colón
 
EDI WS API ECGridOS Web Services
bizquirk
 
Ad

Similar to JavaBin: Reacting to an event driven world (20)

PPTX
JLove conference 2020 - Reacting to an Event-Driven World
Grace Jansen
 
PPTX
Developer Week - Reacting to an event-driven world
Grace Jansen
 
PDF
Reacting to an Event-Driven World (Kate Stanley & Grace Jansen, IBM) Kafka Su...
confluent
 
PDF
Reactive Microservices with Quarkus
Niklas Heidloff
 
PDF
Reactive Integrations - Caveats and bumps in the road explained
Markus Eisele
 
PDF
Building Serverless Apps with Kafka (Dale Lane, IBM) Kafka Summit London 2019
confluent
 
PDF
An intro to serverless and OpenWhisk for Kafka users
Dale Lane
 
PPTX
High-speed, Reactive Microservices 2017
Rick Hightower
 
PDF
Revitalizing Aging Architectures with Microservices
Legacy Typesafe (now Lightbend)
 
PPT
Reactive java programming for the impatient
Grant Steinfeld
 
PPTX
Event-driven microservices
Andrew Schofield
 
PDF
Building Reactive Applications With Node.Js And Red Hat JBoss Data Grid (Gald...
Red Hat Developers
 
PPTX
Reactive for the Impatient - Mary Grygleski
PolyglotMeetups
 
PDF
Openbar 12 - Leuven - From reactive programming to reactive architecture
Openbar
 
PPTX
Reactive applications tools of the trade huff po
shinolajla
 
PDF
Typesafe & William Hill: Cassandra, Spark, and Kafka - The New Streaming Data...
DataStax Academy
 
PDF
Activity feeds (and more) at mate1
Hisham Mardam-Bey
 
PDF
A Kafka journey and why migrate to Confluent Cloud?
confluent
 
PDF
Apache Kafka for Real-time Supply Chain in the Food and Retail Industry
Kai Wähner
 
PDF
Revitalizing Walmart's Aging Architecture for Web Scale
Kevin Webber
 
JLove conference 2020 - Reacting to an Event-Driven World
Grace Jansen
 
Developer Week - Reacting to an event-driven world
Grace Jansen
 
Reacting to an Event-Driven World (Kate Stanley & Grace Jansen, IBM) Kafka Su...
confluent
 
Reactive Microservices with Quarkus
Niklas Heidloff
 
Reactive Integrations - Caveats and bumps in the road explained
Markus Eisele
 
Building Serverless Apps with Kafka (Dale Lane, IBM) Kafka Summit London 2019
confluent
 
An intro to serverless and OpenWhisk for Kafka users
Dale Lane
 
High-speed, Reactive Microservices 2017
Rick Hightower
 
Revitalizing Aging Architectures with Microservices
Legacy Typesafe (now Lightbend)
 
Reactive java programming for the impatient
Grant Steinfeld
 
Event-driven microservices
Andrew Schofield
 
Building Reactive Applications With Node.Js And Red Hat JBoss Data Grid (Gald...
Red Hat Developers
 
Reactive for the Impatient - Mary Grygleski
PolyglotMeetups
 
Openbar 12 - Leuven - From reactive programming to reactive architecture
Openbar
 
Reactive applications tools of the trade huff po
shinolajla
 
Typesafe & William Hill: Cassandra, Spark, and Kafka - The New Streaming Data...
DataStax Academy
 
Activity feeds (and more) at mate1
Hisham Mardam-Bey
 
A Kafka journey and why migrate to Confluent Cloud?
confluent
 
Apache Kafka for Real-time Supply Chain in the Food and Retail Industry
Kai Wähner
 
Revitalizing Walmart's Aging Architecture for Web Scale
Kevin Webber
 
Ad

More from Grace Jansen (20)

PPTX
JPrime_JITServer.pptx
Grace Jansen
 
PPTX
SwissJUG_15_factor_app.pptx
Grace Jansen
 
PPTX
SwissJUG_Bringing the cloud back down to earth.pptx
Grace Jansen
 
PPTX
ThroughTheLookingGlass_EffectiveObservability.pptx
Grace Jansen
 
PPTX
PittsburgJUG_Cloud-Native Dev Tools: Bringing the cloud back to earth
Grace Jansen
 
PPTX
Javaland_JITServerTalk.pptx
Grace Jansen
 
PPTX
JavaLand_To InstantOn and Beyond.pptx
Grace Jansen
 
PPTX
Jfokus_Bringing the cloud back down to earth.pptx
Grace Jansen
 
PPTX
FooConf23_Bringing the cloud back down to earth.pptx
Grace Jansen
 
PPTX
DevoxxBelgium_StatefulCloud.pptx
Grace Jansen
 
PPTX
UtrechtJUG_Exploring statefulmicroservices in a cloud-native world.pptx
Grace Jansen
 
PPTX
JCON_15FactorWorkshop.pptx
Grace Jansen
 
PPTX
JCON_Adressing the transaction challenge in a cloud-native world.pptx
Grace Jansen
 
PPTX
JavaZone_Addressing the transaction challenge in a cloud-native world.pptx
Grace Jansen
 
PPTX
JavaZone_Mother Nature vs Java – the security face off.pptx
Grace Jansen
 
PPTX
Boost developer productivity with EE, MP and OL (Devoxx Ukraine 22).pptx
Grace Jansen
 
PPTX
Addressing the transaction challenge in a cloud-native world Devoxx Ukraine 2022
Grace Jansen
 
PPTX
JBCNConf_Addressing_The_Transaction_Challenge_LRA.pptx
Grace Jansen
 
PDF
2022-Devnexus-StatefulMicroservices.pptx.pdf
Grace Jansen
 
PPTX
How to become a superhero without even leaving your desk!
Grace Jansen
 
JPrime_JITServer.pptx
Grace Jansen
 
SwissJUG_15_factor_app.pptx
Grace Jansen
 
SwissJUG_Bringing the cloud back down to earth.pptx
Grace Jansen
 
ThroughTheLookingGlass_EffectiveObservability.pptx
Grace Jansen
 
PittsburgJUG_Cloud-Native Dev Tools: Bringing the cloud back to earth
Grace Jansen
 
Javaland_JITServerTalk.pptx
Grace Jansen
 
JavaLand_To InstantOn and Beyond.pptx
Grace Jansen
 
Jfokus_Bringing the cloud back down to earth.pptx
Grace Jansen
 
FooConf23_Bringing the cloud back down to earth.pptx
Grace Jansen
 
DevoxxBelgium_StatefulCloud.pptx
Grace Jansen
 
UtrechtJUG_Exploring statefulmicroservices in a cloud-native world.pptx
Grace Jansen
 
JCON_15FactorWorkshop.pptx
Grace Jansen
 
JCON_Adressing the transaction challenge in a cloud-native world.pptx
Grace Jansen
 
JavaZone_Addressing the transaction challenge in a cloud-native world.pptx
Grace Jansen
 
JavaZone_Mother Nature vs Java – the security face off.pptx
Grace Jansen
 
Boost developer productivity with EE, MP and OL (Devoxx Ukraine 22).pptx
Grace Jansen
 
Addressing the transaction challenge in a cloud-native world Devoxx Ukraine 2022
Grace Jansen
 
JBCNConf_Addressing_The_Transaction_Challenge_LRA.pptx
Grace Jansen
 
2022-Devnexus-StatefulMicroservices.pptx.pdf
Grace Jansen
 
How to become a superhero without even leaving your desk!
Grace Jansen
 

Recently uploaded (20)

PPTX
hospital managemt ,san.dckldnklcdnkdnkdnjadnjdjn
khushisoniwer2
 
PPTX
4Seller: The All-in-One Multi-Channel E-Commerce Management Platform for Glob...
4Seller Multi-channel Ecommerce Tool
 
PDF
Sun and Bloombase Spitfire StoreSafe End-to-end Storage Security Solution
Bloombase
 
PPTX
CNN LeNet5 Architecture: Neural Networks
DrRPonnusamyCIT
 
PPTX
Presentation by Samna Perveen And Subhan Afzal.pptx
AbdullahShahbaz13
 
PDF
Workplace Software and Skills - OpenStax
tranviettoan19672001
 
PDF
The Dynamic Duo Transforming Financial Accounting Systems Through Modern Expe...
Triforce Global
 
DOC
UTEP毕业证学历认证,宾夕法尼亚克拉里恩大学毕业证未毕业
oqwcyqe
 
PPTX
Lecture 5 Software Requirement Engineering
Huda Nasir
 
PPTX
DevOpsDays Halifax 2025 - Building 10x Organizations Using Modern Productivit...
Justin Reock
 
PPTX
Computer Software - Technology and Livelihood Education
ShielaGuevarra6
 
PPTX
Python is a high-level, interpreted programming language
kesavansa2002
 
PPTX
Chapter 1 - Transaction Processing and Mgt.pptx
LeulPrince
 
PPTX
MLforCyber_MLDataSetsandFeatures_Presentation.pptx
AaryaNaik8
 
PDF
Visual explanation of Dijkstra's Algorithm using Python
Jhoveran Cuno
 
PPTX
HackYourBrain__UtrechtJUG__11092025.pptx
SimonedeGijt
 
PDF
Guide to Food Delivery App Development.pdf
Lilac infotech
 
PDF
Type Class Derivation in Scala 3 - Jose Luis Pintado Barbero
José Luis Pintado Barbero
 
PPTX
Matchmaking for JVMs: How to Pick the Perfect GC Partner
Tier1 app
 
PPTX
Cybersecurity-and-Fraud-Protecting-Your-Digital-Life.pptx
balaji9945191
 
hospital managemt ,san.dckldnklcdnkdnkdnjadnjdjn
khushisoniwer2
 
4Seller: The All-in-One Multi-Channel E-Commerce Management Platform for Glob...
4Seller Multi-channel Ecommerce Tool
 
Sun and Bloombase Spitfire StoreSafe End-to-end Storage Security Solution
Bloombase
 
CNN LeNet5 Architecture: Neural Networks
DrRPonnusamyCIT
 
Presentation by Samna Perveen And Subhan Afzal.pptx
AbdullahShahbaz13
 
Workplace Software and Skills - OpenStax
tranviettoan19672001
 
The Dynamic Duo Transforming Financial Accounting Systems Through Modern Expe...
Triforce Global
 
UTEP毕业证学历认证,宾夕法尼亚克拉里恩大学毕业证未毕业
oqwcyqe
 
Lecture 5 Software Requirement Engineering
Huda Nasir
 
DevOpsDays Halifax 2025 - Building 10x Organizations Using Modern Productivit...
Justin Reock
 
Computer Software - Technology and Livelihood Education
ShielaGuevarra6
 
Python is a high-level, interpreted programming language
kesavansa2002
 
Chapter 1 - Transaction Processing and Mgt.pptx
LeulPrince
 
MLforCyber_MLDataSetsandFeatures_Presentation.pptx
AaryaNaik8
 
Visual explanation of Dijkstra's Algorithm using Python
Jhoveran Cuno
 
HackYourBrain__UtrechtJUG__11092025.pptx
SimonedeGijt
 
Guide to Food Delivery App Development.pdf
Lilac infotech
 
Type Class Derivation in Scala 3 - Jose Luis Pintado Barbero
José Luis Pintado Barbero
 
Matchmaking for JVMs: How to Pick the Perfect GC Partner
Tier1 app
 
Cybersecurity-and-Fraud-Protecting-Your-Digital-Life.pptx
balaji9945191
 

JavaBin: Reacting to an event driven world

  • 1. Reacting to an Event- Driven World Grace Jansen IBM Developer Advocate @gracejansen27 © 2021 IBM Corporation Kate Stanley IBM Software Engineer @katestanley91
  • 2. Let’s get some coffee… © 2020 IBM Corporation
  • 3. Barista Example: © 2020 IBM Corporation Coffee Shop Barista Coffee Lovers HTTP HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo
  • 4. Event Driven Architecture © 2020 IBM Corporation S1 S3 S2 S4 Event-driven messaging backbone Microservice publishing events Microservice consuming events Event-driven messaging backbone http://ibm.biz/AdvantagesOfEDA
  • 5. Barista Example: © 2020 IBM Corporation Coffee Shop Coffee Shop Barista Barista Board Coffee Lovers Coffee Lovers HTTP Orders, Queue HTTP HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo Event Backbone
  • 6. © 2020 IBM Corporation Apache Kafka is an open source, distributed streaming platform Stream history Immutable data Highly available Scalable Scalable consumption
  • 7. © 2020 IBM Corporation Q: Is your coffee shop non-blocking and highly responsive?
  • 8. © 2020 IBM Corporation Q: Is your microservice system non- blocking and highly responsive?
  • 9. © 2020 IBM Corporation Q: Is your microservice system non- blocking and highly responsive? A:Yes I’m using Kafka!
  • 10. © 2020 IBM Corporation Q: Is your microservice system non- blocking and highly responsive? A:Yes I’m using Kafka!
  • 11. Reactive systems © 2020 IBM Corporation
  • 12. Reactive Manifesto © 2020 IBM Corporation
  • 14. Events “A signal emitted by a component upon reaching a given state.” © 2020 IBM Corporation A message can contain an encoded event in its payload. Messages “An item of data sent to a specific location.”
  • 15. © 2020 IBM Corporation Apache Kafka is an open source, distributed streaming platform Publish and subscribe to streams of records Store records in durable way Process streams of records as they occur
  • 16. Barista Example: © 2020 IBM Corporation Coffee Shop Barista Board Coffee Lovers Orders, Queue HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo Event Backbone
  • 17. Barista Example: © 2020 IBM Corporation Coffee Shop Barista Board Coffee Lovers Orders, Queue HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo Event Backbone
  • 18. Barista Example: © 2020 IBM Corporation Coffee Shop Barista Board Coffee Lovers Orders, Queue HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo Event Backbone
  • 20. Barista Example: © 2020 IBM Corporation Coffee Shop Barista Board Coffee Lovers Orders, Queue HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo Event Backbone
  • 21. Barista Example: © 2020 IBM Corporation Coffee Shop Barista Board Coffee Lovers Orders, Queue HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo Event Backbone
  • 22. Barista Example: © 2020 IBM Corporation Coffee Shop Barista Board Coffee Lovers Orders, Queue HTTP https://github.com/cescoffier/quarkus-coffeeshop-demo Event Backbone
  • 27. How do we make a highly responsive app? Microservice 1 © 2020 IBM Corporation Microservice 2 Microservice 3
  • 28. How do we make a highly responsive app? Microservice 1 © 2020 IBM Corporation Microservice 2 Microservice 3 Reactive Architecture Patterns
  • 29. Reactive Architecture design patterns CQRS Circuit breaker Saga Back pressure © 2020 IBM Corporation APP WRITE API APP READ API APP APP APP APP APP APP APP APP
  • 30. How do we make a highly responsive app? Microservice 1 © 2020 IBM Corporation Microservice 2 Microservice 3 Futures Reactive Streams Libraries Futures Reactive Streams Libraries Futures Reactive Streams Libraries Reactive Programming
  • 31. Reactive Programming © 2020 IBM Corporation A subset of asynchronous programming and a paradigm where the availability of new information drives the logic forward rather than having control flow driven by a thread-of-execution.
  • 32. Reactive Programming Patterns © 2020 IBM Corporation Futures: a promise to hold the result of some operation once that operation completes Reactive programming libraries: for composing asynchronous and event-based programs. (e.g. RxJava, SmallRye Mutiny) Reactive Streams: a programming concept for handling asynchronous data streams in a non-blocking manner while providing backpressure to stream publishers
  • 33. Utilising Kafka in reactive systems © 2020 IBM Corporation
  • 36. Message Retention and Data Persistence © 2020 IBM Corporation Stream history Immutable Data
  • 37. Resilient Kafka Clusters © 2020 IBM Corporation
  • 38. © 2020 IBM Corporation Resilient Kafka Clusters
  • 39. Resilient Kafka Clusters © 2021 IBM Corporation
  • 40. Topic A Partition 1 Broker 1 Topic A Partition 1 Offline Leader Resilient Kafka Clusters © 2021 IBM Corporation
  • 41. Resilient Producers Delivery guarantees: At most once At least once Configuration: Acks Retries © 2021 IBM Corporation
  • 42. Resilient Consumers 0 1 2 3 4 5 Offset © 2021 IBM Corporation
  • 43. Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte
  • 44. Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Coffee
  • 45. Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Coffee
  • 46. Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte
  • 47. Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Cappuccino
  • 48. Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Cappuccino Latte
  • 49. Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Cappuccino Latte Baristas with manual commit Coffee Cappuccino Latte TOPIC Barista
  • 50. Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Cappuccino Latte Baristas with manual commit Coffee Cappuccino Latte TOPIC Barista Coffee
  • 51. Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Cappuccino Latte Baristas with manual commit Coffee Cappuccino Latte TOPIC Barista Coffee
  • 52. Baristas with auto commit Barista TOPIC Coffee Cappuccino Latte Cappuccino Latte Baristas with manual commit Coffee Cappuccino Latte TOPIC Barista Coffee Latte Cappuccino
  • 53. Schemas and Schema Registries © 2020 IBM Corporation
  • 55. Scalability in Kafka © 2021 IBM Corporation
  • 56. Elasticity in Consumers © 2021 IBM Corporation
  • 57. Consumer Groups Consumer groupA Topic 0 1 2 3 0 1 2 3 4 5 Partition 0 Partition 1 Partition 2 0 1 2 3 4 5 6 7 Consumer Consumer Consumer Consumer group B Consumer Consumer © 2021 IBM Corporation
  • 58. Consumer Groups Consumer groupA p0, offset 7 p1, offset 3 p2, offset 5 Topic 0 1 2 3 0 1 2 3 4 5 Partition 0 Partition 1 Partition 2 0 1 2 3 4 5 6 7 Consumer Consumer Consumer Consumer group B Consumer Consumer © 2021 IBM Corporation
  • 59. Consumer Groups Consumer groupA p0, offset 7 p1, offset 3 p2, offset 5 Topic 0 1 2 3 0 1 2 3 4 5 Partition 0 Partition 1 Partition 2 0 1 2 3 4 5 6 7 Consumer Consumer Consumer Consumer group B p0, offset 7 p1, offset 3 p2, offset 5 Consumer Consumer © 2021 IBM Corporation
  • 60. Consumer Groups Consumer groupA p0, offset 7 p1, offset 3 p2, offset 5 Topic 0 1 2 3 0 1 2 3 4 5 Partition 0 Partition 1 Partition 2 0 1 2 3 4 5 6 7 Consumer Consumer Consumer Consumer Consumer group B p0, offset 7 p1, offset 3 p2, offset 5 Consumer Consumer © 2021 IBM Corporation
  • 62. © 2021 IBM Corporation
  • 63. Reactive Frameworks for Kafka Alpakka Kafka Connector MicroProfile Reactive Messaging Vert.x Kafka Client © 2021 IBM Corporation
  • 64. Alpakka Kafka Connector API © 2021 IBM Corporation
  • 65. Eclipse MicroProfile An open-source community specification for Enterprise Java microservices A community of: individuals organizations vendors © 2021 IBM Corporation
  • 66. MicroProfile 3.3 Stack Reactive Streams Operators 1.1 GraphQL 1.0 Standalone Projects JSON-B 1.0 JSON-P 1.1 CDI 2.0 Config 1.4 Fault Tolerance 2.1 JWT Propagation 1.1 Health Check 2.2 Metrics 2.3 OpenTracing 1.3 Open API 1.1 JAX-RS 2.1 Rest Client 1.4 Reactive Messaging 1.0 Context Propagation 1.0 Reactive Streams Not a MicroProfile spec © 2021 IBM Corporation
  • 67. MicroProfile Reactive Messaging Application’s beans contain methods annotated with @Incoming and @Outgoing annotations The annotated methods are connected by named channels A channel is a name indicating which source or destination of messages is used. Channels are opaque Strings. @Incoming and @Outgoing annotations are matched up by channel names © 2021 IBM Corporation
  • 68. What is Eclipse Vert.x? Polyglot Tool-kit Based on Reactor pattern Runs on the JVM Non-blocking Event-driven Includes distributed event-bus Code is single-threaded © 2021 IBM Corporation
  • 69. Vert.x Demo App © 2020 IBM Corporation
  • 70. Demo app © 2021 IBM Corporation https://github.com/ibm-messaging/kafka-java-vertx-starter Vert.x app produce consume
  • 71. Demo app © 2021 IBM Corporation Vert.x app websocket produce consume https://github.com/ibm-messaging/kafka-java-vertx-starter
  • 72. © 2021 IBM Corporation https://github.com/ibm-messaging/kafka-java-vertx-starter
  • 73. © 2021 IBM Corporation
  • 74. Producing Records © 2021 IBM Corporation Vert.x app websocket produce Start Stop
  • 75. Producing Records © 2021 IBM Corporation
  • 76. Consuming and Processing Records © 2021 IBM Corporation Apache Kafka Java Client:
  • 77. © 2021 IBM Corporation Consuming and Processing Records Apache Kafka Java Client:
  • 78. © 2021 IBM Corporation Consuming and Processing Records Apache Kafka Java Client:
  • 79. © 2021 IBM Corporation Consuming and Processing Records Vert.x Kafka Client
  • 80. © 2021 IBM Corporation Consuming and Processing Records Vert.x Kafka Client
  • 81. © 2021 IBM Corporation Flow Control Vert.x Kafka Client
  • 82. © 2021 IBM Corporation ibm.biz/ExperiencesWritingAReactiveKafkaApp
  • 83. Summary Non-reactive + Kafka != reactive Consider Kafka configuration for the best reactive system The open-source reactive community is on hand to help! Reactive toolkits and frameworks can provide additional benefits © 2021 IBM Corporation
  • 84. Reactive Systems Explained © 2021 IBM Corporation ibm.biz/ReactiveReport
  • 86. Thank you Grace Jansen | @gracejansen27 Kate Stanley | @katestanley91 © 2021 IBM Corporation Reactive resources: https://ibm.biz/IntroToReactive https://ibm.biz/GettingStartedWithReactive Getting started with Kafka: https://kafka.apache.org/quickstart https://strimzi.io https://ibm.github.io/event-streams/schemas/overview/ Reactive Kafka libraries https://vertx.io/docs/vertx-kafka-client/java/ https://github.com/eclipse/microprofile-reactive- messaging https://projectreactor.io/docs/kafka https://github.com/akka/alpakka-kafka Open Liberty: https://openliberty.io