SlideShare a Scribd company logo
Professional Open Source™




JBoss clustering solutions
Mircea Markus, JBoss R&D




                                                         1
Agenda
                              Professional Open Source




o Clustering terminology
o JBoss clustering backbone
  o JGroups
  oJBossCache
  oPojoCache
o The future – Infinispan
o Q&A




                                                         2
Clustering terminology
                                                                                       Professional Open Source

o Scalability
    o   I want to handle x times the number of concurrent requests than I can now
o High availability
    o   Services are accessible with reasonable (and predictable) response times at any time
    o E.g., 99.999 (5 Nines in Telco)
o Load balancing
    o   A way to obtain scalability and better performance by dispatching incoming requests to different
        servers
    o Session affinity (or stickiness)
    o Checking heart beat
o Failover
    o   Process can continue when it is re-directed to a “backup” node because the original one fails
    o What is the policy? Round-robin?
o Fault tolerance
    o   A service that guarantees strictly correct behavior despite system failure
    o Cost?




                                                                                                                  3
Load Balancing != Fault Tolerance
                                                              Professional Open Source


Load balancing is used for scalability, not for fault tolerance




                                                                                         4
Load Balancing != Fault Tolerance
                                                               Professional Open Source



Failover and state replication is used for fault tolerance




                                                    State Replication




                                                                                          5
Cost of Fault Tolerance
                                                                Professional Open Source


For fault tolerance, state must be available to the failover node
 – Shared persistent store
    • Caching is a problem; need cache invalidation
 – Replicated state

Synchronous vs. Asynchronous Replication
 – Reduced application responsiveness vs. chance that failover occurs
   before state arrives

Analyze the likelihood of failure
 – How much fault tolerance is needed?

Limit amount of replicated state
 – Entity data can be reconstructed
 – Consider keeping short term-conversational state on client
    • Form data from a wizard


                                                                                           6
JGroups
                                                 Professional Open Source


o Library for reliable multicasting
o Provides
   o Fragmentation
   o   Message retransmission
   o   Flow control
   o   Ordering
   o   Group membership, membership change notification
o LAN or WAN based
   o IP multicasting transport default for LAN
   o TCP transport default for WAN




                                                                            7
JBossCache
                                               Professional Open Source

 o Replicated in memory data repository
 o Either locally or cluster-wide
 o Support for eviction of unused elements
 o Cache loading/storing to disk to free up memory
 o Chaining caches, remote caches using
   TcpCacheLoader
 o Support for JTA transactions
 o Listeners and notifications
 o JMX manageability
 o Multiple locking schemes (MVCC recommanded)
 o JGroups as a network stack

                                                                          8
PojoCache
                                  Professional Open Source



 oExtension of core cache
 oOptimised for caching large and complex
  objects with relationships
 oObject relationships maintained, even
  after replication or persistence
 oFine-grained replication
 oMinimal API




                                                             9
Where is JBossCache used?
                                              Professional Open Source


o JBoss Application Server - Clustering HTTP and EJB
  sessions, JPA entities
o Hibernate - entity caching
o SEAM - caching JSF generated content
o JBoss Portal
o Lucene/Hibernate Search - cluster-wide indexes
o GridGain - data grid component to complement compute
  grid
o Coming soon:
   – Drools - clustering rules engines
   – Mobicents – VOIP SIP server clustering
o Many other open source and commercial projects



                                                                         10
Infinispan – the future
                                              Professional Open Source



o JBossCache is now in maintenance
o simple-to-use Map interface
o Replication
   o Total
   o Distribution/consistent hashing – virtually linear
     scalability
o Transaction support enhancement - XAResource
o Data eviction redesign
o JSR-107 compliant
o Benchmark to come!
  (CacheBenchmarkFramework)


                                                                         11
Infinispan - data persistence
                                    Professional Open Source



o Useful for
  o‘warm’ starts
  oSurvive server restarts
  oSwap data to disk to avoid OOM
o Several ‘CacheStore’ implementations
  oJDBC
  oFile system
  oAmazon S3
    (http://code.google.com/p/jclouds)
  oJDBM

                                                               12
Infinispan – datagrid platform
                                      Professional Open Source



o Data grid
   oUniform sea of memory
   oSpread over several servers
o Solution to database limitations
   oPhysical limitations
   oDB does not scale
o “memory is the new disk, disk is the new
  tape” - Tim Bray




                                                                 13
Infinispan – async API
                                                 Professional Open Source


o New API in Infinispan, major feature for 4.0




o Hybrid between sync and async calls




                                                                            14
New cool things to come!
                                  Professional Open Source



 omemcached server/clients, able to use
  from Python, Ruby, C++, C#
 oQuery API - do remote searches
 oMap/Reduce - pass the cache a Callable
  and have it execute wherever the data
  exists
 oJPA-style API. Easy migration from
  using a database to using the grid!
 oCheck it out here!
  http://www.jboss.org/infinispan


                                                             15

More Related Content

PPTX
High-Availability of YARN (MRv2)
Mário Almeida
 
PPTX
Jug Lugano - Scale over the limits
Davide Carnevali
 
PDF
Accelerating Ceph with iWARP RDMA over Ethernet - Brien Porter, Haodong Tang
Ceph Community
 
PPTX
Ceph Tech Talk -- Ceph Benchmarking Tool
Ceph Community
 
PDF
NVMe over Fabric
singh.gurjeet
 
PDF
Ceph on All Flash Storage -- Breaking Performance Barriers
Ceph Community
 
PDF
Ceph Day Shanghai - Recovery Erasure Coding and Cache Tiering
Ceph Community
 
PDF
Ceph on Intel: Intel Storage Components, Benchmarks, and Contributions
Colleen Corrice
 
High-Availability of YARN (MRv2)
Mário Almeida
 
Jug Lugano - Scale over the limits
Davide Carnevali
 
Accelerating Ceph with iWARP RDMA over Ethernet - Brien Porter, Haodong Tang
Ceph Community
 
Ceph Tech Talk -- Ceph Benchmarking Tool
Ceph Community
 
NVMe over Fabric
singh.gurjeet
 
Ceph on All Flash Storage -- Breaking Performance Barriers
Ceph Community
 
Ceph Day Shanghai - Recovery Erasure Coding and Cache Tiering
Ceph Community
 
Ceph on Intel: Intel Storage Components, Benchmarks, and Contributions
Colleen Corrice
 

Similar to "JBoss clustering solutions Mission Critical Enterprise" by Mircea Markus @ eLiberatica 2009 (20)

PDF
Lightweight Grids With Terracotta
PT.JUG
 
PDF
Voldemort Nosql
elliando dias
 
PPT
01 persistence and domain modeling
thirumuru2012
 
PDF
Petabyte scale on commodity infrastructure
elliando dias
 
PPTX
Virtualizing Latency Sensitive Workloads and vFabric GemFire
Carter Shanklin
 
PPTX
From cache to in-memory data grid. Introduction to Hazelcast.
Taras Matyashovsky
 
PDF
A memcached implementation in Java
elliando dias
 
PDF
Open source and standards - unleashing the potential for innovation of cloud ...
Ignacio M. Llorente
 
PDF
.org to .com: Going from Project to Product
Joshua L. Davis
 
PDF
Distributed Data processing in a Cloud
elliando dias
 
PDF
Using Distributed In-Memory Computing for Fast Data Analysis
ScaleOut Software
 
PDF
NetflixOSS Open House Lightning talks
Ruslan Meshenberg
 
PDF
Qcon
adityaagarwal
 
KEY
Infinispan, Data Grids, NoSQL, Cloud Storage and JSR 347
Manik Surtani
 
PDF
Using and Benchmarking Galera in different architectures (PLUK 2012)
Henrik Ingo
 
PPT
13 caching latest
thirumuru2012
 
PPS
OSOM - Open source catching solutions
Marcela Oniga
 
PPT
Breaking The Clustering Limits @ AlphaCSP JavaEdge 2007
Baruch Sadogursky
 
PDF
Top 6 Reasons to Use a Distributed Data Grid
ScaleOut Software
 
KEY
Infinspan: In-memory data grid meets NoSQL
Manik Surtani
 
Lightweight Grids With Terracotta
PT.JUG
 
Voldemort Nosql
elliando dias
 
01 persistence and domain modeling
thirumuru2012
 
Petabyte scale on commodity infrastructure
elliando dias
 
Virtualizing Latency Sensitive Workloads and vFabric GemFire
Carter Shanklin
 
From cache to in-memory data grid. Introduction to Hazelcast.
Taras Matyashovsky
 
A memcached implementation in Java
elliando dias
 
Open source and standards - unleashing the potential for innovation of cloud ...
Ignacio M. Llorente
 
.org to .com: Going from Project to Product
Joshua L. Davis
 
Distributed Data processing in a Cloud
elliando dias
 
Using Distributed In-Memory Computing for Fast Data Analysis
ScaleOut Software
 
NetflixOSS Open House Lightning talks
Ruslan Meshenberg
 
Infinispan, Data Grids, NoSQL, Cloud Storage and JSR 347
Manik Surtani
 
Using and Benchmarking Galera in different architectures (PLUK 2012)
Henrik Ingo
 
13 caching latest
thirumuru2012
 
OSOM - Open source catching solutions
Marcela Oniga
 
Breaking The Clustering Limits @ AlphaCSP JavaEdge 2007
Baruch Sadogursky
 
Top 6 Reasons to Use a Distributed Data Grid
ScaleOut Software
 
Infinspan: In-memory data grid meets NoSQL
Manik Surtani
 
Ad

More from eLiberatica (20)

PDF
"Understanding Free Software and Open Source Licensing" by Zak Greant @ eLibe...
eLiberatica
 
PDF
"Sun Open Source Universe" by Vassilis Boulogiorgos @ eLiberatica 2008
eLiberatica
 
PDF
"Komodo - Why we chose to make our product open source" by Shane Caraveo @ eL...
eLiberatica
 
PDF
"Dell and Open Source" by Serban Zirnovan @ eLiberatica 2008
eLiberatica
 
PDF
"SocrateOpen after two years" by Remus Cazacu @ eLiberatica 2008
eLiberatica
 
PDF
"Introducing Red Hat Training Center" by Radu Radulescu @ eLiberatica 2008
eLiberatica
 
PDF
"HP vision Governing the use of open source" by Martin Michlmayr @ eLiberatic...
eLiberatica
 
PDF
"Write the Future Open Standards Open Source OpenOffice" by Louis Suarez-Pott...
eLiberatica
 
PDF
"Open Source Software Middleware for The Internet of Things - Project ASPIRE"...
eLiberatica
 
PDF
"Introducing eConference" by Eugen Rotariu @ eLiberatica 2008
eLiberatica
 
PDF
"Mozilla Messaging and Thunderbird - why and how" by David Ascher @ eLiberati...
eLiberatica
 
PDF
"For the first time in Europe Digital ID providers and OpenID service for Rom...
eLiberatica
 
PDF
"Standing on the Shoulders of Giants" by Brian King @ eLiberatica 2008
eLiberatica
 
PDF
"Legal aspects related to a FLOSS based model business" by Bogdan Manolea @ e...
eLiberatica
 
PDF
"OSS in Public Administrations - A short Report from the European Level" by B...
eLiberatica
 
PDF
"BitDefender - What's Next" by Alexandru Balan @ eLiberatica 2008
eLiberatica
 
PDF
"The Future of Enterprise Content Management" by Aleksander Farstad @ eLibera...
eLiberatica
 
PDF
"Integrating Open Source into Your Business" by Adam Jollans @ eLiberatica 2008
eLiberatica
 
PDF
"Open Source at Microsoft" by Zoli Herczeg @ eLiberatica 2008
eLiberatica
 
PDF
"The Past Present and Future of the Mozilla Foundation" by Zak Greant @ eLibe...
eLiberatica
 
"Understanding Free Software and Open Source Licensing" by Zak Greant @ eLibe...
eLiberatica
 
"Sun Open Source Universe" by Vassilis Boulogiorgos @ eLiberatica 2008
eLiberatica
 
"Komodo - Why we chose to make our product open source" by Shane Caraveo @ eL...
eLiberatica
 
"Dell and Open Source" by Serban Zirnovan @ eLiberatica 2008
eLiberatica
 
"SocrateOpen after two years" by Remus Cazacu @ eLiberatica 2008
eLiberatica
 
"Introducing Red Hat Training Center" by Radu Radulescu @ eLiberatica 2008
eLiberatica
 
"HP vision Governing the use of open source" by Martin Michlmayr @ eLiberatic...
eLiberatica
 
"Write the Future Open Standards Open Source OpenOffice" by Louis Suarez-Pott...
eLiberatica
 
"Open Source Software Middleware for The Internet of Things - Project ASPIRE"...
eLiberatica
 
"Introducing eConference" by Eugen Rotariu @ eLiberatica 2008
eLiberatica
 
"Mozilla Messaging and Thunderbird - why and how" by David Ascher @ eLiberati...
eLiberatica
 
"For the first time in Europe Digital ID providers and OpenID service for Rom...
eLiberatica
 
"Standing on the Shoulders of Giants" by Brian King @ eLiberatica 2008
eLiberatica
 
"Legal aspects related to a FLOSS based model business" by Bogdan Manolea @ e...
eLiberatica
 
"OSS in Public Administrations - A short Report from the European Level" by B...
eLiberatica
 
"BitDefender - What's Next" by Alexandru Balan @ eLiberatica 2008
eLiberatica
 
"The Future of Enterprise Content Management" by Aleksander Farstad @ eLibera...
eLiberatica
 
"Integrating Open Source into Your Business" by Adam Jollans @ eLiberatica 2008
eLiberatica
 
"Open Source at Microsoft" by Zoli Herczeg @ eLiberatica 2008
eLiberatica
 
"The Past Present and Future of the Mozilla Foundation" by Zak Greant @ eLibe...
eLiberatica
 
Ad

Recently uploaded (20)

PDF
Software Development Company | KodekX
KodekX
 
PPTX
The-Ethical-Hackers-Imperative-Safeguarding-the-Digital-Frontier.pptx
sujalchauhan1305
 
PDF
Oracle AI Vector Search- Getting Started and what's new in 2025- AIOUG Yatra ...
Sandesh Rao
 
PDF
Software Development Methodologies in 2025
KodekX
 
PDF
NewMind AI Weekly Chronicles - July'25 - Week IV
NewMind AI
 
PPTX
OA presentation.pptx OA presentation.pptx
pateldhruv002338
 
PPTX
ChatGPT's Deck on The Enduring Legacy of Fax Machines
Greg Swan
 
PDF
This slide provides an overview Technology
mineshkharadi333
 
PDF
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
 
PDF
Tea4chat - another LLM Project by Kerem Atam
a0m0rajab1
 
PPTX
How to Build a Scalable Micro-Investing Platform in 2025 - A Founder’s Guide ...
Third Rock Techkno
 
PDF
A Day in the Life of Location Data - Turning Where into How.pdf
Precisely
 
PDF
Unlocking the Future- AI Agents Meet Oracle Database 23ai - AIOUG Yatra 2025.pdf
Sandesh Rao
 
PDF
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
PDF
Beyond Automation: The Role of IoT Sensor Integration in Next-Gen Industries
Rejig Digital
 
PDF
Using Anchore and DefectDojo to Stand Up Your DevSecOps Function
Anchore
 
PDF
Event Presentation Google Cloud Next Extended 2025
minhtrietgect
 
PPTX
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
PPTX
AI and Robotics for Human Well-being.pptx
JAYMIN SUTHAR
 
PDF
The Evolution of KM Roles (Presented at Knowledge Summit Dublin 2025)
Enterprise Knowledge
 
Software Development Company | KodekX
KodekX
 
The-Ethical-Hackers-Imperative-Safeguarding-the-Digital-Frontier.pptx
sujalchauhan1305
 
Oracle AI Vector Search- Getting Started and what's new in 2025- AIOUG Yatra ...
Sandesh Rao
 
Software Development Methodologies in 2025
KodekX
 
NewMind AI Weekly Chronicles - July'25 - Week IV
NewMind AI
 
OA presentation.pptx OA presentation.pptx
pateldhruv002338
 
ChatGPT's Deck on The Enduring Legacy of Fax Machines
Greg Swan
 
This slide provides an overview Technology
mineshkharadi333
 
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
 
Tea4chat - another LLM Project by Kerem Atam
a0m0rajab1
 
How to Build a Scalable Micro-Investing Platform in 2025 - A Founder’s Guide ...
Third Rock Techkno
 
A Day in the Life of Location Data - Turning Where into How.pdf
Precisely
 
Unlocking the Future- AI Agents Meet Oracle Database 23ai - AIOUG Yatra 2025.pdf
Sandesh Rao
 
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
Beyond Automation: The Role of IoT Sensor Integration in Next-Gen Industries
Rejig Digital
 
Using Anchore and DefectDojo to Stand Up Your DevSecOps Function
Anchore
 
Event Presentation Google Cloud Next Extended 2025
minhtrietgect
 
Applied-Statistics-Mastering-Data-Driven-Decisions.pptx
parmaryashparmaryash
 
AI and Robotics for Human Well-being.pptx
JAYMIN SUTHAR
 
The Evolution of KM Roles (Presented at Knowledge Summit Dublin 2025)
Enterprise Knowledge
 

"JBoss clustering solutions Mission Critical Enterprise" by Mircea Markus @ eLiberatica 2009

  • 1. Professional Open Source™ JBoss clustering solutions Mircea Markus, JBoss R&D 1
  • 2. Agenda Professional Open Source o Clustering terminology o JBoss clustering backbone o JGroups oJBossCache oPojoCache o The future – Infinispan o Q&A 2
  • 3. Clustering terminology Professional Open Source o Scalability o I want to handle x times the number of concurrent requests than I can now o High availability o Services are accessible with reasonable (and predictable) response times at any time o E.g., 99.999 (5 Nines in Telco) o Load balancing o A way to obtain scalability and better performance by dispatching incoming requests to different servers o Session affinity (or stickiness) o Checking heart beat o Failover o Process can continue when it is re-directed to a “backup” node because the original one fails o What is the policy? Round-robin? o Fault tolerance o A service that guarantees strictly correct behavior despite system failure o Cost? 3
  • 4. Load Balancing != Fault Tolerance Professional Open Source Load balancing is used for scalability, not for fault tolerance 4
  • 5. Load Balancing != Fault Tolerance Professional Open Source Failover and state replication is used for fault tolerance State Replication 5
  • 6. Cost of Fault Tolerance Professional Open Source For fault tolerance, state must be available to the failover node – Shared persistent store • Caching is a problem; need cache invalidation – Replicated state Synchronous vs. Asynchronous Replication – Reduced application responsiveness vs. chance that failover occurs before state arrives Analyze the likelihood of failure – How much fault tolerance is needed? Limit amount of replicated state – Entity data can be reconstructed – Consider keeping short term-conversational state on client • Form data from a wizard 6
  • 7. JGroups Professional Open Source o Library for reliable multicasting o Provides o Fragmentation o Message retransmission o Flow control o Ordering o Group membership, membership change notification o LAN or WAN based o IP multicasting transport default for LAN o TCP transport default for WAN 7
  • 8. JBossCache Professional Open Source o Replicated in memory data repository o Either locally or cluster-wide o Support for eviction of unused elements o Cache loading/storing to disk to free up memory o Chaining caches, remote caches using TcpCacheLoader o Support for JTA transactions o Listeners and notifications o JMX manageability o Multiple locking schemes (MVCC recommanded) o JGroups as a network stack 8
  • 9. PojoCache Professional Open Source oExtension of core cache oOptimised for caching large and complex objects with relationships oObject relationships maintained, even after replication or persistence oFine-grained replication oMinimal API 9
  • 10. Where is JBossCache used? Professional Open Source o JBoss Application Server - Clustering HTTP and EJB sessions, JPA entities o Hibernate - entity caching o SEAM - caching JSF generated content o JBoss Portal o Lucene/Hibernate Search - cluster-wide indexes o GridGain - data grid component to complement compute grid o Coming soon: – Drools - clustering rules engines – Mobicents – VOIP SIP server clustering o Many other open source and commercial projects 10
  • 11. Infinispan – the future Professional Open Source o JBossCache is now in maintenance o simple-to-use Map interface o Replication o Total o Distribution/consistent hashing – virtually linear scalability o Transaction support enhancement - XAResource o Data eviction redesign o JSR-107 compliant o Benchmark to come! (CacheBenchmarkFramework) 11
  • 12. Infinispan - data persistence Professional Open Source o Useful for o‘warm’ starts oSurvive server restarts oSwap data to disk to avoid OOM o Several ‘CacheStore’ implementations oJDBC oFile system oAmazon S3 (http://code.google.com/p/jclouds) oJDBM 12
  • 13. Infinispan – datagrid platform Professional Open Source o Data grid oUniform sea of memory oSpread over several servers o Solution to database limitations oPhysical limitations oDB does not scale o “memory is the new disk, disk is the new tape” - Tim Bray 13
  • 14. Infinispan – async API Professional Open Source o New API in Infinispan, major feature for 4.0 o Hybrid between sync and async calls 14
  • 15. New cool things to come! Professional Open Source omemcached server/clients, able to use from Python, Ruby, C++, C# oQuery API - do remote searches oMap/Reduce - pass the cache a Callable and have it execute wherever the data exists oJPA-style API. Easy migration from using a database to using the grid! oCheck it out here! http://www.jboss.org/infinispan 15