SlideShare a Scribd company logo
2
Most read
4
Most read
6
Most read
AEM – Binary less Replication
Exploring binary less replication, its use cases & some special cases
Ashokkumar T A | 17-Jan-2020
Binary less replication
Binaries left out from the content being replicated
• For assets, only its metadata gets replicated (usually)
• Have shared datastore between author & all publish instances, so that binaries are accessible to publish
instances
• Can be leveraged if the architecture mandates having a shared datastore
2
How it works?
• Replication package created with hashcode references instead of the actual binary
• Receiver resolve hashcode references to the binary in its datastore
• Hashcode references resolve on the receiver as both sender and receiver share a common datastore
• If receiver not able to resolve, falls back on the default replication approach to get binaries replicated
• Overall replication could still be successful even when binary less replication fails
3
Log statements with “FAILED PATHS START”, “FAILED PATHS END” denotes failure &
log statements with “set using a reference” denotes success of binary less replication
Use cases
Useful in setups using shared datastore across instances
• All AEM instances (Author & all publishers) share common datastore
• Keeping your Author separate, but all publishers share common datastore
• Multiple data centers – Instances in each data center sharing common datastore
• DR instances completely isolated from Primary environment
4
Special Case
Author has a separate datastore and all publish
instances share a common datastore
5
1. Designate one publish instance as a Gateway instance
2. Default replication to this gateway publish instance
3. Chain replicate from Gateway instance to all other
publish instances
4. This ensures the binaries are replicated to shared
datastore through the gateway instance before binary
less replication kicks in
Replication through gateway instance
Replication flow through a designated Gateway instance
6
Gateway instance approach can be used in any scenario where an isolated set of instance share a
common datastore (Multiple data centers, DR environments, …)
Limitations
Some of the limitation in using Gateway instance to use binary less replication
• Introduces a delay as replication is now a 2 step process
• New content visible on gateway instance before other publishers – Keep gateway instance internal (only for
replication and not for serving live traffic) if possible
• Replication status on author goes green as soon as replication to gateway instance is successful
• Be ready to handle gateway instance failures (make another instance as gateway)
7
Final word
Binary less is very useful when your architecture involves multiple instances sharing a
common datastore…
• Understand the holistic picture of your configuration (Data centers, DR approach, …) and plan replication
configuration as appropriate
• The gateway instance approach handles most if not all of the scenarios… But there are limitations. Validate
the limitations and plan remedies if using this approach
8
More details at
https://aem-musings.blogspot.com/2019/06/applying-binary-less-replication.html
Thank You
9
Feedback and suggestions welcome. Please write to
ashokkumar.ta@gmail.com

More Related Content

What's hot (20)

PDF
CEHv9 : module 06 - malware threats
teknetir
 
PDF
Nginx cheat sheet
Lam Hoang
 
PPTX
Ssrf
Ilan Mindel
 
PPTX
Containers and workload security an overview
Krishna-Kumar
 
PPTX
WAF Bypass Techniques - Using HTTP Standard and Web Servers’ Behaviour
Soroush Dalili
 
PDF
Apache Kafka Architecture & Fundamentals Explained
confluent
 
PDF
Multi cluster management with rancher
Kyohei Mizumoto
 
PPTX
Docker Networking Overview
Sreenivas Makam
 
PDF
A Hacker's perspective on AEM applications security
Mikhail Egorov
 
PDF
Hadoop Workshop using Cloudera on Amazon EC2
IMC Institute
 
PDF
AEM hacker - approaching Adobe Experience Manager webapps in bug bounty programs
Mikhail Egorov
 
PDF
A story of the passive aggressive sysadmin of AEM
Frans Rosén
 
PDF
Kafka: All an engineer needs to know
Thao Huynh Quang
 
PDF
Vorontsov, golovko ssrf attacks and sockets. smorgasbord of vulnerabilities
DefconRussia
 
PPT
Same origin policy
Vivek Madurai
 
PDF
Introduction to Vault
Knoldus Inc.
 
PDF
Hashicorp Vault Associate Certification Concepts Part 2
Adnan Rashid
 
PDF
helm 입문
choi sungwook
 
PPTX
"Certified Kubernetes Administrator Exam – how it was" by Andrii Fedenishin
Katherine Golovinova
 
PDF
Mikhail Egorov - Hunting for bugs in Adobe Experience Manager webapps
hacktivity
 
CEHv9 : module 06 - malware threats
teknetir
 
Nginx cheat sheet
Lam Hoang
 
Containers and workload security an overview
Krishna-Kumar
 
WAF Bypass Techniques - Using HTTP Standard and Web Servers’ Behaviour
Soroush Dalili
 
Apache Kafka Architecture & Fundamentals Explained
confluent
 
Multi cluster management with rancher
Kyohei Mizumoto
 
Docker Networking Overview
Sreenivas Makam
 
A Hacker's perspective on AEM applications security
Mikhail Egorov
 
Hadoop Workshop using Cloudera on Amazon EC2
IMC Institute
 
AEM hacker - approaching Adobe Experience Manager webapps in bug bounty programs
Mikhail Egorov
 
A story of the passive aggressive sysadmin of AEM
Frans Rosén
 
Kafka: All an engineer needs to know
Thao Huynh Quang
 
Vorontsov, golovko ssrf attacks and sockets. smorgasbord of vulnerabilities
DefconRussia
 
Same origin policy
Vivek Madurai
 
Introduction to Vault
Knoldus Inc.
 
Hashicorp Vault Associate Certification Concepts Part 2
Adnan Rashid
 
helm 입문
choi sungwook
 
"Certified Kubernetes Administrator Exam – how it was" by Andrii Fedenishin
Katherine Golovinova
 
Mikhail Egorov - Hunting for bugs in Adobe Experience Manager webapps
hacktivity
 

More from Ashokkumar T A (18)

PDF
A quick introduction to Strapi CMS
Ashokkumar T A
 
PDF
A quick introduction to GraphQL
Ashokkumar T A
 
PDF
Cloud trends - 2020
Ashokkumar T A
 
PDF
Microservices trends - 2020
Ashokkumar T A
 
PDF
Upgrading or migrating to a higher AEM version - Planning and process
Ashokkumar T A
 
PDF
Aligning to AEMs Release Cycle
Ashokkumar T A
 
PDF
Designing for search in AEM
Ashokkumar T A
 
PDF
AEM - A Collection of developer friendly tools
Ashokkumar T A
 
PDF
On MQ Series & JMS
Ashokkumar T A
 
PDF
Aem offline content
Ashokkumar T A
 
PDF
Reactive applications
Ashokkumar T A
 
PDF
Redis overview
Ashokkumar T A
 
PDF
Apache shiro security framework
Ashokkumar T A
 
PDF
Web analytics an intro
Ashokkumar T A
 
PDF
The six key steps to AEM architecture
Ashokkumar T A
 
PDF
Cms product evaluation
Ashokkumar T A
 
PDF
Aem maintenance
Ashokkumar T A
 
PDF
Aem dispatcher – tips & tricks
Ashokkumar T A
 
A quick introduction to Strapi CMS
Ashokkumar T A
 
A quick introduction to GraphQL
Ashokkumar T A
 
Cloud trends - 2020
Ashokkumar T A
 
Microservices trends - 2020
Ashokkumar T A
 
Upgrading or migrating to a higher AEM version - Planning and process
Ashokkumar T A
 
Aligning to AEMs Release Cycle
Ashokkumar T A
 
Designing for search in AEM
Ashokkumar T A
 
AEM - A Collection of developer friendly tools
Ashokkumar T A
 
On MQ Series & JMS
Ashokkumar T A
 
Aem offline content
Ashokkumar T A
 
Reactive applications
Ashokkumar T A
 
Redis overview
Ashokkumar T A
 
Apache shiro security framework
Ashokkumar T A
 
Web analytics an intro
Ashokkumar T A
 
The six key steps to AEM architecture
Ashokkumar T A
 
Cms product evaluation
Ashokkumar T A
 
Aem maintenance
Ashokkumar T A
 
Aem dispatcher – tips & tricks
Ashokkumar T A
 
Ad

Recently uploaded (20)

PDF
Open Chain Q2 Steering Committee Meeting - 2025-06-25
Shane Coughlan
 
PDF
Top Agile Project Management Tools for Teams in 2025
Orangescrum
 
PDF
4K Video Downloader Plus Pro Crack for MacOS New Download 2025
bashirkhan333g
 
PPTX
Empowering Asian Contributions: The Rise of Regional User Groups in Open Sour...
Shane Coughlan
 
PPTX
Change Common Properties in IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
PDF
유니티에서 Burst Compiler+ThreadedJobs+SIMD 적용사례
Seongdae Kim
 
PDF
MiniTool Power Data Recovery 8.8 With Crack New Latest 2025
bashirkhan333g
 
PDF
Technical-Careers-Roadmap-in-Software-Market.pdf
Hussein Ali
 
PDF
AI + DevOps = Smart Automation with devseccops.ai.pdf
Devseccops.ai
 
PPTX
OpenChain @ OSS NA - In From the Cold: Open Source as Part of Mainstream Soft...
Shane Coughlan
 
PPTX
Finding Your License Details in IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
PPTX
Customise Your Correlation Table in IBM SPSS Statistics.pptx
Version 1 Analytics
 
PDF
Empower Your Tech Vision- Why Businesses Prefer to Hire Remote Developers fro...
logixshapers59
 
PPTX
Comprehensive Risk Assessment Module for Smarter Risk Management
EHA Soft Solutions
 
PPTX
Home Care Tools: Benefits, features and more
Third Rock Techkno
 
PDF
SAP Firmaya İade ABAB Kodları - ABAB ile yazılmıl hazır kod örneği
Salih Küçük
 
PDF
SciPy 2025 - Packaging a Scientific Python Project
Henry Schreiner
 
PDF
Generic or Specific? Making sensible software design decisions
Bert Jan Schrijver
 
PPTX
ChiSquare Procedure in IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
PDF
Driver Easy Pro 6.1.1 Crack Licensce key 2025 FREE
utfefguu
 
Open Chain Q2 Steering Committee Meeting - 2025-06-25
Shane Coughlan
 
Top Agile Project Management Tools for Teams in 2025
Orangescrum
 
4K Video Downloader Plus Pro Crack for MacOS New Download 2025
bashirkhan333g
 
Empowering Asian Contributions: The Rise of Regional User Groups in Open Sour...
Shane Coughlan
 
Change Common Properties in IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
유니티에서 Burst Compiler+ThreadedJobs+SIMD 적용사례
Seongdae Kim
 
MiniTool Power Data Recovery 8.8 With Crack New Latest 2025
bashirkhan333g
 
Technical-Careers-Roadmap-in-Software-Market.pdf
Hussein Ali
 
AI + DevOps = Smart Automation with devseccops.ai.pdf
Devseccops.ai
 
OpenChain @ OSS NA - In From the Cold: Open Source as Part of Mainstream Soft...
Shane Coughlan
 
Finding Your License Details in IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
Customise Your Correlation Table in IBM SPSS Statistics.pptx
Version 1 Analytics
 
Empower Your Tech Vision- Why Businesses Prefer to Hire Remote Developers fro...
logixshapers59
 
Comprehensive Risk Assessment Module for Smarter Risk Management
EHA Soft Solutions
 
Home Care Tools: Benefits, features and more
Third Rock Techkno
 
SAP Firmaya İade ABAB Kodları - ABAB ile yazılmıl hazır kod örneği
Salih Küçük
 
SciPy 2025 - Packaging a Scientific Python Project
Henry Schreiner
 
Generic or Specific? Making sensible software design decisions
Bert Jan Schrijver
 
ChiSquare Procedure in IBM SPSS Statistics Version 31.pptx
Version 1 Analytics
 
Driver Easy Pro 6.1.1 Crack Licensce key 2025 FREE
utfefguu
 
Ad

AEM - Binary less replication

  • 1. AEM – Binary less Replication Exploring binary less replication, its use cases & some special cases Ashokkumar T A | 17-Jan-2020
  • 2. Binary less replication Binaries left out from the content being replicated • For assets, only its metadata gets replicated (usually) • Have shared datastore between author & all publish instances, so that binaries are accessible to publish instances • Can be leveraged if the architecture mandates having a shared datastore 2
  • 3. How it works? • Replication package created with hashcode references instead of the actual binary • Receiver resolve hashcode references to the binary in its datastore • Hashcode references resolve on the receiver as both sender and receiver share a common datastore • If receiver not able to resolve, falls back on the default replication approach to get binaries replicated • Overall replication could still be successful even when binary less replication fails 3 Log statements with “FAILED PATHS START”, “FAILED PATHS END” denotes failure & log statements with “set using a reference” denotes success of binary less replication
  • 4. Use cases Useful in setups using shared datastore across instances • All AEM instances (Author & all publishers) share common datastore • Keeping your Author separate, but all publishers share common datastore • Multiple data centers – Instances in each data center sharing common datastore • DR instances completely isolated from Primary environment 4
  • 5. Special Case Author has a separate datastore and all publish instances share a common datastore 5 1. Designate one publish instance as a Gateway instance 2. Default replication to this gateway publish instance 3. Chain replicate from Gateway instance to all other publish instances 4. This ensures the binaries are replicated to shared datastore through the gateway instance before binary less replication kicks in
  • 6. Replication through gateway instance Replication flow through a designated Gateway instance 6 Gateway instance approach can be used in any scenario where an isolated set of instance share a common datastore (Multiple data centers, DR environments, …)
  • 7. Limitations Some of the limitation in using Gateway instance to use binary less replication • Introduces a delay as replication is now a 2 step process • New content visible on gateway instance before other publishers – Keep gateway instance internal (only for replication and not for serving live traffic) if possible • Replication status on author goes green as soon as replication to gateway instance is successful • Be ready to handle gateway instance failures (make another instance as gateway) 7
  • 8. Final word Binary less is very useful when your architecture involves multiple instances sharing a common datastore… • Understand the holistic picture of your configuration (Data centers, DR approach, …) and plan replication configuration as appropriate • The gateway instance approach handles most if not all of the scenarios… But there are limitations. Validate the limitations and plan remedies if using this approach 8 More details at https://aem-musings.blogspot.com/2019/06/applying-binary-less-replication.html
  • 9. Thank You 9 Feedback and suggestions welcome. Please write to [email protected]