SlideShare a Scribd company logo
Managing
         PostgreSQL
         Replication



© 2ndQuadrant Limited 2010
Who Am I?
       • Simon Riggs
       • Major Developer on PostgreSQL project
       • CTO, 2ndQuadrant




© 2ndQuadrant Limited 2010
Replication Use Cases
       • High Availability   • Protection
                             • Total Cost of
       • Scalability             Ownership
                             • Exploiting success




© 2ndQuadrant Limited 2010
Replication Mechanisms
       • Trigger-based replication
                 – User space solution
       • Log-based replication
                 – Integrated development




© 2ndQuadrant Limited 2010
Log Shipping Developments
       • 8.0 – Point in Time Recovery, Full WAL info
       • 8.2 – Restartable Recovery, Log Switching,
               Streaming API
       • 8.3 – Full Page Optimization, pg_standby
       • 8.4 – BgWriter during Recovery
       • 9.0 – Streaming Replication
               Hot Standby



© 2ndQuadrant Limited 2010
Streaming Replication (9.0)
       •      Efficient real-time “log shipping”
       •      Master → Slave replication using full security
       •      Multiple concurrent slaves
       •      Robust bi-modal design




© 2ndQuadrant Limited 2010
WAL Sender




© 2ndQuadrant Limited 2010
WAL Receiver




© 2ndQuadrant Limited 2010
Hot Standby
       •      Read-only access while “in recovery”
       •      Equivalent of Oracle 11g Active Data Guard
       •      Load balanced read scalability
       •      Query off-load from main write node
       •      Multiple highly available standby nodes




© 2ndQuadrant Limited 2010
Capabilities
       •   High Performance
       •   Integrated
       •   Ease of Use
       •   Query Access
       •   Relay
       •   Selectivity
       •   Query Farm


© 2ndQuadrant Limited 2010
Capabilities with Tools
       •   High Performance
       •   Integrated
       •   Ease of Use
       •   Query Access
       •   Relay
       •   Selectivity
       •   Query Farm


© 2ndQuadrant Limited 2010
Repmgr




© 2ndQuadrant Limited 2010
Repmgr
       • Simplify standby management
       • Monitor replication delays
       • Provide feedback mechanisms




© 2ndQuadrant Limited 2010
Future: Sync Replication (9.1)
       •   User-controlled robustness
       •   High performance design
       •   Simplicity
       •   Additional flexibility through registration




© 2ndQuadrant Limited 2010
Future: Loose Coupling
       •   Allows distributed database
       •   High Availability and Disaster Recovery
       •   No shared resources – better scalability
       •   “Cellular” approach




© 2ndQuadrant Limited 2010
PostgreSQL Books

       • http://www.2ndQuadrant.com/books/




© 2ndQuadrant Limited 2010

More Related Content

What's hot (20)

ODP
Managing ceph through_oVirt_using_Cinder
Maor Lipchuk
 
PDF
Database experiences designing cassandra schema for keystone
openstackindia
 
PDF
Kubernetes for Enterprise DevOps
Jim Bugwadia
 
PPTX
Demistifying open stack storage
openstackindia
 
PDF
OpenNebula TechDay Boston 2015 - Hyperconvergence and OpenNebula
OpenNebula Project
 
PDF
Guts & OpenStack migration
openstackindia
 
PPTX
State of Linux Containers in OpenStack
openstackindia
 
PPTX
OpenStack Contribution Workflow
Sean McGinnis
 
PDF
SUSE Enterprise Storage
SUSE
 
PPTX
Windows Azure Pack: Containerized SQL Server Resource provider
Valio Bonev
 
PDF
Setting up a MySQL Docker Container
Victor S. Recio
 
PDF
OpenStack Boston Summit: Kuryr project updates
Antoni Segura Puimedon
 
PPTX
Introduction to OpenStack Cinder
Sean McGinnis
 
PDF
Carbon 5 : A Preview
Sameera Jayasoma
 
PPTX
Mysql 8 vs Mariadb 10.4 Webinar 2020 Feb
Alkin Tezuysal
 
PDF
Multiple Sites and Disaster Recovery with Ceph: Andrew Hatfield, Red Hat
OpenStack
 
PDF
Building Services with WSO2 Microservices framework for Java and WSO2 AS
Kasun Gajasinghe
 
PDF
Protecting the Galaxy - Multi-Region Disaster Recovery with OpenStack and Ceph
Sean Cohen
 
PDF
Open stack solidfire-mavenspire-meetup
Gene Dubensky
 
PDF
OpenStack Tokyo Meeup - Gluster Storage Day
Dan Radez
 
Managing ceph through_oVirt_using_Cinder
Maor Lipchuk
 
Database experiences designing cassandra schema for keystone
openstackindia
 
Kubernetes for Enterprise DevOps
Jim Bugwadia
 
Demistifying open stack storage
openstackindia
 
OpenNebula TechDay Boston 2015 - Hyperconvergence and OpenNebula
OpenNebula Project
 
Guts & OpenStack migration
openstackindia
 
State of Linux Containers in OpenStack
openstackindia
 
OpenStack Contribution Workflow
Sean McGinnis
 
SUSE Enterprise Storage
SUSE
 
Windows Azure Pack: Containerized SQL Server Resource provider
Valio Bonev
 
Setting up a MySQL Docker Container
Victor S. Recio
 
OpenStack Boston Summit: Kuryr project updates
Antoni Segura Puimedon
 
Introduction to OpenStack Cinder
Sean McGinnis
 
Carbon 5 : A Preview
Sameera Jayasoma
 
Mysql 8 vs Mariadb 10.4 Webinar 2020 Feb
Alkin Tezuysal
 
Multiple Sites and Disaster Recovery with Ceph: Andrew Hatfield, Red Hat
OpenStack
 
Building Services with WSO2 Microservices framework for Java and WSO2 AS
Kasun Gajasinghe
 
Protecting the Galaxy - Multi-Region Disaster Recovery with OpenStack and Ceph
Sean Cohen
 
Open stack solidfire-mavenspire-meetup
Gene Dubensky
 
OpenStack Tokyo Meeup - Gluster Storage Day
Dan Radez
 

Viewers also liked (8)

PDF
Big Data and PostgreSQL
PGConf APAC
 
PDF
Migration From Oracle to PostgreSQL
PGConf APAC
 
PDF
Lessons PostgreSQL learned from commercial databases, and didn’t
PGConf APAC
 
PDF
PostgreSQL WAL for DBAs
PGConf APAC
 
PDF
Use Case: PostGIS and Agribotics
PGConf APAC
 
PDF
How to teach an elephant to rock'n'roll
PGConf APAC
 
PDF
Why we love pgpool-II and why we hate it!
PGConf APAC
 
PDF
Query Parallelism in PostgreSQL: What's coming next?
PGConf APAC
 
Big Data and PostgreSQL
PGConf APAC
 
Migration From Oracle to PostgreSQL
PGConf APAC
 
Lessons PostgreSQL learned from commercial databases, and didn’t
PGConf APAC
 
PostgreSQL WAL for DBAs
PGConf APAC
 
Use Case: PostGIS and Agribotics
PGConf APAC
 
How to teach an elephant to rock'n'roll
PGConf APAC
 
Why we love pgpool-II and why we hate it!
PGConf APAC
 
Query Parallelism in PostgreSQL: What's coming next?
PGConf APAC
 
Ad

Similar to Managing replication of PostgreSQL (Simon Riggs) (20)

PDF
PoPostgreSQL Web Projects: From Start to FinishStart To Finish
elliando dias
 
PDF
Microservices Architectures with Docker Swarm, etcd, Kuryr and Neutron
Fawad Khaliq
 
PPTX
20191201 kubernetes managed weblogic revival - part 1
makker_nl
 
PDF
Self-Driving Storage and Applications Integration
MarketingArrowECS_CZ
 
PDF
Red Hat Storage - Introduction to GlusterFS
GlusterFS
 
PPTX
YARN Containerized Services: Fading The Lines Between On-Prem And Cloud
DataWorks Summit
 
PPTX
Kubernetes is all you need
Vishwas N
 
PDF
The Kubernetes WebLogic revival (part 1)
Simon Haslam
 
PDF
My sql 5.5_product_update
henriquesidney
 
PDF
Postgres & Red Hat Cluster Suite
EDB
 
PDF
VMworld 2013: Three Advantages of Running Cloud Foundry in a VMware Private C...
VMworld
 
PDF
Server Day 2009: Oracle/Bea Fusion Middleware by Paolo Ramasso
JUG Genova
 
PPTX
Kubernetes 101
Vishwas N
 
PPTX
Mysql ecosystem in 2019
Alkin Tezuysal
 
PDF
Building Tungsten Clusters with PostgreSQL Hot Standby and Streaming Replication
Linas Virbalas
 
PDF
Radical Innovations In Storage for Multi-Tenant Infrastructure
NetApp
 
PDF
Exploring the Hybrid Cloud by Jeff Malkin of Encoding.com
ETCenter
 
PDF
recent CF repositories
Ken Ojiri
 
PDF
IBM MQ High Availabillity and Disaster Recovery (2017 version)
MarkTaylorIBM
 
PDF
Harnessing the Power of Master/Slave Clusters to Operate Data-Driven Business...
Continuent
 
PoPostgreSQL Web Projects: From Start to FinishStart To Finish
elliando dias
 
Microservices Architectures with Docker Swarm, etcd, Kuryr and Neutron
Fawad Khaliq
 
20191201 kubernetes managed weblogic revival - part 1
makker_nl
 
Self-Driving Storage and Applications Integration
MarketingArrowECS_CZ
 
Red Hat Storage - Introduction to GlusterFS
GlusterFS
 
YARN Containerized Services: Fading The Lines Between On-Prem And Cloud
DataWorks Summit
 
Kubernetes is all you need
Vishwas N
 
The Kubernetes WebLogic revival (part 1)
Simon Haslam
 
My sql 5.5_product_update
henriquesidney
 
Postgres & Red Hat Cluster Suite
EDB
 
VMworld 2013: Three Advantages of Running Cloud Foundry in a VMware Private C...
VMworld
 
Server Day 2009: Oracle/Bea Fusion Middleware by Paolo Ramasso
JUG Genova
 
Kubernetes 101
Vishwas N
 
Mysql ecosystem in 2019
Alkin Tezuysal
 
Building Tungsten Clusters with PostgreSQL Hot Standby and Streaming Replication
Linas Virbalas
 
Radical Innovations In Storage for Multi-Tenant Infrastructure
NetApp
 
Exploring the Hybrid Cloud by Jeff Malkin of Encoding.com
ETCenter
 
recent CF repositories
Ken Ojiri
 
IBM MQ High Availabillity and Disaster Recovery (2017 version)
MarkTaylorIBM
 
Harnessing the Power of Master/Slave Clusters to Operate Data-Driven Business...
Continuent
 
Ad

More from Ontico (20)

PDF
One-cloud — система управления дата-центром в Одноклассниках / Олег Анастасье...
Ontico
 
PDF
Масштабируя DNS / Артем Гавриченков (Qrator Labs)
Ontico
 
PPTX
Создание BigData-платформы для ФГУП Почта России / Андрей Бащенко (Luxoft)
Ontico
 
PDF
Готовим тестовое окружение, или сколько тестовых инстансов вам нужно / Алекса...
Ontico
 
PDF
Новые технологии репликации данных в PostgreSQL / Александр Алексеев (Postgre...
Ontico
 
PDF
PostgreSQL Configuration for Humans / Alvaro Hernandez (OnGres)
Ontico
 
PDF
Inexpensive Datamasking for MySQL with ProxySQL — Data Anonymization for Deve...
Ontico
 
PDF
Опыт разработки модуля межсетевого экранирования для MySQL / Олег Брославский...
Ontico
 
PPTX
ProxySQL Use Case Scenarios / Alkin Tezuysal (Percona)
Ontico
 
PPTX
MySQL Replication — Advanced Features / Петр Зайцев (Percona)
Ontico
 
PDF
Внутренний open-source. Как разрабатывать мобильное приложение большим количе...
Ontico
 
PPTX
Подробно о том, как Causal Consistency реализовано в MongoDB / Михаил Тюленев...
Ontico
 
PPTX
Балансировка на скорости проводов. Без ASIC, без ограничений. Решения NFWare ...
Ontico
 
PDF
Перехват трафика — мифы и реальность / Евгений Усков (Qrator Labs)
Ontico
 
PPT
И тогда наверняка вдруг запляшут облака! / Алексей Сушков (ПЕТЕР-СЕРВИС)
Ontico
 
PPTX
Как мы заставили Druid работать в Одноклассниках / Юрий Невиницин (OK.RU)
Ontico
 
PPTX
Разгоняем ASP.NET Core / Илья Вербицкий (WebStoating s.r.o.)
Ontico
 
PPTX
100500 способов кэширования в Oracle Database или как достичь максимальной ск...
Ontico
 
PPTX
Apache Ignite Persistence: зачем Persistence для In-Memory, и как он работает...
Ontico
 
PDF
Механизмы мониторинга баз данных: взгляд изнутри / Дмитрий Еманов (Firebird P...
Ontico
 
One-cloud — система управления дата-центром в Одноклассниках / Олег Анастасье...
Ontico
 
Масштабируя DNS / Артем Гавриченков (Qrator Labs)
Ontico
 
Создание BigData-платформы для ФГУП Почта России / Андрей Бащенко (Luxoft)
Ontico
 
Готовим тестовое окружение, или сколько тестовых инстансов вам нужно / Алекса...
Ontico
 
Новые технологии репликации данных в PostgreSQL / Александр Алексеев (Postgre...
Ontico
 
PostgreSQL Configuration for Humans / Alvaro Hernandez (OnGres)
Ontico
 
Inexpensive Datamasking for MySQL with ProxySQL — Data Anonymization for Deve...
Ontico
 
Опыт разработки модуля межсетевого экранирования для MySQL / Олег Брославский...
Ontico
 
ProxySQL Use Case Scenarios / Alkin Tezuysal (Percona)
Ontico
 
MySQL Replication — Advanced Features / Петр Зайцев (Percona)
Ontico
 
Внутренний open-source. Как разрабатывать мобильное приложение большим количе...
Ontico
 
Подробно о том, как Causal Consistency реализовано в MongoDB / Михаил Тюленев...
Ontico
 
Балансировка на скорости проводов. Без ASIC, без ограничений. Решения NFWare ...
Ontico
 
Перехват трафика — мифы и реальность / Евгений Усков (Qrator Labs)
Ontico
 
И тогда наверняка вдруг запляшут облака! / Алексей Сушков (ПЕТЕР-СЕРВИС)
Ontico
 
Как мы заставили Druid работать в Одноклассниках / Юрий Невиницин (OK.RU)
Ontico
 
Разгоняем ASP.NET Core / Илья Вербицкий (WebStoating s.r.o.)
Ontico
 
100500 способов кэширования в Oracle Database или как достичь максимальной ск...
Ontico
 
Apache Ignite Persistence: зачем Persistence для In-Memory, и как он работает...
Ontico
 
Механизмы мониторинга баз данных: взгляд изнутри / Дмитрий Еманов (Firebird P...
Ontico
 

Recently uploaded (20)

PDF
Biography of Daniel Podor.pdf
Daniel Podor
 
PPTX
Q2 FY26 Tableau User Group Leader Quarterly Call
lward7
 
PDF
From Code to Challenge: Crafting Skill-Based Games That Engage and Reward
aiyshauae
 
PPTX
"Autonomy of LLM Agents: Current State and Future Prospects", Oles` Petriv
Fwdays
 
PDF
Mastering Financial Management in Direct Selling
Epixel MLM Software
 
PPTX
Building Search Using OpenSearch: Limitations and Workarounds
Sease
 
PDF
Empower Inclusion Through Accessible Java Applications
Ana-Maria Mihalceanu
 
PPTX
AUTOMATION AND ROBOTICS IN PHARMA INDUSTRY.pptx
sameeraaabegumm
 
PDF
Smart Trailers 2025 Update with History and Overview
Paul Menig
 
PDF
CIFDAQ Market Insights for July 7th 2025
CIFDAQ
 
PDF
"AI Transformation: Directions and Challenges", Pavlo Shaternik
Fwdays
 
PDF
CIFDAQ Market Wrap for the week of 4th July 2025
CIFDAQ
 
PDF
New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
PDF
The Rise of AI and IoT in Mobile App Tech.pdf
IMG Global Infotech
 
PDF
Agentic AI lifecycle for Enterprise Hyper-Automation
Debmalya Biswas
 
PDF
Blockchain Transactions Explained For Everyone
CIFDAQ
 
PDF
CIFDAQ Weekly Market Wrap for 11th July 2025
CIFDAQ
 
PPTX
AI Penetration Testing Essentials: A Cybersecurity Guide for 2025
defencerabbit Team
 
PDF
How Startups Are Growing Faster with App Developers in Australia.pdf
India App Developer
 
PDF
Newgen Beyond Frankenstein_Build vs Buy_Digital_version.pdf
darshakparmar
 
Biography of Daniel Podor.pdf
Daniel Podor
 
Q2 FY26 Tableau User Group Leader Quarterly Call
lward7
 
From Code to Challenge: Crafting Skill-Based Games That Engage and Reward
aiyshauae
 
"Autonomy of LLM Agents: Current State and Future Prospects", Oles` Petriv
Fwdays
 
Mastering Financial Management in Direct Selling
Epixel MLM Software
 
Building Search Using OpenSearch: Limitations and Workarounds
Sease
 
Empower Inclusion Through Accessible Java Applications
Ana-Maria Mihalceanu
 
AUTOMATION AND ROBOTICS IN PHARMA INDUSTRY.pptx
sameeraaabegumm
 
Smart Trailers 2025 Update with History and Overview
Paul Menig
 
CIFDAQ Market Insights for July 7th 2025
CIFDAQ
 
"AI Transformation: Directions and Challenges", Pavlo Shaternik
Fwdays
 
CIFDAQ Market Wrap for the week of 4th July 2025
CIFDAQ
 
New from BookNet Canada for 2025: BNC BiblioShare - Tech Forum 2025
BookNet Canada
 
The Rise of AI and IoT in Mobile App Tech.pdf
IMG Global Infotech
 
Agentic AI lifecycle for Enterprise Hyper-Automation
Debmalya Biswas
 
Blockchain Transactions Explained For Everyone
CIFDAQ
 
CIFDAQ Weekly Market Wrap for 11th July 2025
CIFDAQ
 
AI Penetration Testing Essentials: A Cybersecurity Guide for 2025
defencerabbit Team
 
How Startups Are Growing Faster with App Developers in Australia.pdf
India App Developer
 
Newgen Beyond Frankenstein_Build vs Buy_Digital_version.pdf
darshakparmar
 

Managing replication of PostgreSQL (Simon Riggs)

  • 1. Managing PostgreSQL Replication © 2ndQuadrant Limited 2010
  • 2. Who Am I? • Simon Riggs • Major Developer on PostgreSQL project • CTO, 2ndQuadrant © 2ndQuadrant Limited 2010
  • 3. Replication Use Cases • High Availability • Protection • Total Cost of • Scalability Ownership • Exploiting success © 2ndQuadrant Limited 2010
  • 4. Replication Mechanisms • Trigger-based replication – User space solution • Log-based replication – Integrated development © 2ndQuadrant Limited 2010
  • 5. Log Shipping Developments • 8.0 – Point in Time Recovery, Full WAL info • 8.2 – Restartable Recovery, Log Switching, Streaming API • 8.3 – Full Page Optimization, pg_standby • 8.4 – BgWriter during Recovery • 9.0 – Streaming Replication Hot Standby © 2ndQuadrant Limited 2010
  • 6. Streaming Replication (9.0) • Efficient real-time “log shipping” • Master → Slave replication using full security • Multiple concurrent slaves • Robust bi-modal design © 2ndQuadrant Limited 2010
  • 9. Hot Standby • Read-only access while “in recovery” • Equivalent of Oracle 11g Active Data Guard • Load balanced read scalability • Query off-load from main write node • Multiple highly available standby nodes © 2ndQuadrant Limited 2010
  • 10. Capabilities • High Performance • Integrated • Ease of Use • Query Access • Relay • Selectivity • Query Farm © 2ndQuadrant Limited 2010
  • 11. Capabilities with Tools • High Performance • Integrated • Ease of Use • Query Access • Relay • Selectivity • Query Farm © 2ndQuadrant Limited 2010
  • 13. Repmgr • Simplify standby management • Monitor replication delays • Provide feedback mechanisms © 2ndQuadrant Limited 2010
  • 14. Future: Sync Replication (9.1) • User-controlled robustness • High performance design • Simplicity • Additional flexibility through registration © 2ndQuadrant Limited 2010
  • 15. Future: Loose Coupling • Allows distributed database • High Availability and Disaster Recovery • No shared resources – better scalability • “Cellular” approach © 2ndQuadrant Limited 2010
  • 16. PostgreSQL Books • http://www.2ndQuadrant.com/books/ © 2ndQuadrant Limited 2010