Running Highly Available Postgres Databases in Containers
Download as PPTX, PDF2 likes889 views
The document outlines EDB's capabilities in running highly available PostgreSQL databases within containers, emphasizing its leadership in open-source PostgreSQL software and services since 2004. Key topics include the EDB Postgres platform, high availability strategies for databases, and the benefits of using containers for deployment. The upcoming EDB container platform 2.4 release and a demo at Postgres Vision in 2019 are also highlighted.
Running Highly Available Postgres Databases in Containers
- 1. © Copyright EnterpriseDB Corporation, 2019. All rights reserved. Running Highly Available Postgres Databases in Containers Aziz Rahman, Lead Architect, EDB Postgres Container Platform Marc Linster, SVP, Product Development and Support 1
- 2. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.2 AGENDA • Who is EDB? • EDB Postgres Platform • Cattle and Pets • EDB Postgres Container Platform and Architecture • Demo • EDB Postgres Container Strategy
- 3. © Copyright EnterpriseDB Corporation, 2019. All rights reserved. WHO IS EDB? The world leader in open-source based Postgres software and services. • Founded in 2004 • Recognized RDBMS leader by: • Gartner • Forrester • Customer base > 4000 • 300+ employees • Offices worldwide • PostgreSQL community leader 3
- 4. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.4 OVER 4,000 CUSTOMERS U.S Customers EMEA Customers APAC Customers 92 of the Fortune 500 311 of the Forbes Global 2000 Our customers benefit from the most reliable, high-performing, flexible, open, and cost-effective data management platform available.
- 5. © Copyright EnterpriseDB Corporation, 2019. All rights reserved. 5 ONLY OPEN SOURCE BASED RDBMS IN GARTNER MQ EDB Recognized 6 Years In A Row on Gartner’s Magic Quadrant
- 6. © Copyright EnterpriseDB Corporation, 2019. All rights reserved. EDB OPEN SOURCE LEADERSHIP Named EDB open source committers and contributors CONTRIBUTORS Akshay Joshi Amul Sul Ashesh Vashi Ashutosh Sharma Dilip Kumar Jeevan Ladhe Mithun Cy M. Usama Rushabh Lathia MAJOR CONTRIBUTORSCORE TEAM Andres Freund Devrim Gündüz Thomas Munro Amit Kapila Bruce Momjian Dave Page Robert Haas 6
- 7. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.7 EDB POSTGRES PLATFORM
- 8. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.8 EDB POSTGRES ADVANCED SERVER Enterprise capabilities add to the strengths of community PostgreSQL • Items in GREY are available in Community PostgreSQL • Items in RED are proprietary additions in Advanced Server
- 9. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.9 EDB POSTGRES PLATFORM Today’s Focus
- 10. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.10 Survey: Are you running databases in containers today? 1) For production (10.11%) 1) Development (22.74%) 1) No (67.15%)
- 11. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.11 Cattle and Pets ● Containers support an ephemeral and fungible model ○ Need more? Make more! ○ Acting up? Replace it! ● Applications are fungible, like cattle - databases are not ● Databases are ○ Persistent ○ Take a long time to warm up (cache loading) ○ When disconnected, they impact applications (disconnects, transaction restarts, errors visible to the users, …) ● Treat databases lovingly - just like pets
- 12. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.12 High Availability for Databases ● Things to consider ○ Do you need streaming replication with query routing, load balancing and/or read scaling? ○ Do you need synchronous replication? ○ Double (triple?) check that the database container is really down (get consensus and avoid false failover) ○ Promote carefully and make 100% sure that no application remains connected (STONITH) ● Options: ○ Custom scripting ○ Stolon https://github.com/sorintlab/stolon ○ Patroni https://github.com/zalando/patroni/ ○ EDB Failover Manager
- 13. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.13 Survey: How are you handling high availability in database containers? 1) No HA (62.37%) 2) Stolon (1.55%) 3) Patroni (4.12%) 4) EDB Failover Manager (9.28%) 5) Other (22.68%)
- 14. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.14 EDB Postgres Container Platform: Components Highly Available Data Management EDB Postgres Advanced Server ● 9.5 - 11 ● PostGIS optional Always includes EDB Failover Manager Read Scalability pgPool 4 ● Query routing ● Load balancing Backup and Recovery EDB Backup and Recovery ● Full and incremental backup ● Point in time recovery Tooling Upgrade tool ● Migration paths for older EPAS versions Monitoring & Management Postgres Enterprise Manager ● Dashboards and Alerts ● Performance management
- 15. © Copyright EnterpriseDB Corporation, 2019. All rights reserved. Master Node 15 EDB Postgres Container Platform: Architecture Overview k8s Cluster Management Components edb-service Master Node Client Anti-affinity BART edb-as Master EPAS +EFM Agent +PEM Agent PgPool +EFM Agent edb-pgpool Master Node PEMServer edb-as Standby EPAS +EFM Agent +PEM Agent PgPool +EFM Agent edb-pgpool edb-pemserver Master Node edb-as Standby EPAS +EFM Agent +PEM Agent Storage Subsystem . . . Worker Node 1 Worker Node 2 Worker Node 3 Shared Storageedb-bart
- 16. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.16 EDB Postgres Container Platform: Architecture Discussion • Kubernetes features we used to create a highly available containerized database platform • Stateful Sets • Pod Anti-affinity • Config Maps • Secrets • Dynamic Persistent Volume
- 17. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.17 EDB Postgres Container Platform: Architecture Discussion ● Deployment Methods • Helm charts for Google Kubernetes Engine • Operators (all Kubernetes environments) coming soon • Deployment Options • EDB Postgres Advanced Server (w. EDB Failover Manager) • EFM enabled or disabled • pgPool • EDB Backup/Recovery Tool • EDB Postgres Enterprise Manager
- 18. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.18 Demo
- 19. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.19 EDB Container Strategy ● Containers are becoming a key database deployment platform ○ Current focus: Development, some production deployments ○ Expectation 2020: Major production deployment for EDB Postgres platform ● Database best practices for containers are emerging ● EDB supports ○ GKE ○ OpenShift ○ IBM Cloud Private ○ Pivotal Cloud Foundry (planned for H2 2019)
- 20. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.20 Next Steps ● EDB Container Platform 2.4 GA plan date: March 19 2019 ○ Current scripts and V 2.4 containers are beta versions! ● Get your containers from EDB https://www.enterprisedb.com/advanced- downloads ● Get the sample Helm chart https://get.enterprisedb.com/helm-charts/edb- demo-0.1.1.tgz https://get.enterprisedb.com/helm-charts/demo-values.yaml ○ Accesses the demo repo - will not be available after GA ● Join us at Postgres Vision in Boston June 24 - 26 ○ Pre-conference workshop will be about databases in containers
- 21. © Copyright EnterpriseDB Corporation, 2019. All rights reserved.21
- 22. © Copyright EnterpriseDB Corporation, 2019. All rights reserved. THANK YOU [email protected] www.enterprisedb.com 22