MySQL Group Replication - an Overview
10 likes7,745 views
The document provides an overview of MySQL Group Replication, which is a multi-master update anywhere replication plugin for MySQL that provides built-in automatic distributed recovery, conflict detection, and group membership. It allows for active/active update anywhere setups, automates group reconfiguration, and provides a highly available distributed database service. The document discusses the theory behind MySQL Group Replication, provides examples of how to use it, and concludes by discussing its benefits and future releases.
MySQL Group Replication - an Overview
- 1. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | MySQL Group Replication An Overview 1
- 2. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracleās products remains at the sole discretion of Oracle. 2
- 3. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Program Agenda
- 4. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Program Agenda The Theory How It Works How to Use It Conclusion 1 2 3 4 4
- 5. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | The Theory1
- 6. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | M S S S S M write clients read clients read clients write clients More reads? More slaves! Read scale-out Background: What is Replication Used For? 6
- 7. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | C B A C B ACrash C B A B is the new master Uh Oh! Whew! Redundancy: If master crashes, promote slave to master Background: What is Replication Used For? 7
- 8. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | MySQL Group Replication 8 M M M M M Replication Group Clients
- 9. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | MySQL Group Replication ā¢ What is MySQL Group Replication? āMulti-master update anywhere replication plugin for MySQL with built-in automatic distributed recovery, conflict detection, and group membership.ā ā¢ What does the MySQL Group Replication plugin do for the user? ā Removes the need for manually handling server fail-over ā Provides distributed fault tolerance ā Enables Active/Active update anywhere setups ā Automates group reconfiguration (handling of crashes, failures, re-connects) ā Provides a highly available distributed database service 9
- 10. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Use Cases ā¢ Elastic Replication ā Environments that require a very fluid replication infrastructure, where the number of servers has to grow or shrink dynamically and with as little manual intervention as possible. ā¢ Highly Available Shards ā Sharding is a popular approach to achieve write scale-out. Users can use MySQL Group Replication to implement highly available shards. Each shard can map to an individual Replication Group. ā¢ Alternative to Master-Slave Replication ā It may be that a single master server makes it a single point of contention. Writing to an entire group may prove more scalable under certain circumstances. 10
- 11. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | The Theory Behind It ā¢ Implementation is based on āReplicated Database State Machinesā ā Group Communication primitives resemble general properties of Databases ā Distributed systems meet Databases: Pedone, Guerraoui, and Schiper paper ā¢ Deferred update replication: before committing locally we certify it on all nodes ā In order to implement it one needs Atomic Broadcast ā the change occurs everywhere or nowhere ā This is necessary to ensure data consistency across all nodes ā¢ Membership Service ā Group Membership: it allows one to know that at a given moment in time all the members that are participating in the protocol are associated with the same logical identifier (view id) ā View Synchrony: ensure that messages from past views are all delivered before a new view is installed 11
- 12. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | How It Works2
- 13. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Example: Adding a Node to an Existing Group ā¢ Create a user for automated distributed recovery: ā¢ Server needs to be started with a valid configuration: 13 ./bin/mysqld --no-defaults --basedir=. --datadir=<DATADIR_LOCATION> āP <PORT> --socket=mysqld<ID>.sock --log-bin=master-bin --server-id=<ID> --gtid-mode=on --enforce-gtid-consistency --log-slave-updates --binlog-checksum=NONE --binlog-format=row --master-info-repository=TABLE --relay-log-info-repository=TABLE --transaction-write-set-extraction=MURMUR32 --plugin-dir=lib/plugin --plugin-load=group_replication.so ./bin/mysql -uroot -h 127.0.0.1 -P 13001 -p --prompt='server1>' server1> CREATE USER 'rpl_user'@'%' IDENTIFIED BY 'rpl_pass'; GRANT REPLICATION SLAVE ON *.* TO rpl_user@'%';
- 14. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Example: Adding a Node to an Existing Group (2) ā¢ Now lets configure the replication user used for recovery: ā¢ Now the group communication backbone: 14 SET GLOBAL group_replication_recovery_user='rpl_user'; SET GLOBAL group_replication_recovery_password='rpl_pass'; SET GLOBAL group_replication_group_name= <valid UUID>; SET GLOBAL group_replication_local_address=<this node address:port for the communication backbone>; SET GLOBAL group_replication_peer_addresses= <comma-separated list of all other nodes in the group>; SET GLOBAL group_replication_bootstrap_group= 0;
- 15. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Example: Adding a Node to an Existing Group (3) ā¢ Server that joins the group will automatically synchronize with the others ā¢ It will retrieve the diff between its data and the rest of the group ā¢ Hint: provision the new node with base data (i.e. restore a backup) before joining an existing group 15 M M M M M N I want to join the group START GROUP_REPLICATION; ONLINE
- 16. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Example: Adding a Node to an Existing Group (4) 16 M M M M M N ONLINE RECOVERING SELECT * FROM performance_schema.replication_group_membersG M M M M M N ONLINE
- 17. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Example: Automated Group Membership ā¢ If a server leaves the group, the others will automatically be informed 17 M M M M M M My machine needs maintenance or a system crash happens Each membership configuration is identified by a view_id view_id: 4 STOP GROUP_REPLICATION;
- 18. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Example: Automated Group Membership (2) ā¢ If a server leaves the group, the others will automatically be informed ā¢ Server that (re)joins the group will automatically synch with the others 18 M M M M M view_id: 5 M M M M M M RECOVERING -> ONLINE view_id: 6
- 19. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | How to Use It3
- 20. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Multi-Master Update Anywhere! ā¢ Any two transactions on different servers can write to the same row ā¢ Conflicts will automatically be detected and handled ā First committer wins rule 20 M M M M M UPDATE t1 SET a=4 WHERE a=2UPDATE t1 SET a=3 WHERE a=1 OKOK M M M M M UPDATE t1 SET a=2 WHERE a=1UPDATE t1 SET a=3 WHERE a=1 OK
- 21. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Full GTID Support ā¢ All group members share the same UUID, which is the group name 21 M M M M M INSERT y; Will have GTID: group_name:2 INSERT x; Will have GTID: group_name:1
- 22. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Monitoring the Replication Group ā¢ Monitor group health and stats using Performance Schema tables 22 mysql> SELECT * FROM performance_schema.replication_connection_statusG *************************** 1. row *************************** CHANNEL_NAME: group_replication_applier GROUP_NAME: 8a94f357-aab4-11df-86ab-c80aa9429563 SOURCE_UUID: 8a94f357-aab4-11df-86ab-c80aa9429563 THREAD_ID: NULL SERVICE_STATE: ON ... mysql> SELECT * FROM performance_schema.replication_group_member_statsG *************************** 1. row *************************** CHANNEL_NAME: group_replication_applier VIEW_ID: 1428497631:3 MEMBER_ID: e38fdea8-dded-11e4-b211-e8b1fc3848de COUNT_TRANSACTIONS_IN_QUEUE: 0 COUNT_TRANSACTIONS_CHECKED: 12 COUNT_CONFLICTS_DETECTED: 5 COUNT_TRANSACTIONS_VALIDATING: 6 TRANSACTIONS_COMMITTED_ALL_MEMBERS: 8a84f397-aaa4-18df-89ab- c70aa9823561:1-7 LAST_CONFLICT_FREE_TRANSACTION: 8a84f397-aaa4-18df-89ab-c70aa9823561:7 mysql> SELECT * FROM performance_schema.replication_group_membersG *************************** 1. row *************************** CHANNEL_NAME: group_replication_applier MEMBER_ID: 597dbb72-3e2c-11e4-9d9d-ecf4bb227f3b MEMBER_HOST: nightfury MEMBER_PORT: 13000 MEMBER_STATE: ONLINE *************************** 2. row *************************** ...
- 23. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Conclusion4
- 24. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Summary ā¢ Cloud Friendly ā Great techonology for deployments where high availability and elasticity is a requirement, such as Cloud based infrastructures ā¢ Integrated ā With standard MySQL servers through a well defined API ā With standard GTIDs, ROW based replication, and Performance Schema tables ā¢ Autonomic and Operations Friendly ā It is self-healing: no admin overhead for handling server fail-overs ā Provides fault-tolerance: enables multi-master update anywhere and a resilient distributed MySQL service ā¢ Lab releases provide a sneak peek at what is coming -- a new replication plugin and exciting new infrastructure: MySQL Group Replication and MySQL Router 24
- 25. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | ā¢ Strong development cycles and continuous community engagement through regular lab releases Releases 25 2015-Apr-06 Labs release: 0.3.0 2014-Aug-06 Labs release: 0.4.0 2015-Sep-14 Labs release: 0.5.0 Introduces new communication engine! 2015-Oct-22 Labs release: 0.6.0 2016-Jan-13 Labs release: 0.7.0 Introduces Windows Support!
- 26. Copyright Ā© 2016, Oracle and/or its affiliates. All rights reserved. | Where to Go From Here? ā¢ Packages ā http://labs.mysql.com ā¢ Blogs from the Engineers (news, technical information, and much more) ā http://mysqlhighavailability.com/tag/mysql-group-replication/ 26