Training Slides: 102 - Basics - Tungsten Replicator - How We Move Your Data
0 likes91 views
The document discusses the basics of Tungsten Replicator and how it moves data. It describes the replicator states as START, OFFLINE, GOING-ONLINE, ONLINE, and GOING-OFFLINE. It also explains the replicator roles of master, slave, thl-server, and thl-client. Finally, it outlines the replicator stages of extraction, filtering, and application between a primary and replica, including the stages of binlog-to-q, q-to-thl, remote-to-thl, thl-to-q, and q-to-dbms.
Training Slides: 102 - Basics - Tungsten Replicator - How We Move Your Data
- 1. The MySQL Availability Company Tungsten Cluster Master Class Basics: Tungsten Replicator – How we Move Your Data Chris Parker, Customer Success Director, EMEA & APAC
- 2. Topics In this short course, we will • Take a look at the inner workings of the Replicator • Understand Replicator States • Explore the Replicator Stages
- 6. Tungsten Replicator Roles • master (extractor) • A replicator in a ”master” role extracts data from a source database (for example, by reading the binary log from a MySQL server) and generates THL. As the extractor, the replicator also serves THL to other replicators over the network connection. • slave (applier) • The applier replicator pulls THL from one of more extractors and then applies that data to a target database or environment. • thl-server • New in v6.1.2 • A thl-server replicator is a special role that extractor replicators in Clusters can be changed to temporarily when a Primary is taken offline. This will allow downstream appliers to download and apply any THL that hasn't yet been processed by the replicator. • thl-client • New in v6.1.4 • A thl-client replicator is a special role that appliers can be changed to. This will allow the applier replicator to download any THL available from the upstream extractor, but does NOT apply the THL to the target database.
- 7. Tungsten Replicator States • START • The replicator service is starting up and reading the replicator properties configuration file. • OFFLINE:NORMAL • The node has been deliberately placed into the offline mode by an administrator. No replication events are processed and reading or writing to the underlying database does not take place. • OFFLINE:ERROR • The node has entered the offline state because of an error. No replication events are processed and reading or writing to the underlying database does not take place. • GOING-ONLINE:PROVISIONING • The replicator is currently reading provisioning information from the primary database before entering the ONLINE state. • GOING-ONLINE:RESTORING • The replicator is preparing to go online and is currently restoring data from a backup. • GOING-ONLINE:SYNCHRONIZING • The replicator is preparing to go online and is currently preparing to process any outstanding events from the incoming event stream. This mode occurs when an applier has been switched online after maintenance, or in the event of a temporary network error where the applier has reconnected to the extractor.
- 8. Tungsten Replicator States • ONLINE • The node is currently online and processing events, reading incoming data and applying those changes to the database as required. In this mode the current status and position within the replication stream is recorded and can be monitored. Replication will continue until an error or administrative condition switches the node into the OFFLINE state. • GOING-OFFLINE • The replicator is processing any outstanding events or transactions that were in progress when the node was switched offline. When these transactions are complete, and the resources in use (memory, network connections) have been closed down, the replicator will switch to the OFFLINE:NORMAL state. This state may also be seen in a node where auto-enable is disabled after a start or restart operation. • ONLINE:DEGRADED • This status will be seen on an extractor and is indicative of the replicator loosing connectivity to the source database that it is extracting from. The replicator will still continue to extract entries from the binary log that have not yet been processed. After extracting all log entries, the replicator will proceed to the ONLINE:DEGRADED-BINLOG-FULLY- READ state. • ONLINE:DEGRADED-BINLOG-FULLY-READ • This status will be seen on an extractor replicator following the ONLINE:DEGRADED state and indicates that the replicator has completed reading all binlog entries. In a clustering environment, it indicates to the cluster that failover can now proceed.
- 10. Tungsten Replicator Stages • Each stage passes through: • Extract -> Filter -> Apply • binlog-to-q • Handles extraction of transactions from binary log and places into in-memory queue • q-to-thl • Takes transactions from in-memory queue and writes down to disk into thl log file DBMS Logs Primary Replicator: Extractor binlog-to-q q-to-thl Memory THL Extract Filter Apply
- 11. Tungsten Replicator Stages • remote-to-thl • Streams thl log files across network socket, from configured extractor. Writes out THL to local disk.. • thl-to-q • Reads transactions from thl and places into in-memory queue • q-to-dbms • Reads transactions from in-memory queue and writes out to target database Remote THL Replica Replicator: Applier remote-to-thl q-to-dbms Memory Queue thl-to-q Local THL
- 12. Summary What we have learnt today • How the Replicator Works • Reviewed the Replicator States • Discussed the Replicator Stages
- 13. Next Steps In the next session we will • Walk through the process of installing a simple cluster. • Gain an understanding of the pre-requisites. • Discuss various pre-installation decisions
- 14. THANK YOU FOR LISTENING continuent.com The MySQL Availability Company Chris Parker, Customer Success Director, EMEA & APAC