MySQL Ecosystem in 2020
1 like531 views
In a 2020 webinar, Alkin Tezuysal discusses the evolution of MySQL and its ecosystem, tracing its history from its inception by Monty Widenius in 1995 to its acquisitions by Oracle. The presentation highlights major developments in MySQL versions 5.0 to 8.0, including significant features and the emergence of forks like MariaDB and Percona Server. It also covers the current landscape of database management tools, trends, and players in the MySQL ecosystem.
MySQL Ecosystem in 2020
- 1. The MySQL Ecosystem in 2020 Where can you be part of it? ALKIN TEZUYSAL - Sr. Technical Manager June 4th, 2020 - 2020 Webinar Series
- 2. @ask_dba © 2020 Percona2 Alkin Tezuysal - @ask_dba – Sr. Technical Manager, Percona – Global Operations – Managed Services – 25+ years of IT experience in RDBMS domain – Open Source Database Evangelist – Enterprise background – Speaker, mentor and coach – Born to Sail, Forced to Work @ask_dba
- 3. About This Presentation @ask_dba © 2020 Percona 3 Overview of Existing Solutions and History of MySQLOverview Discuss what we use at Percona and best practicesDiscuss Show what specific things to look at and trending topics Show
- 4. Inception of MySQL • Written by Monty Widenius (Monty) in 1995 • In 15 June 2001, NuSphere sued MySQL AB, • In October 2005, Oracle Corporation acquired Innobase • In February 2006, Oracle Corporation acquired Sleepycat Software • In January 2008, Sun Microsystems bought MySQL • In April 2009, Oracle Corporation entered into an agreement to purchase Sun Microsystems @ask_dba © 2020 Percona 4
- 5. MySQL Stake Holders @ask_dba © 2020 Percona 5 In January 2009, before Oracle's acquisition of MySQL, Monty Widenius started a GPL-only fork, MariaDB. In 2008 Peter Zaitsev found Percona with MySQL fork In 2008 Drizzle lasted till 2012 In 2014 WebScaleSQL lasted till 2016 As of 2020 Oracle owns both Community and Enterprise Editions of MySQL
- 6. MySQL Versions History @ask_dba © 2020 Percona6 Ref:https://elmcip.net/node/10280
- 7. MySQL 5.0 to 8.0 @ask_dba © 2020 Percona7 Ref:https://github.com/dveeden/mysql-history-graph
- 8. MySQL 5.7 • Over 150 new features in MySQL 5.7 • Group Replication • InnoDB • Optimizer • Security • Performance Schema • GIS (Geographic Information System) • JSON @ask_dba © 2020 Percona 8 Ref:http://www.thecompletelistoffeatures.com/
- 9. MySQL 8.0 • Native Data Dictionary • Fast Information Schema • Utf8mb4 as Default Character Set • Security • Roles • New Super Privileges • Password history • Log encryption • Persistent Auto Increment • Auto Undo Tablespace • Self Tuning (pool, log, flush) • Invisible Indexes • Optimizer Histograms • Performance Schema • Innodb No Wait and Skip Locked • Descending Indexes • Aggregate over JSON • JSON to table (Labs) • JSON Extraction • CTE (Recursive and Non- Recursive) • Window Functions • GIS Features Set • Document Store • MySQL Shell @ask_dba © 2020 Percona9 Database Administration Software Development Ref:https://mysqlserverteam.com/the-complete-list-of-new-features-in-mysql-8-0/
- 10. MySQL 8.0.20 • 8.0.0 to 8.0.5 Several Bugs Fixed • 8.0.11 Deprecates uft8mb3 • 8.0.12 Improves performance_schema defaults • 8.0.13 Major deprecations InnoDB, Partitioning • 8.0.14 MySQL allows dual passwords • 8.0.15 Major Bugs Fixed • 8.0.16 Several changes made to account-management capabilities, deprecation of mysql_upgrade. • 8.0.17 Audit Log , C API , Character Set Support changes. • MySQL Shell Plugins • Parallel table import • In InnoDB Cluster: • Automatic instance provisioning through cloning • Automatic server version compatibility handling • Simplification of internal recovery accounts • 8.0.18 MySQL Shell Plugins, • 8.0.19 Innodb ReplicaSet Parallel Table Import, Innodb Cluster improvements • 8.0.20 Binary Log Compression @ask_dba © 2020 Percona 10
- 11. Percona Server 5.7 to 8.0 @ask_dba © 2020 Percona11 Ref:https://github.com/dveeden/mysql-history-graph
- 12. Percona Server for MySQL 8.0.19- 10 • Faster and more consistently run queries • Enhanced security with binary log (binlog) encryption and data-at-rest encryption • MyRocks, TokuDB Storage Engines • InnoDB Full-Text Search Improvements • Extra Hast/Digest Functions • Improved diagnostics with instrumentation and troubleshooting features @ask_dba © 2020 Percona 12
- 13. Community vs Enterprise vs Percona @ask_dba © 2020 Percona 13 Community Enterprise Percona - MySQL Enterprise Monitor Percona Monitoring and Management - PAM Authentication PAM Authentication - - RocksDB - - Extra Hash/Digest Functions - - Extra Diagnostic Features - Performance & Scalability Performance & Scalability - MySQL Enterprise Backup Percona Xtrabackup - MySQL Enterprise Audit Percona Audit Plugin - - TokuDB - Threadpool Threadpool
- 14. MariaDB 10.5.3 • Partitioned S3 tables are discoverable. This means that if you create a partitioned S3 table, both the partitioned table and its partitions can be directly used by another server that has access to the S3 storage. (MDEV-22088) • Optimizer flag rowid_filter leads to long query (MDEV-21794) • WSREP_ON is unnecessarily expensive to evaluate (MDEV-22203 • Misc wsrep performance optimization (MDEV-7962) • Modernise Linux Large Page support (multiplesizes) (MDEV- 18851) • Added system user for user view which allows to remove root (MDEV-19650) • WolfSSL updated • ALTER USER doesn't remove excess authentication plugins from mysql.global_priv (MDEV-21928) • mysql_upgrade creating empty global_priv table (MDEV-21244) @ask_dba © 2020 Percona 14
- 15. Percona / MariaDB MyRocks Engine • MyRocks storage engine based of RocksDB • RocksDB is key-value store fork of LevelDB • Optimized for writes and disk space usage • Log-Structured Merge Tree Database • Compressed InnoDB is roughly 2x smaller than uncompressed InnoDB, MyRocks/HBase are 4x smaller • Decompression cost on read is non zero. It matters less on i/o bound workloads • Write efficiency is 10X better @ask_dba © 2020 Percona 15
- 16. MyRocks Engine – Read, Write and Space Performance/Efficiency @ask_dba © 2020 Percona 16 – Ref:https://www.percona.com/live/e18/sessions/myrocks-in- the-real-world
- 17. Other Major Players • Amazon Web Services (AWS) RDS MySQL & MariaDB • Amazon Web Services (AWS) Aurora • Google Cloud Platform • Alibaba Cloud (AliSQL, PolarDB) • Microsoft Azure MySQL & MariaDB • Rackspace Cloud MySQL & MariaDB & Percona Server • Linux distributions MariaDB default database @ask_dba © 2020 Percona17
- 18. Popularity of Mysql vs … @ask_dba © 2020 Percona18 https://db-engines.com/en/ranking_trend
- 19. Web Scale – Social Media (Facebook, Twitter) – Content and Cloud Providers (Google, Dropbox, Box) – Services (Uber, Booking) – E-commerce (ebay, amazon) SaaS – AWS , Salesforce, Slack, Adobe MySQL Use Cases @ask_dba © 2020 Percona19 Ref: https://www.mysql.com/customers/ Ref: https://dzone.com/articles/2019-open-source-database-report-top- databases-pub
- 20. What’s the most used Database in the world? • Oracle ? • SQL Server ? • DB2 ? • MySQL ? • PostgreSQL ? SQLite • Every Android device • Every iPhone and iOS device • Every Mac • Every Windows10 machine • Every Firefox, Chrome, and Safari web browser • Every instance of Skype • Every instance of iTunes • Every Dropbox client • Every TurboTax and QuickBooks • PHP and Python • Most television sets and set-top cable boxes • Most automotive multimedia systems • Countless millions of other applications https://www.sqlite.org/mostdeployed.html @ask_dba © 2020 Percona20
- 21. Edge Cases of MySQL • Very Large Clusters up to 10-15K MySQL instances. • Sharded operations for geographic zones and customer base Vitess • Usage beyond MySQL’s initial design • Not fit due to hardware limitation • Unexpected growth and expansion • One billion tables http://bit.ly/2DCXfjI @ask_dba © 2020 Percona21
- 22. Scalability and Proxy Wars What’s a proxy? – Lightweight application between client and server • Known proxies and load balancers: • Software • Open Source • ProxySQL • HA Proxy • MySQL Router • Licenced • ScaleArc • MaxScale • Netscaler (Virtual Appliance) • Hardware • Netscaler • F5 @ask_dba © 2020 Percona22
- 23. Open Source Proxy Options for MySQL ProxySQL 2.0.7 (GPLv3) – Stable since December 2015 – ProxySQL - included with PerconaXtraDB Cluster 5.7,8.0, – Lots of features and use cases – ProxySQL Use Case Scenarios MariaDB MaxScale 1.0…1.4.x – GA since January 2015 – The “Swiss Army Knife” - pluggable router with an extensible architecture – Logging, writing to other backends (besides MySQL), firewall filter, routing via hints, query rewriting – Binlog Server - popularised by booking.com to not have intermediate masters – Popular use case: sitting in front of a 3-node Galera Cluster @ask_dba © 2020 Percona23
- 24. MySQL Proxy Vision @ask_dba © 2020 Percona24 https://proxysql.com/blog/proxysql-native-galera-support https://tinyurl.com/y5fwde4z
- 25. MySQL HA Solutions On Premise – MySQL – Group Replication – Innodb Cluster – Based on Galera – Percona Xtradb – MariaDB – Continuent Tungsten – ScaleArc – Vitess – Native Replication – MHA, Orchestrator, MySQL Failover Cloud – AWS Aurora – Google Cloud Platform – Azure SQL – Alibaba Cloud AliSQL – Microsoft Azure @ask_dba © 2020 Percona25
- 26. Tooling Highlights @ask_dba © 2020 Percona 26 Percona Toolkit (pt-osc,pt-table-sync, XtraBackup) MySQL Shell Orchestrator, gh-ost MHA Tungsten Replicator MySQL Built-in Utilities ClusterControl MySQL Sandbox aka Dbdeployer Sysbench GUI tools: MySQL Workbench, phpMyAdmin, SQLYog, etc PMM , VividCortex
- 27. MySQL Trending Topics • Kubernetes Operators • Vitess • Group Replication • Galera 4.0 • Percona XtraDB 8.X • MySQL 8.0.X • Observability & Monitoring • ProxySQL 2.X • Orchestrator @ask_dba © 2020 Percona27
- 28. Percona Kubernetes Operator for Percona XtraDB Cluster ü Deploy easily ü Scale Percona XtraDB Cluster ü Automate Backups ü Integrate with Percona Monitoring and Management (PMM) ü Relies on ProxySQL to Remove Single Point of Failure ü Automate node recovery ü Provide data encryption ü Support private data registries Kubernetes Operators for MySQL @ask_dba © 2020 Percona28 Presslabs Kubernetes Operator ü Integration with Google Cloud Marketplace, OperatorHub.io, AWS Marketplace ü CRD Validation and webhooks ü SSL support ü Default integrated with MySQL 8.0 ü Proxy SQL integration ü Backup policies ü Physical backups ü HA Orchestrator integration ü Prometheus metrics exporter ü Lag mitigation ü Query limits Vitess Kubernetes Operator ü Create a StatefulSet for each VitessTablet in a VitessCluster ü Create a Job to elect the initial master in each VitessShard ü Fix parenting and normalization ü Create vtctld Deployment and Service ü Create vttablet service ü Create vtgate Deployment and Service ü Create PodDisruptionBudgets ü Reconcile all the things! ü Label pods when they become shard masters ü Add the ability to automatically merge/split a shard ü Add the ability to automatically export/import resources from embedded objects to separate objects and back
- 29. Vitess • Scalability • Performance • Manageability • Shard management • Performance • Connection pooling • Shard management • Workflow @ask_dba © 2020 Percona 29
- 30. MySQL Group Replication –Oracle MySQL shared-everything –Developed in 2013 at 5.6 GA since 5.7 at the end of 2016 –MySQL Plugin –Paxos based consensus algorithm Multi-Master –InnoDB engine –Performance Schema tables –Enhanced in 8.0.X @ask_dba © 2020 Percona 30
- 31. Galera 4.0 – Galera Cluster uses an allocation algorithm that attempts to store write-sets. – True Multi-master, Active-Active Cluster Read and write to any node at any time. – Synchronous Replication No slave lag, no data is lost at node crash. – Tightly Coupled All nodes hold the same state. No diverged data between nodes allowed. – Multi-threaded Slave For better performance. For any workload. – No Master-Slave Failover Operations or Use of VIP. – Hot Standby No downtime during failover (since there is no failover). – Automatic Node Provisioning No need to manually back up the database and copy it to the new node. – Supports InnoDB. – Transparent to Applications Required no (or minimal changes) to the application. – No Read and Write Splitting Needed. – Easy to Use and Deploy @ask_dba © 2020 Percona 31
- 32. Observability and Monitoring @ask_dba © 2020 Percona 32 PMM 2.X SolarWinds (VividCortex)
- 33. PMM Highlights @ask_dba © 2020 Percona 33 Point-in-time visibility and historical trending of database performance Data from the Performance Schema and MySQL slow query log Specific Amazon RDS and Amazon Aurora metrics dashboards for AWS- specific monitoring Data from the MongoDB query profiler Best-of-breed tools, including Grafana, Prometheus, and Consul, query analytics, administration, API, agent and exporter components DBTA TREND-SETTING PRODUCT 2019 https://pmmdemo.percona.com/
- 34. Vividcortex Highlights @ask_dba © 2020 Percona 34 Network analyzer Monitors MySQL Queries real time Monitors MySQL metrics Agent based auto discovery Cloud hosted Designed for teams
- 35. MySQL’s 25th Anniversary @ask_dba © 2020 Percona 35
- 36. @ask_dba © 2020 Percona36 https://www.eventbrite.com/e/proxysql-tech-talks-with- percona-tickets-106255384716?aff=efbneb
- 37. Q&A Open Source Database Experts