MySQL Innovation from 5.7 to 8.0

June 2017
MySQL Innovation
Evolution is inevitable

Frédéric Descamps - MySQL Community Manager - Oracle
4 / 46

Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purpose only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied up in
making purchasing decisions. The development, release and timing of any features or
functionality described for Oracle´s product remains at the sole discretion of Oracle.
Copyright @ 2017 Oracle and/or its affiliates. All rights reserved.
5 / 46

about.me/lefred
Who am I ?
6 / 46

Frédéric Descamps
@lefred
MySQL Evangelist
Hacking MySQL since 3.23
devops believer
MySQL Community Manager since May
2016
living in Belgium 🇧🇪
7 / 46

MySQL 5.7 -> 8.0
Innovation
8 / 46

MySQL 5.7 (GA)
3x Better Performance
Replication Enhancements
Optimizer Cost Model
JSON Support
Improved Security
SYS & Performance Schema
GIS

MySQL InnoDB Cluster (GA)
MySQL Group Replication
MySQL Router
MySQL Shell
MySQL 8.0 (DMR)
Data Dictionary
Roles
Unicode
CTEs
Window Functions
Security
Replication
SysSchema
GIS
MySQL Innovation: 5.7 -> 8.0
9 / 46

100%

virtually all organizations require their most
critical systems to be highly available !
10 / 46

100%

virtually all organizations require their most
critical systems to be highly available !
11 / 46

"HighAvailabilitybecomesacorefirst
classfeatureofMySQL!"
MySQL InnoDB Cluster

12 / 46

MySQL InnoDB Cluster: vision
"Asingleproduct-MySQL-withhighavailabilityandscalingfeaturesbakedin;providing
anintegratedend-to-endsolutionthatiseasytouse."
13 / 46

MySQL InnoDB Cluster: vision
"Asingleproduct-MySQL-withhighavailabilityandscalingfeaturesbakedin;providing
anintegratedend-to-endsolutionthatiseasytouse."
InnoDB
cluster
Ease-of-Use
Extreme Scale-Out
Out-of-Box Solution
Built-in HA
High Performance
Everything Integrated
14 / 46

One Product: MySQL
All components created together
Tested together
Packaged together
Easy to Use
One client: MySQL Shell
Easy packaging
Integrated orchestration
Homogenous servers
Flexible and Moden
SQL and NoSQL together
Protocol Buffers
Asynchronous API
Developer friendly
Support Read/Write Scale Out
Shared clusters
Federated systemof N replica sets
supporting cross shard
operations
Each replica set manages a shard
MySQL InnoDB Cluster: goals
15 / 46

MySQL powers the Web !
16 / 46

MySQL powers the Web !
and many more...
17 / 46

Web applications evolution
18 / 46

Everything is already Mobile first or moving to mobile very soon
19 / 46

Everything is already Mobile first or moving to mobile very soon

...and it impacts our roadmap and newfeatures priority
20 / 46

Evolution Driving Roadmap: 1995 vs 2017

There was no local.
Noweverything is
contextual to me as a
user.
The Internet was
global, but full of
silos. Nowwe are
more connected than
ever.
In the past APIs were
cumbersome,
powered by SOAP and
XML-RPC.
There is nowan
increased focus on
privacy and
protecting
information.
21 / 46

Evolution Driving Roadmap: 1995 vs 2017

There was no local.
Noweverything is
contextual to me as a
user.
The Internet was
global, but full of
silos. Nowwe are
more connected than
ever.
In the past APIs were
cumbersome,
powered by SOAP and
XML-RPC.
There is nowan
increased focus on
privacy and
protecting
information.
22 / 46

Evolution Driving Roadmap: MySQL 5.7 recap
Switched to
Boost.Geometry
library
R+Tree indexes for
InnoDB
Spatial Typed for
InnoDB
Optimized InnoDB
Temporary Tables
Optimized Packed
Sort Buffer
Switched InnoDB to
DYNAMIC row format
by default
Native JSON Data
Type
20+ JSON Functions
Generated Columns
for Functional Index
JSON Comparator
Short-hand JSON
operators
Secure by Default
Password Expiration
Password Policy
Remove old
password hash
Encrypted
Tablespaces, TDE
(Enterprise)
Firewall (Enterprise)
Audit (Enterprise)
23 / 46

Evolution Driving Roadmap: MySQL 8.0
Geography support
Spatial Reference
System (SRS)
Support
SQL/MM Information
Schema views
Standard compliant
axis ordering in
import/export
functions
Utf8mb4 as default
Up to 16x Faster
Performance
Based on Unicode 9.0
New collations with
Accents/Case sensitivity
Japanese Collation
Aggregate, Table
and Pretty Print
Functions
Sort Performance
Improvements
Optimizer support
for in-place update
JSON Shell
Roles
Encrypted REDO Log
and UNDO Space
Finer grained
system privileges
Atomicity in
Privilege
statements
24 / 46

Overview of improvements & new features
What's new in MySQL 8.0 ?
25 / 46

Fully Function, Properly Architected
Roles
Create and Drop Roles, Grant to Roles
Grant Roles to Roles. Grant Roles to
Users
Limit Hosts that can use roles, Define
Default Roles
And even visualize Roles with SQL
function ROLES_GRAHPHML()
MySQL 8.0: Security Roles
26 / 46

MySQL 8.0 vs MySQL 5.7 utf8mb4
UTF8MB4 is nowthe default charset set !
27 / 46

MySQL 8.0 vs MySQL 5.7 utf8mb3
No need to use the short-cut as in 5.7
28 / 46

MySQL 8.0: Boosts Developer Productivity

Improve support for the SQL standard
29 / 46

MySQL 8.0: Boosts Developer Productivity
New! CTEs and Recusrsive CTEs
New! WindowFunctions
New! SKIP LOCKED and NOWAIT
UUIDs and Bitwise Functions
30 / 46

WITH RECURSIVE qn AS
( SELECT 1 AS a
UNION ALL
SELECT 1+a FROM qn WHERE a<10
)
SELECT * FROM qn;
MySQL 8.0: recursive CTE (example)

31 / 46

WITH RECURSIVE qn AS
( SELECT 1 AS a
UNION ALL
SELECT 1+a FROM qn WHERE a<10
)
SELECT * FROM qn;
+------+
| a |
+------+
| 1 |
| 2 |
| 3 |
| 4 |
| 5 |
| 6 |
| 7 |
| 8 |
| 9 |
| 10 |
+------+
10 rows in set (0.01 sec)
MySQL 8.0: recursive CTE (example)

32 / 46

SELECT seat_no
FROM seats
JOIN seat_rows USING (row_no)
WHERE seat_no IN (3,4)
AND seat_rows.row_no IN (12)
AND booked = 'NO'
FOR UPDATE OF seats SKIP LOCKED
FOR SHARE OF seats_rows NOWAIT;
MySQL 8.0: better handing of hot rows

33 / 46

SELECT seat_no
FROM seats
JOIN seat_rows USING (row_no)
WHERE seat_no IN (3,4)
AND seat_rows.row_no IN (12)
AND booked = 'NO'
FOR UPDATE OF seats SKIP LOCKED
FOR SHARE OF seats_rows NOWAIT;
SKIP LOCKED = non deterministically
skip over locked rows
NOWAIT = error immediately if a rowis
already locked
MySQL 8.0: better handing of hot rows

34 / 46

Do more with a fewer number of servers
Take more advantages of newhardware:
SSD
multi-core processors
Greater density per server
Operator Friendliness
Increase Reliability
Improved Replication Throughput
35 / 46

MySQL 8.0: Makes Scale Easier
Better Observability: improving PFS (more instruments, better performance)
Newoperations
Higher Reliability: systemtables are nowin InnoDB and is used for Data Dictionary
Parallel Replication
36 / 46

MySQL 8.0: Performance Schema
SQL error instrumentation
Indexes
Configuration Variables
New! Data Locks
New! Histograms
37 / 46

PFS : Performance Comparison
38 / 46

PFS : Performance Comparison
Over 30x faster!
39 / 46

MySQL 8.0: Invisible Indexes
Indexes are "hidden" to the MySQL Optimizer
not the same as "disabled indexes"
contents are fully up to date and maintained by DML
Two use cases:
Soft Delete (RecycleBin)
Staged Rollout
40 / 46

MySQL 8.0: Persist Configuration
Persist GLOBAL Server Variables
SET PERSIST max_connections = 500;
Examples Include:
Of ine_mode
Read_Only
Requires no filesystemaccess
New! Captures timestamp and change user
41 / 46

MySQL 8.0: Parallel Replication
MySQL 5.7 added support for logical clock parallel replication
in early version (<5.7.3), the logical clock is group commit based
in next versions, the logical clock is interval based
MySQL 8.0 adds support for Write Set parallelismidentification
42 / 46

MySQL 8.0: Replication Improvements
43 / 46

MySQL 8.0: Replication Improvements
44 / 46

Source code now documented
with Doxygen
Plugin Infrastructure!
Expanded Query Hints Support
Improved Scan Query Performance
Improved BLOB Storage
Improved Memcached Interface
Cost Model Improvements
Scalabibilty Improvements
Atomicity in Privileges
Parser Refactoring
Improvements to Temporary
Tables
C++11 and Toolchain
Improvements
GTID_PURGED always settable
Persistent Auto Increment
Native InnoDB Data Dictionary
Improved Information Schema
performance
New! SQL Grouping Function
New! Optimizer Trace detailed
sort statistics
New! Descending Indexes
New! Smaller Package Downloads
New! JSON Aggregate, Pretty
print functions
New! JSON performance
improvements
New! Expended Query Hints
New! Improved usability of cost
constant configuration
Group Replication
New! Transaction Save Point
support in Group Replication
New! Improved Replication Applier
Lag Statistics in Performance
Schema
New! Per Multi-source Channel
Replication Filters
New! Atomic DDL extended to the
Binary Log
New! Performance Improvements
on the Replication Applier
New! Parallel Replication Applier
Policy
New! Binary Log Management
Enhancements
New! Additional Metadata into the
Binary Log
All these features plus...
45 / 46

Thank you !
Any Questions ?
46 / 46

MySQL Innovation from 5.7 to 8.0

More Related Content

What's hot (20)

Similar to MySQL Innovation from 5.7 to 8.0 (20)

More from Frederic Descamps (20)

Recently uploaded (20)

MySQL Innovation from 5.7 to 8.0