UAE MySQL Users Group Meet-up : MySQL Shell Document Store & more...

Frédéric Descamps
Community Manager
MySQL
MySQL Shell: Document Store & More
MySQL 8 is Great !
2 / 96

Safe Harbor
The following is intended to outline our general product direction. It is intended for information purpose only, and
may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality,
and should not be relied up in making purchasing decisions. The development, release, timing and pricing of any
features or functionality described for Oracle´s product may change and remains at the sole discretion of Oracle
Corporation.
Statement in this presentation relating to Oracle´s future plans, expectations, beliefs, intentions and ptospects
are "forward-looking statements" and are subject to material risks and uncertainties. A detailed discussion of
these factors and other risks that a ect our business is contained in Oracle´s Securities and Exchange
Commission (SEC) lings, including our most recent reports on Form 10-K and Form 10-Q under the heading
"Risk Factors". These lings are available on the SEC´s website or on Oracle´s website at
h p://www.oracle.com/investor. All information in this presentation is current as of September 2019 and Oracle
undertakes no duty to update any statement in light of new information or future events.
Copyright @ 2020 Oracle and/or its affiliates.
3 / 96

Who am I ?
4 / 96

Frédéric Descamps
@lefred
MySQL Evangelist
Managing MySQL since 3.23
devops believer
living in Belgium 🇧🇪
h ps://lefred.be
5 / 96

MySQL Shell
The MySQL Shell is an interactive Javascript, Python, or SQL interface supporting
development and administration for the MySQL Server and is a component of the MySQL
Server. You can use the MySQL Shell to perform data queries and updates as well as
various administration operations.
6 / 96

MySQL Shell (2)
The MySQL Shell provides:
7 / 96

MySQL Shell (2)
Both Interactive and Batch operations
8 / 96

MySQL Shell (2)
Document and Relational Models
9 / 96

MySQL Shell (2)
CRUD Document and Relational APIs via scripting
10 /
96

MySQL Shell (2)
Traditional Table, JSON, Tab Separated output results formats
11 /
96

MySQL Shell (2)
MySQL Standard and X Protocols
12 /
96

MySQL Shell (2)
MySQL Standard and X Protocols
and more...
13 /
96

MySQL Shell Overview
PY
JS
SQL
>
MySQL 8.0
Upgrade Checker
Auto Completion
&
Command History
Output
Formats
(table, json, tabs)
Prompt
Themes
Batch
Execution
5.7
8.0
JS
Document
Store
X dev API
SQL CLI InnoDB
Cluster
importJSON
JSJS
parallel
importTABLE
data
14 /
96

setup your environment
Starting with MySQL Shell
15 /
96

Install MySQL Shell
the package's name to install is mysql-shell
you always need to use the latest available even with a lower MySQL Server version
latest version is 8.0.19, use it even with MySQL 5.7.x
Shell
16 /
96

Start a beautiful Shell
The default prompts is basic, we provide several di erent prompt examples.
# cp /usr/share/mysqlsh/prompt/prompt_256pl+aw.json ~/.mysqlsh/prompt.json
Then start the mysqlsh:
17 /
96

Start a beautiful Shell
The default prompts is basic, we provide several di erent prompt examples.
# cp /usr/share/mysqlsh/prompt/prompt_256pl+aw.json ~/.mysqlsh/prompt.json
Then start the mysqlsh:
18 /
96

Some configuration tips
These are some se ings I usually use:
mysql-js> shell.options.setPersist('history.autoSave', 1)
mysql-js> shell.options.setPersist('history.maxSize', 5000)
You can switch to all 3 di erent modes using:
py for Python
js for Javascript
sql for SQL
If you have a preferred mode, you can specify it like this:
mysql-js> shell.options.setPersist('defaultMode', 'sql')
19 /
96

Util
The MySQL Shell comes with a global object called util. This object is used to perform
some dedicated DBA tasks like:
Checking if the server's con guration and schema design is compatible with next
MySQL version (checkForServerUpdrade())
Importing JSON documents, like exports from MondoDB (importJSON())
Importing table dumps in parallel (importTable())
Con guring OCI pro le (con gureOCI())
20 /
96

Admin API
The Admin API is used to con gure MySQL instances to be part of a MySQL InnoDB
Cluster or a MySQL InnoDB ReplicaSet - NEW in 8.0.19.
It also creates and manage clusters.
More Info: h ps://lefred.be/content/mysql-innodb-cluster-from-scratch-even-more-
easy-since-8-0-17/
21 /
96

NoSQL
22 /
96

* CREATE
* READ
* UPDATE
* DELETE
col->add({title: 'MySQL is Great', author: 'lefred' })
col-> nd()
collection.modify('author = "lefred"').set('author',
'kenny')
col.remove('author = "lefred"')
MySQL supports JSON & CRUD operations
23 /
96

* CREATE
* READ
* UPDATE
* DELETE
col->add({title: 'MySQL is Great', author: 'lefred' })
col-> nd()
collection.modify('author = "lefred"').set('author',
'kenny')
col.remove('author = "lefred"')
MySQL supports JSON & CRUD operations
It's possible to use MySQL without a single line
of SQL !
24 /
96

Migration from MongoDB to MySQL DS
For this example, I will use the well known restaurants collection:
25 /
96

Migration from MongoDB to MySQL DS
For this example, I will use the well known restaurants collection:
26 /
96

Let's make a query
27 /
96

Let's make a query
That's too much records to show in here... let's limit it
28 /
96

29 /
96

Some more examples
30 /
96

Let's add a selection criteria:
31 /
96

Simpler Syntax than other Document Store
32 /
96

Simpler Syntax than other Document Store
33 /
96

NoSQL + SQL =
MySQL
34 /
96

SQL
35 /
96

Credits: @MarkusWinand - @ModernSQL
SQL: RECURSION / CTEs
36 /
96

SQL: LATERAL
37 /
96

SQL: Analytical / Window Functions
38 /
96

SQL: Analytical / Window Functions
39 /
96

SQL: JSON_TABLE
40 /
96

SQL: JSON_TABLE
41 /
96

List the best restaurant of each type of
food and show the top 10, with the best
one first !
42 /
96

And all together !
43 /
96

And all together !
44 /
96

More Validation
45 /
96

CHECK CONSTRAINTS
46 /
96

JSON SCHEMA VALIDATION
47 /
96

48 /
96

And the best of both worlds:
49 /
96

50 /
96

51 /
96

JSON Array
Indexes
52 /
96

Index of a JSON array
A functional index over a JSON
expression
The expression evaluates to an array
Several index entries per row
One index entry per array element
General mechanism, currently used
for JSON arrays
Used to speed up array lookups
JSON_CONTAINS(...)
JSON_OVERLAPS(...)
MEMBER OF (...)
JSON Array Indexes
53 /
96

JSON Array Indexes
54 /
96

JSON Array Indexes
55 /
96

JSON Array Indexes
56 /
96

we want more !
Extending MySQL Shell
57 /
96

MySQL Shell and Javascript
In JS mode, it's also possible to load some pure Javascript modules installed in sys.path:
58 /
96

MySQL Shell and Javascript (2)
The module has to be pure JS (not node.JS) modules:
59 /
96

MySQL Shell and Javascript (3)
Then your module can be loaded and used like this:
60 /
96

MySQL Shell and Python
When using the python mode in the Shell, it's even possible to use system modules (local).
61 /
96

MySQL Shell and Python (2)
Of course this can be any type of modules:
62 /
96

MySQL Shell and Python (2)
Of course this can be any type of modules:
63 /
96

Extending MySQL Shell
Since 8.0.17, you have 3 di erent ways to extend the MySQL Shell:
using the new Reporting Framework (>= 8.0.16)
create your own modules to extend MySQL Shell (obsolete)
create your own plugins that will be completely integrated in all supported interpreters
(>= 8.0.17)
8.0
64 /
96

MySQL Shell User-Defined Reports
You can create reports that are called once on demand (show) or constantly refreshed
(watch).
Example for checking the LOCKS:
65 /
96

MySQL Shell User-Defined Reports (2)
This is a Python le (locks_info.py) installed in ~/.mysqlsh/init.d:
It contains a de nition and a registration:
def locks_info(session):
query = session.sql("select ...")
...
return {'report': report}
shell.register_report(
'locks_info',
'list',
locks_info,
{
'brief': 'Shows Locks.',
'details': ['You need the SELECT privilege on sys.session view and the ..'],
'argc': '0'
}
)
66 /
96

User-De ned Reports can be called from any MySQL Shell mode, even SQL:
67 /
96

More info:
h ps://lefred.be/content/using-the-new-mysql-shell-reporting-framework-to-
monitor-innodb-cluster/
h ps://lefred.be/content/mysql-innodb-cluster-recovery-process-monitoring-with-
the-mysql-shell-reporting-framework/
68 /
96

Sources of Examples:
h ps://github.com/lefred/mysql-shell-udr
Pull Requests welcome !
69 /
96

Why should I extend the MySQL Shell with
plugins?
For calling some long statements or group of operations or sometimes to replace a
missing functionality.
70 /
96

plugins?
Recently, somebody pointed out that since the new DD it was not anymore possible to
delete all routines for a speci c schema.
71 /
96

plugins?
Recently, somebody pointed out that since the new DD it was not anymore possible to
delete all routines for a speci c schema.
Jesper explained how the MySQL Shell could help here see
h ps://mysql.wisborg.dk/2018/12/02/mysql-8-drop-several-stored-events-procedures-
or-functions/
72 /
96

Using a plugin within MySQL Shell
Plugins are available from the ext global object:
73 /
96

Using a plugin within MySQL Shell (2)
Help is automatically available:
74 /
96

Plugins are available from JS and Python, regardless of the language in which they are
wri en:
75 /
96

Using a plugin wi thin MySQL Shell (4)
The help goes from the plugin to its methods:
76 /
96

And nally the plugin in action:
77 /
96

And nally the plugin in action:
78 /
96

How to use MySQL Shell Plugins ?
Plugins must be installed inside ~/.mysqlsh/plugins/ext directory.
Several existing plugins can be found at h ps://github.com/lefred/mysqlshell-plugins
Plugins are split in di erent categories:
check innodb_cluster router
collations maintenance schema
con guration performance security
demo proxysql support
innodb ...
79 /
96

Overview of some plugins
Extending MySQL Shell with Plugins
80 /
96

MySQL Shell: Security
Retrieving the expiration period of passwords:
81 /
96

MySQL Shell: InnoDB
Which tables are potentially fragmented:
82 /
96

MySQL Shell: InnoDB (2)
And it can be improved using table space on disk size:
83 /
96

MySQL Shell: Schema
We already saw how we added methods to show and delete procedures. But recently
somebody complained about the complexity of knowing what are the default values of
columns when expressions are used (h ps://forums.mysql.com/read.php?
101,670682,670682):
84 /
96

MySQL Shell: Schema (2)
In MySQL 8.0, 0000-00-00 is not a valid value for a date eld anymore. We can check for
such dates in our dataset:
More Info: h ps://lefred.be/content/mysql-8-0-and-wrong-dates/
85 /
96

MySQL Shell: Maintenance
When using MySQL X Protocol, it's not allowed to shutdown MySQL. This plugin resolves
this limitation:
86 /
96

MySQL Shell: Collations
When upgrading, the collation might be problematic for unique values. This plugin from
Bernt Marius Johnsen shows the non-unique values for a speci c collation:
87 /
96

Outside MySQL
It's also possible to interact with external tools
88 /
96

Monitoring MySQL Router
With the MySQL Shell and MySQL Router's REST API, it's even possible to create a plugin
to monitor the Router:
89 /
96

Monitoring MySQL Router (2)
90 /
96

MySQL Shell and ProxySQL
It's also possible to integrate 3rd party projects directly in MySQL Shell:
91 /
96

MySQL Shell and ProxySQL
92 /
96

And much more on
https://github.com/lefred/mysqlshell-plugins
93 /
96

Thank you !
94 /
96

Upgrade to MySQL 8.0
It's time to upgrade to
MySQL 8.0, the fastest MySQL
adoption release ever !
95 /
96

Upgrade to MySQL 8.0
It's time to upgrade to
MySQL 8.0, the fastest MySQL
adoption release ever !
96 /
96

UAE MySQL Users Group Meet-up : MySQL Shell Document Store & more...

More Related Content

What's hot (20)

Similar to UAE MySQL Users Group Meet-up : MySQL Shell Document Store & more... (20)

More from Frederic Descamps (19)

Recently uploaded (20)

UAE MySQL Users Group Meet-up : MySQL Shell Document Store & more...