MySQL Document Store - A Document Store with all the benefts of a Transactonal RDBMS

Copyright © 2018, Oracle and/or its afliates. All rights reserved. |
MySQL Document StoreMySQL Document Store
Copyright © 2018, Oracle and/or its afliates. All rights reserved.
Olivier Dasini
MySQL Principal Solutons Architect EMEA
olivier.dasini@oracle.com
@freshdaz
A Document Store with all the benefts of a Transactonal RDBMSA Document Store with all the benefts of a Transactonal RDBMS

Copyright © 2018, Oracle and/or its afliates. All rights reserved. |
Safe Harbor Statement
The following is intended to outline our general product directon. It is intended for
informaton purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functonality, and should not be relied upon
in making purchasing decisions. The development, release, and tming of any features or
functonality described for Oracle’s products remains at the sole discreton of Oracle.
22

Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 3
Me, Myself & I

MySQL Geek
 Addicted to MySQL for 15+ years!
 Playing with databases for 20+ years

MySQL Writer, Blogger and Speaker
 Also former : DBA, Consultant, Architect, Trainer, ...

MySQL Principal Solutons Architect EMEA at Oracle

Stay tuned! :
 Twiter: @freshdaz
 Blog: http:////dasini.net//blog
Olivier DASINI

Agenda
1
2
3
4
Introducton: SQL + NoSQL
MySQL Document Store Architecture
Live Demo using MySQL Shell
Conclusion

The world's most popular open source database

• Data Integrity
– Normalizaton
– Constraints (Foreign keys, …)
• Atomicity, Consistency, Isolaton, Durability
– ACID Compliant
– Transactons
• SQL
– Powerful Query Language
– Schema, Table, Row
– SELECT / UPDATE / DELETE / INSERT
Relatonal Databases
6

• An object that can represent structured data
• Structure is implicit in the document; usually no external/central schema
• Compact, popular and standardized
• Can be represented natvely in many languages (JavaScript,Python, etc.)
8
• JSON is a lightweight data-interchange format.
• It is easy for humans to read and write.
• It is easy for machines to parse and generate.
• It is based on a subset of the JavaScript Programming.
• Language, Standard ECMA-262 3rd Editon - December 1999.
• Use for storing and exchanging data.
What is a JSON Document ?
JavaScript Object Notaton

JSON Support
• Natve File Format
– Standardized as ECMA-404 (htp://json.org)
– Binary Storage
• Generated Columns
• 20+ Functons
 Search Functons
 Aggregatons Functons
• Query structured data and semi-structured JSON data

MySQL 5.7 and 8.0
JSON_ARRAY_APPEND()
JSON_ARRAY_INSERT()
JSON_ARRAY()
JSON_CONTAINS_PATH()
JSON_CONTAINS()
JSON_DEPTH()
JSON_EXTRACT()
JSON_INSERT()
JSON_KEYS()
JSON_LENGTH()
JSON_MERGE[_PRESERVE]()
JSON_OBJECT()
JSON_QUOTE()
JSON_REMOVE()
JSON_REPLACE()
JSON_SEARCH()
JSON_SET()
JSON_TYPE()
JSON_UNQUOTE()
JSON_VALID()
JSON_PRETTY()
JSON_STORAGE_SIZE()
JSON_STORAGE_FREE()
JSON_ARRAYAGG()
JSON_OBJECTAGG()
JSON_MERGE_PATCH()
JSON_TABLE()
https://mysqlserverteam.com/mysql-8-0-from-sql-tables-to-json-documents-and-back-again/
JSON Functons

• Schemaless
– No schema design, No normalizaton, No Foreign Keys, No data types, …
– Very quick inital development
• Flexible data structure
– Embedded arrays or objects
– Valid soluton when natural data can’t be medelized optmally into a relatonal model
– Objects persistence without the use of any ORM – Mapping Object-Oriented
• JSON
– Close to frontend
– Natve in JavaScript
– Easy to learn
NoSQL : Document Store
11

•Schema (Database)
•Collecton
– Group of JSON documents.
– Equivalent of table
•Document
– Set of key-value pairs in JSON
format
– Equivalent of row (tuple)
Document Store Databases
12
•CRUD (basic functons of persistent storage)
– CREATE
– READ
– UPDATE
– DELETE

Document Store
An easy, straight forward way to work with JSON documents in MySQL

RDBMS or NoSQL ?
Why not both ?

Document Store: Components
• MySQL X Plugin
• Introduces X Protocol for relatonal- and
document operatons
• Maps CRUD operatons to standard SQL
(relatonal tables, JSON datatype and
functons)
• X Protocol
• New MySQL client protocol based on top of
industry standard (Protobuf)
• Works for both, CRUD and SQL operatons
• InnoDB Cluster
• Read-Scaling, Write-Scaling, HA
• X DevAPI
• New, modern, async developer API for CRUD
and SQL operatons on top of X Protocol
• Introduces Collectons as new Schema obj.
• MySQL Shell
• Ofers interactve X DevAPI mode for app
prototyping
• MySQL Connectors
• Support for X DevAPI for
• JavaScript, Python, PHP, Java, C#, C++
16

Document Store: Architecture
17

Document Store
SQL is now optonal ! - Write applicatons using X DevAPIX DevAPI

Welcome to the X DevAPI!
MySQL X devAPI connector for:
• Java
– htps://insidemysql.com/connectorj-8-0-11-the-face-for-your-brand-new-document-oriented-database
• .NET
– htps://insidemysql.com/introducing-connectornet-with-full-support-for-mysql-8-0
• Node.JS
– htps://insidemysql.com/introducing-connectornode-js-for-mysql-8-0
• C++
– htps://insidemysql.com/what-is-new-in-connectorc-8-0
• Python
– htps://insidemysql.com/using-mysql-connectorpython-8-0-with-mysql-8-0
• PHP
– htps://insidemysql.com/introducing-the-mysqlx-php-extension-for-mysql-8-0
• ODBC
– htps://insidemysql.com/what-is-new-in-connectorodbc-8-0
https://insidemysql.com/mysql-8-0-welcome-to-the-devapi/
19
Motvaton
• We are doing something that has not been done before
• Document databases exist! Relatonal databases exist!
• We even see databases that support relatonal and document querying over the same data set
• However we have yet to see a relatonal database include a document model so that a user can use document objects alongside their
existng relatonal data.

Welcome to the X DevAPI! - Python Example
https://insidemysql.com/using-mysql-connector-python-8-0-with-mysql-8-0/
20
Writng a program using MySQL 8.0 Document Store
import mysqlx
session = mysqlx.get_session({
"host": "localhost",
"port": 33060,
"user": "my_user",
"password": "s0S3kR*T"
})
schema = session.get_schema("test")
collection = schema.get_collection("my_collection")
result = collection.find("name like :param").bind("param", "Olivier").limit(1).execute()
docs = result.fetch_all()
print("Name: {0}".format(docs[0]["name"]))
session.close()
Connector/Python 8.0 installaton
shell> pip install mysql-connector-python

Document Store
Live Demo

js> session.createSchema('demo')
js> use demo
js> db.getCollections()
js> db.createCollection('myCollection')
js> db.getCollections()
js> db.myCollection.add({"param1":"value1", "param2":"value2"})
js> db.myCollection.find()
js> db.myCollection.find().limit(1)
js> db.myCollection.find("_id = '00005af018430000000000000002'")
js> db.myCollection.modify("_id = '1234'").set("param","value")
js> db.myCollection.remove("_id = '1234'")
js> session.startTransaction()
js> …
js> session.rollback()
js> db.myCollection.createIndex("ageIdx",{fields:[{"field":"$.age","type":"INT",required:false}]})
Copyright @ 2018 Oracle and/or its affiliates. All rights reserved.
MySQL Document Store “cheat sheet”
CCreate
RRead
UUpdate
DDelete
Index
TTransacton

Document Store
Wrap-up

Document Store
✔ Built on Proven SQL/InnoDB/Replicaton technology
✔ Schema-less/Relatonal/Hybrid
✔ ACID/Transactons
✔ No SQL required - CRUD/JSON/Documents/Indexes
✔ Modern Dev API
✔ Modern/Efcient Protocol
✔ SQL Queries/Analytcs over JSON Documents
✔ Transparent and Easy HA/Scaling with MySQL InnoDB Cluster
25

Hybrid database that covers 4 core areas
Relatonal
MySQL Tables and SQL
Relatonal
Relatonal Analytcs
Relatonal Analytcs
Document Store
MySQL Collectons and
Table with JSON Datatytpe
Key//Value
MySQL Memcached
Document Store
MySQL Collectons and
Table with JSON Datatytpe
Key//Value
MySQL Memcached
Mass Scale Analytcs
Sharded MySQL
Relatonal and//or Document Store
Mass Scale Analytcs
Sharded MySQL
Relatonal and//or Document Store
Otperatonal Analytcal
Relatonal//SQL
NoSQL

Resources
Topic Link(s)
Top 10 reasons for NoSQL with MySQL htp://lefred.be/content/top-10-reasons-for-nosql-with-mysql/
MySQL as a Document Store htps://dev.mysql.com/doc/refman/8.0/en/document-store.html
MySQL Shell User Guide htps://dev.mysql.com/doc/mysql-shell-excerpt/8.0/en/index.html
MySQL Shell Documentaton htps://dev.mysql.com/doc/dev/mysqlsh-api-javascript/8.0/
htps://dev.mysql.com/doc/dev/mysqlsh-api-python/8.0/
X Dev API User Guide htps://dev.mysql.com/doc/x-devapi-userguide/en/
X Plugin htps://dev.mysql.com/doc/refman/8.0/en/x-plugin.html
MySQL Engineering Blog htps://insidemysql.com/mysql-8-0-welcome-to-the-devapi/
htps://insidemysql.com/mysql-document-store-crud-quick-start/
MySQL JSON Data Type htps://dev.mysql.com/doc/refman/8.0/en/json.html
Blogs htp://dasini.net/blog/2015/11/17/30-mins-avec-json-en-mysql/
htp://dasini.net/blog/2015/11/30/json-et-colonnes-generees-avec-mysql
htp://mysqlserverteam.com/tag/json/
htp://mysqlserverteam.com/category/docstore/

Questons?

Thank you!

MySQL Document Store - A Document Store with all the benefts of a Transactonal RDBMS

MySQL Document Store - A Document Store with all the benefts of a Transactonal RDBMS

More Related Content

What's hot (20)

Similar to MySQL Document Store - A Document Store with all the benefts of a Transactonal RDBMS (20)

More from Olivier DASINI (15)

Recently uploaded (20)

MySQL Document Store - A Document Store with all the benefts of a Transactonal RDBMS