MySQL as a Document Store
4 likes1,067 views
The document discusses the MySQL Document Store and how it can be used to store and query JSON documents. Key points include: - MySQL 5.7 introduced native JSON support including storage, indexing, and querying of JSON documents - JSON documents can be stored directly in MySQL tables and queried using SQL functions - The X DevAPI provides an abstraction over SQL for common CRUD operations on JSON documents in a fluent style without needing SQL knowledge
![Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
MySQL 5.7: JSON Support (cont.)
• Inline SQL JSON path expressions
SELECT doc->'$.object.array[0].item' FROM some_table
• Boolean operators (compare JSON values etc)
– foo = doc->'$.field'
Oracle ConfidenOal – Restricted 11](https://image.slidesharecdn.com/mysqldocumentstore-160714093738/85/MySQL-as-a-Document-Store-11-320.jpg)
![Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Find Documents
Oracle ConfidenOal – Restricted 26
products.find("color = 'yellow'").sort(["name"]).execute();](https://image.slidesharecdn.com/mysqldocumentstore-160714093738/85/MySQL-as-a-Document-Store-26-320.jpg)
MySQL as a Document Store
- 4. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | RelaOonal Databases • Data Integrity – NormalizaOon – Constraints (foreign keys etc) • Atomicity, Consistency, IsolaOon, Durability - ACID – TransacOons • SQL – Powerful, OpOmizable Query Language – Declare what you want and the DB will find out the most efficient way to get it to you Oracle ConfidenOal – Restricted 4
- 5. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Plus… • MySQL has been around since 1995 • Ubiquitous • Pregy much a standard • Scalable • When there are issues, they are known and understood • Large body of knowledge, from small to BIG deployments Oracle ConfidenOal – Restricted 5
- 6. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Document Databases Oracle ConfidenOal – Restricted 6 • Schemaless – no schema design, normalizaOon, foreign keys, constraints, data types etc – faster iniOal development • Flexible data structures – nested arrays and objects – some data is simply naturally unstructured or cannot be modeled efficiently in the relaOonal model (hierarchies, product DB etc) – persist objects without ORMs
- 7. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Document Databases (Cont.) Oracle ConfidenOal – Restricted 7 • JSON – Closer to the frontend – "naOve" in JavaScript – Node.js and full stack JavaScript • Easy to learn, easy to use
- 10. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | MySQL 5.7: JSON Support • NaOve JSON datatype • Store JSON values (objects, arrays and simple values) in MySQL tables • Binary JSON storage format • Conversion from "naOve" SQL types to and from JSON values • JSON ManipulaOon funcOons – Extract contents (JSON_EXTRACT, JSON_KEYS etc) – Inspect contents (JSON_CONTAINS etc) – Modify contents (JSON_SET, JSON_INSERT, JSON_REMOVE etc) – Create arrays and objects (JSON_ARRAY, JSON_OBJECT) – Search objects (JSON_SEARCH) Oracle ConfidenOal – Restricted 10
- 11. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | MySQL 5.7: JSON Support (cont.) • Inline SQL JSON path expressions SELECT doc->'$.object.array[0].item' FROM some_table • Boolean operators (compare JSON values etc) – foo = doc->'$.field' Oracle ConfidenOal – Restricted 11
- 15. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | ExtracOng JSON from a RelaOonal DB Rela+onal In, Rela+onal + Document Out • SQL FuncOons to construct JSON – JSON_OBJECT(), JSON_ARRAY() • Ex.: SELECT JSON_OBJECT('cust_id', id, 'name', name, 'email', email) FROM customer; CREATE VIEW customer_json AS SELECT JSON_OBJECT('cust_id', id, 'name', name, 'email', email) as doc FROM customer; SELECT * FROM customer_json; • Updates and inserts sOll happen through the table columns Oracle ConfidenOal – Restricted 15
- 17. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | MySQL as a JSON Document Container Oracle ConfidenOal – Restricted 17 Example: "product_info" table product_id a<ribute value 9 size M 9 color red 9 fabric cogon 11 flavour strawberry 12 capacity 128GB 12 speed class class 10 13 connecOvity Wi-Fi 13 storage 64GB 13 screen size 8.9" 13 resoluOon 2560 x 1600 (339 ppi) 13 bagery life 12 hours { "product_id": 9, "size" : "M", "color": "red", "fabric": "cogon" }, { "product_id": 11, "flavour": "strawberry" }, { "product_id": 12, "capacity": "128GB", "speed class": "class 10" }, {
- 18. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | MySQL as a JSON Document Container Document In, Rela+onal + Document Out • An ordinary MySQL table with a single JSON data column • Generated columns allow SQL engine to look inside the JSON data – Virtual columns – Primary Keys – Indexes – Foreign Keys • Writes on the JSON column • Reads primarily from the JSON columns Oracle ConfidenOal – Restricted 18
- 19. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Hybrid RelaOonal and JSON Rela+onal + Document In, Rela+onal + Document Out • Database is mostly relaOonal • Some parts of the database are unstructured or does not model cleanly as relaOonal • JSON columns in relaOonal tables • Queries can mix and match JSON and column data • EvoluOon path for Document based applicaOons Oracle ConfidenOal – Restricted 19
- 21. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Document OperaOons via SQL • Powerful • Allows complex queries • But… sOll difficult to use Oracle ConfidenOal – Restricted 21
- 22. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Document OperaOons via SQL CREATE TABLE product ( id VARCHAR(32) GENERATED ALWAYS AS (JSON_EXTRACT(doc, '$.id')) STORED, doc JSON ); INSERT INTO product VALUES (1, '{…}'); SELECT * FROM product WHERE JSON_EXTRACT(doc, '$.field') = value; etc. Oracle ConfidenOal – Restricted 22
- 23. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | The X DevAPI • AbstracOon over SQL • Focused on 4 basic CRUD operaOons (Create, Read, Update, Delete) • Fluent, NaOve Language API • No knowledge of SQL needed • X Protocol – CRUD requests encoded at protocol level – Request details "visible" (vs "opaque" SQL strings) Oracle ConfidenOal – Restricted 23
- 24. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | CollecOon and Schema OperaOons • Get a handle to a Schema mydb = session.getSchema("mydb"); • Create a CollecOon mydb.createCollection("products"); • Get a (local) reference to a CollecOon products = mydb.getCollection("products"); Oracle ConfidenOal – Restricted 24
- 26. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Find Documents Oracle ConfidenOal – Restricted 26 products.find("color = 'yellow'").sort(["name"]).execute();
- 27. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Modify Documents Oracle ConfidenOal – Restricted 27 products.modify("product_id = 123").set("color", "red").execute();
- 28. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Remove Documents Oracle ConfidenOal – Restricted 28 products.remove("product_id = 123").execute();
- 31. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | CRUD OperaOons – NoSQL/Document and SQL/RelaOonal Opera+on Document Rela+onal Create CollecOon.add() Table.insert() Read CollecOon.find() Table.select() Update CollecOon.modify() Table.update() Delete CollecOon.remove() Table.delete() 31
- 33. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | 5.7.12 Development Preview Release • MySQL 5.7.12 with Document Store plugin • MySQL Shell 1.0.3 • Connector/J 7.0 • Connector/Net 7.0 • Connector/Node.js 1.0 Oracle ConfidenOal – Restricted 33
- 37. Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Resources Topic Link(s) MySQL as a Document Database hgp://dev.mysql.com/doc/refman/5.7/en/document-database.html MySQL Shell hgp://dev.mysql.com/doc/refman/5.7/en/mysql-shell.html hgp://dev.mysql.com/doc/refman/5.7/en/mysqlx-shell-tutorial-javascript.html hgp://dev.mysql.com/doc/refman/5.7/en/mysqlx-shell-tutorial-python.html X Dev API hgp://dev.mysql.com/doc/x-devapi-userguide/en/ X Plugin hgp://dev.mysql.com/doc/refman/5.7/en/x-plugin.html MySQL JSON hgp://mysqlserverteam.com/tag/json/ hgps://dev.mysql.com/doc/refman/5.7/en/json.html hgps://dev.mysql.com/doc/refman/5.7/en/json-funcOons.html Blogs hgp://mysqlserverteam.com/category/docstore/ 37