SlideShare a Scribd company logo
MySQL shell and It's utilities
Praveen GR
Associate database consultant,
Mydbops
Services on top open source databases
Founded in 2016
80 Member team
Assisted over 500+ Customers
AWS Partner and a PCI Certified Organisation
About Mydbops
Database
Consulting
Services
Managed
Database
Services
Focuses on Top Opensource database MySQL,MariaDB,
MongoDB and PostgreSQL ON Premises and Cloud
Mydbops Services
About MySQL shell
MySQL shell Utilities
Upgrade Checker Utility
Table Export Utility
Parallel Table Import Utility
Dump utility
Dump Loading Utility
JSON Import Utility
Agenda
About MySQL Shell
MySQL shell is an addon utility
JavaScript, Python and SQL
Results - table, tabbed, vertical format, JSON
MySQL Shell
MySQL Shell Utilities
MySQL Shell Utilities
Shell utility
Backup Restore
Other
Table Export
Utility
Dump Utility
Table Import
Utility
Dump Loading
Utility
JSON Import
Utility
Upgrade
Checker Utility
Upgrade Checker Utility
Avoid data corruption
Unwanted downtime extention
Safe migration with proper pre-checks
Upgrade Checker Utility - Purpose
Checks compatibility on server migration 5.7 to 8.0
Reserved keywords
Supported variables (config - Shell 8.0.16 & global)
Specific version check (Shell - 8.0.13)
Upgrade Checker Utility
targetVersion - MySQL version to check the compactibility for
upgrade

configPath - Config file path 

outputFormat - TEXT (Default), JSON

Upgrade Checker Utility - Notable options
Upgrade Checker Utility
Table Export Utility
Faster table export
Controlled Export to avoid load
Rough estimation on completion
Table Export Utility - Purpose
Table export with parallel thread
Progress monitor
Compression - None (Default), gzip, zstd
Supported output format - CSV, TSV (Default)
Output to local or oracle cloud infra
Table Export Utility
maxRate - bytes per second per thread 

compression - gzip, zstd , none(default)

dialect - Export format - csv|csv-unix|tsv

Table Export Utility - Notable options
Table Export Utility
Parallel Table Import Utility
Import the data with parallel thread
Controlled import
Replace the duplicate values of primary key/ unique
Mutiple files at a time from different server
Parallel Table Import Utility - Purpose
Loading the table with a parallel thread
Progress tracking
Can restore compressed ( > Shell - 8.0.22 )
Restore multiple file to single table ( > Shell - 8.0.23 shell version)
Option to avoid duplicate entry failure.
Parallel Table Import Utility
threads - No of thread for restoring

maxRate - bytes per second per thread

replaceDuplicates - Replace existing row of PK/UK (Default - yes)

skipRows - Skip the no of row from the begining of file.

Parallel Table Import Utility - Notable options
Parallel Table Import Utility
Syntax :
Parallel Table Import Utility
Duplicate entry :
Dump Utility
Dump Utility
Instance dump
Dump utility
Schema dump Table dump
Exporting the data with parallel thread
Dry-run before exporting
Compatability checks
Default compression
Dump utility - Purpose
Object names in the instance or schema must be in the latin1 or utf8 characterset.
Data consistency is guaranteed only for tables that use the InnoDB storage engine.
Group Replication, primary keys are required on every table.
Dump Utility - Notable requirement
dryRun - Information about what will be dumped

threads - Thread used to export data

maxRate - The maximum number of bytes per second per thread.

consistent - Lock the instance while taking backup

chunking - Split the data for each table into multiple files

compression - No , gzip , zstd (default)

Dump Utility - Notable options
Dump utility - Instance dump
Dump utility - Schema dump
Dump utility - Table dump
Dump loading utility
Speed the restoration by a parallel thread.
Ignore the index at the target to speed up restoration.
Need to restore the only specified schema from the full dump.
Dump loading utility - Purpose
Restore the dump data with parallel thread ( > Shell - 8.0.21 )
Restore only the required table or schema
Analyze table post restore
Index creation post-restoration to boost loading (Default - Full text index)
Dump loading utility
threads - No.of thread used to restore the data

backgroundThreads - No.of thread used to fetch data

loadIndexes - Restore index at target (Default - true)

deferTableIndexes - Index creation post restoration.

Dump loading utility - Notable options
Dump loading utility
JSON import Utility
Migration of Mongo DB to MySQL
Create the table structure based on JSON
JSON import Utility - Purpose
Import both JSON and BJSON to MySQL ( > Shell - 8.0.13 )
Import to an existing table or new table
The default column name is doc
Auto conversion of BJSON to JSON ( > Shell - 8.0.14 )
JSON import Utility
tableColumn - Columns need to be restored.

convertBsonTypes - Convertion is required (Default - true)

JSON import Utility - Notable options
JSON import Utility
Reach Us : Info@mydbops.com
Thank You

More Related Content

Similar to MySQL shell and It's utilities - Praveen GR (Mydbops Team) (20)

PDF
MySQL Shell for DBAs
Frederic Descamps
 
PPTX
MyDUMPER : Faster logical backups and restores
Mydbops
 
PDF
MySQL Shell for Database Engineers
Mydbops
 
PDF
MySQL Shell - The Best MySQL DBA Tool
Miguel Araújo
 
PDF
20190615 hkos-mysql-troubleshootingandperformancev2
Ivan Ma
 
PDF
JavaScript and Friends August 20th, 20201 -- MySQL Shell and JavaScript
Dave Stokes
 
PDF
SDPHP - Percona Toolkit (It's Basically Magic)
Robert Swisher
 
PDF
UAE MySQL Users Group Meet-up : MySQL Shell Document Store & more...
Frederic Descamps
 
PDF
In-depth session: Big Data Analytics with MariaDB AX
MariaDB plc
 
PDF
MySql 5.7 Backup Script
Hızlan ERPAK
 
PDF
Python Utilities for Managing MySQL Databases
Mats Kindahl
 
PDF
20180420 hk-the powerofmysql8
Ivan Ma
 
PPTX
MySQL Utilities -- Cool Tools For You: PHP World Nov 16 2016
Dave Stokes
 
PDF
MySQL 8.0.1 DMR
MySQL Brasil
 
PDF
MySQL Shell: the best DBA tool !
Frederic Descamps
 
PPTX
MySQL Tools And Gui
mysql content
 
PPTX
Mysql: Tools & Gui
DataminingTools Inc
 
PDF
MySQL sys schema deep dive
Mark Leith
 
PPTX
The State of the Dolphin, MySQL Keynote at Percona Live Europe 2019, Amsterda...
Geir Høydalsvik
 
PPTX
MySQL performance tuning
Anurag Srivastava
 
MySQL Shell for DBAs
Frederic Descamps
 
MyDUMPER : Faster logical backups and restores
Mydbops
 
MySQL Shell for Database Engineers
Mydbops
 
MySQL Shell - The Best MySQL DBA Tool
Miguel Araújo
 
20190615 hkos-mysql-troubleshootingandperformancev2
Ivan Ma
 
JavaScript and Friends August 20th, 20201 -- MySQL Shell and JavaScript
Dave Stokes
 
SDPHP - Percona Toolkit (It's Basically Magic)
Robert Swisher
 
UAE MySQL Users Group Meet-up : MySQL Shell Document Store & more...
Frederic Descamps
 
In-depth session: Big Data Analytics with MariaDB AX
MariaDB plc
 
MySql 5.7 Backup Script
Hızlan ERPAK
 
Python Utilities for Managing MySQL Databases
Mats Kindahl
 
20180420 hk-the powerofmysql8
Ivan Ma
 
MySQL Utilities -- Cool Tools For You: PHP World Nov 16 2016
Dave Stokes
 
MySQL 8.0.1 DMR
MySQL Brasil
 
MySQL Shell: the best DBA tool !
Frederic Descamps
 
MySQL Tools And Gui
mysql content
 
Mysql: Tools & Gui
DataminingTools Inc
 
MySQL sys schema deep dive
Mark Leith
 
The State of the Dolphin, MySQL Keynote at Percona Live Europe 2019, Amsterda...
Geir Høydalsvik
 
MySQL performance tuning
Anurag Srivastava
 

More from Mydbops (20)

PDF
Scaling TiDB for Large-Scale Application
Mydbops
 
PDF
AWS MySQL Showdown - RDS vs RDS Multi AZ vs Aurora vs Serverless - Mydbops...
Mydbops
 
PDF
Mastering Vector Search with MongoDB Atlas - Manosh Malai - Mydbops MyWebinar 39
Mydbops
 
PDF
Migration Journey To TiDB - Kabilesh PR - Mydbops MyWebinar 38
Mydbops
 
PDF
AWS Blue Green Deployment for Databases - Mydbops
Mydbops
 
PDF
What's New In MySQL 8.4 LTS Mydbops MyWebinar Edition 36
Mydbops
 
PDF
What's New in PostgreSQL 17? - Mydbops MyWebinar Edition 35
Mydbops
 
PDF
What's New in MongoDB 8.0 - Mydbops MyWebinar Edition 34
Mydbops
 
PDF
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops
Mydbops
 
PDF
Read/Write Splitting using MySQL Router - Mydbops Meetup16
Mydbops
 
PDF
TiDB - From Data to Discovery: Exploring the Intersection of Distributed Dat...
Mydbops
 
PDF
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
Mydbops
 
PDF
Demystifying Real time Analytics with TiDB
Mydbops
 
PDF
Must Know Postgres Extension for DBA and Developer during Migration
Mydbops
 
PDF
Efficient MySQL Indexing and what's new in MySQL Explain
Mydbops
 
PDF
Scale your database traffic with Read & Write split using MySQL Router
Mydbops
 
PDF
PostgreSQL Schema Changes with pg-osc - Mydbops @ PGConf India 2024
Mydbops
 
PDF
Choosing the Right Database: Exploring MySQL Alternatives for Modern Applicat...
Mydbops
 
PDF
Mastering Aurora PostgreSQL Clusters for Disaster Recovery
Mydbops
 
PDF
Navigating Transactions: ACID Complexity in Modern Databases- Mydbops Open So...
Mydbops
 
Scaling TiDB for Large-Scale Application
Mydbops
 
AWS MySQL Showdown - RDS vs RDS Multi AZ vs Aurora vs Serverless - Mydbops...
Mydbops
 
Mastering Vector Search with MongoDB Atlas - Manosh Malai - Mydbops MyWebinar 39
Mydbops
 
Migration Journey To TiDB - Kabilesh PR - Mydbops MyWebinar 38
Mydbops
 
AWS Blue Green Deployment for Databases - Mydbops
Mydbops
 
What's New In MySQL 8.4 LTS Mydbops MyWebinar Edition 36
Mydbops
 
What's New in PostgreSQL 17? - Mydbops MyWebinar Edition 35
Mydbops
 
What's New in MongoDB 8.0 - Mydbops MyWebinar Edition 34
Mydbops
 
Scaling Connections in PostgreSQL Postgres Bangalore(PGBLR) Meetup-2 - Mydbops
Mydbops
 
Read/Write Splitting using MySQL Router - Mydbops Meetup16
Mydbops
 
TiDB - From Data to Discovery: Exploring the Intersection of Distributed Dat...
Mydbops
 
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
Mydbops
 
Demystifying Real time Analytics with TiDB
Mydbops
 
Must Know Postgres Extension for DBA and Developer during Migration
Mydbops
 
Efficient MySQL Indexing and what's new in MySQL Explain
Mydbops
 
Scale your database traffic with Read & Write split using MySQL Router
Mydbops
 
PostgreSQL Schema Changes with pg-osc - Mydbops @ PGConf India 2024
Mydbops
 
Choosing the Right Database: Exploring MySQL Alternatives for Modern Applicat...
Mydbops
 
Mastering Aurora PostgreSQL Clusters for Disaster Recovery
Mydbops
 
Navigating Transactions: ACID Complexity in Modern Databases- Mydbops Open So...
Mydbops
 
Ad

Recently uploaded (20)

PDF
Halide Perovskites’ Multifunctional Properties: Coordination Engineering, Coo...
TaameBerhe2
 
PPT
PPT2_Metal formingMECHANICALENGINEEIRNG .ppt
Praveen Kumar
 
PDF
International Journal of Information Technology Convergence and services (IJI...
ijitcsjournal4
 
PPTX
Worm gear strength and wear calculation as per standard VB Bhandari Databook.
shahveer210504
 
PPTX
VITEEE 2026 Exam Details , Important Dates
SonaliSingh127098
 
PPTX
The Role of Information Technology in Environmental Protectio....pptx
nallamillisriram
 
PDF
Basic_Concepts_in_Clinical_Biochemistry_2018كيمياء_عملي.pdf
AdelLoin
 
PDF
Reasons for the succes of MENARD PRESSUREMETER.pdf
majdiamz
 
PPT
Electrical Safety Presentation for Basics Learning
AliJaved79382
 
PDF
Introduction to Productivity and Quality
মোঃ ফুরকান উদ্দিন জুয়েল
 
PDF
PORTFOLIO Golam Kibria Khan — architect with a passion for thoughtful design...
MasumKhan59
 
PPTX
DATA BASE MANAGEMENT AND RELATIONAL DATA
gomathisankariv2
 
PDF
MAD Unit - 2 Activity and Fragment Management in Android (Diploma IT)
JappanMavani
 
PPTX
Product Development & DevelopmentLecture02.pptx
zeeshanwazir2
 
PPTX
Knowledge Representation : Semantic Networks
Amity University, Patna
 
PPTX
Arduino Based Gas Leakage Detector Project
CircuitDigest
 
PPTX
Introduction to Basic Renewable Energy.pptx
examcoordinatormesu
 
PDF
Design Thinking basics for Engineers.pdf
CMR University
 
PPT
Carmon_Remote Sensing GIS by Mahesh kumar
DhananjayM6
 
PDF
Pressure Measurement training for engineers and Technicians
AIESOLUTIONS
 
Halide Perovskites’ Multifunctional Properties: Coordination Engineering, Coo...
TaameBerhe2
 
PPT2_Metal formingMECHANICALENGINEEIRNG .ppt
Praveen Kumar
 
International Journal of Information Technology Convergence and services (IJI...
ijitcsjournal4
 
Worm gear strength and wear calculation as per standard VB Bhandari Databook.
shahveer210504
 
VITEEE 2026 Exam Details , Important Dates
SonaliSingh127098
 
The Role of Information Technology in Environmental Protectio....pptx
nallamillisriram
 
Basic_Concepts_in_Clinical_Biochemistry_2018كيمياء_عملي.pdf
AdelLoin
 
Reasons for the succes of MENARD PRESSUREMETER.pdf
majdiamz
 
Electrical Safety Presentation for Basics Learning
AliJaved79382
 
Introduction to Productivity and Quality
মোঃ ফুরকান উদ্দিন জুয়েল
 
PORTFOLIO Golam Kibria Khan — architect with a passion for thoughtful design...
MasumKhan59
 
DATA BASE MANAGEMENT AND RELATIONAL DATA
gomathisankariv2
 
MAD Unit - 2 Activity and Fragment Management in Android (Diploma IT)
JappanMavani
 
Product Development & DevelopmentLecture02.pptx
zeeshanwazir2
 
Knowledge Representation : Semantic Networks
Amity University, Patna
 
Arduino Based Gas Leakage Detector Project
CircuitDigest
 
Introduction to Basic Renewable Energy.pptx
examcoordinatormesu
 
Design Thinking basics for Engineers.pdf
CMR University
 
Carmon_Remote Sensing GIS by Mahesh kumar
DhananjayM6
 
Pressure Measurement training for engineers and Technicians
AIESOLUTIONS
 
Ad

MySQL shell and It's utilities - Praveen GR (Mydbops Team)

  • 1. MySQL shell and It's utilities Praveen GR Associate database consultant, Mydbops
  • 2. Services on top open source databases Founded in 2016 80 Member team Assisted over 500+ Customers AWS Partner and a PCI Certified Organisation About Mydbops
  • 3. Database Consulting Services Managed Database Services Focuses on Top Opensource database MySQL,MariaDB, MongoDB and PostgreSQL ON Premises and Cloud Mydbops Services
  • 4. About MySQL shell MySQL shell Utilities Upgrade Checker Utility Table Export Utility Parallel Table Import Utility Dump utility Dump Loading Utility JSON Import Utility Agenda
  • 6. MySQL shell is an addon utility JavaScript, Python and SQL Results - table, tabbed, vertical format, JSON MySQL Shell
  • 8. MySQL Shell Utilities Shell utility Backup Restore Other Table Export Utility Dump Utility Table Import Utility Dump Loading Utility JSON Import Utility Upgrade Checker Utility
  • 10. Avoid data corruption Unwanted downtime extention Safe migration with proper pre-checks Upgrade Checker Utility - Purpose
  • 11. Checks compatibility on server migration 5.7 to 8.0 Reserved keywords Supported variables (config - Shell 8.0.16 & global) Specific version check (Shell - 8.0.13) Upgrade Checker Utility
  • 12. targetVersion - MySQL version to check the compactibility for upgrade configPath - Config file path outputFormat - TEXT (Default), JSON Upgrade Checker Utility - Notable options
  • 15. Faster table export Controlled Export to avoid load Rough estimation on completion Table Export Utility - Purpose
  • 16. Table export with parallel thread Progress monitor Compression - None (Default), gzip, zstd Supported output format - CSV, TSV (Default) Output to local or oracle cloud infra Table Export Utility
  • 17. maxRate - bytes per second per thread  compression - gzip, zstd , none(default) dialect - Export format - csv|csv-unix|tsv Table Export Utility - Notable options
  • 20. Import the data with parallel thread Controlled import Replace the duplicate values of primary key/ unique Mutiple files at a time from different server Parallel Table Import Utility - Purpose
  • 21. Loading the table with a parallel thread Progress tracking Can restore compressed ( > Shell - 8.0.22 ) Restore multiple file to single table ( > Shell - 8.0.23 shell version) Option to avoid duplicate entry failure. Parallel Table Import Utility
  • 22. threads - No of thread for restoring maxRate - bytes per second per thread replaceDuplicates - Replace existing row of PK/UK (Default - yes) skipRows - Skip the no of row from the begining of file. Parallel Table Import Utility - Notable options
  • 23. Parallel Table Import Utility Syntax :
  • 24. Parallel Table Import Utility Duplicate entry :
  • 26. Dump Utility Instance dump Dump utility Schema dump Table dump
  • 27. Exporting the data with parallel thread Dry-run before exporting Compatability checks Default compression Dump utility - Purpose
  • 28. Object names in the instance or schema must be in the latin1 or utf8 characterset. Data consistency is guaranteed only for tables that use the InnoDB storage engine. Group Replication, primary keys are required on every table. Dump Utility - Notable requirement
  • 29. dryRun - Information about what will be dumped threads - Thread used to export data maxRate - The maximum number of bytes per second per thread. consistent - Lock the instance while taking backup chunking - Split the data for each table into multiple files compression - No , gzip , zstd (default) Dump Utility - Notable options
  • 30. Dump utility - Instance dump
  • 31. Dump utility - Schema dump
  • 32. Dump utility - Table dump
  • 34. Speed the restoration by a parallel thread. Ignore the index at the target to speed up restoration. Need to restore the only specified schema from the full dump. Dump loading utility - Purpose
  • 35. Restore the dump data with parallel thread ( > Shell - 8.0.21 ) Restore only the required table or schema Analyze table post restore Index creation post-restoration to boost loading (Default - Full text index) Dump loading utility
  • 36. threads - No.of thread used to restore the data backgroundThreads - No.of thread used to fetch data loadIndexes - Restore index at target (Default - true) deferTableIndexes - Index creation post restoration. Dump loading utility - Notable options
  • 39. Migration of Mongo DB to MySQL Create the table structure based on JSON JSON import Utility - Purpose
  • 40. Import both JSON and BJSON to MySQL ( > Shell - 8.0.13 ) Import to an existing table or new table The default column name is doc Auto conversion of BJSON to JSON ( > Shell - 8.0.14 ) JSON import Utility
  • 41. tableColumn - Columns need to be restored. convertBsonTypes - Convertion is required (Default - true) JSON import Utility - Notable options