SlideShare a Scribd company logo
Virtualizing and Scaling
                          for the Future




Tuesday, March 29, 2011
Who am I?
                          Was Director of Architecture for MySQL


                          Founder/CTO Data Differential




                                            Drizzle
                                           Gearman
                                         Memcached
Tuesday, March 29, 2011
In the beginning...



Tuesday, March 29, 2011
• 2008 Sun buys MySQL
                    • 2008 Drizzle forks from MySQL
                    • 2009 Oracle buys Sun
                    • 2010 Drizzle Developers split from Oracle
                    • 2011 First GA Release, Drizzle7

Tuesday, March 29, 2011
Drizzle

                    • Entirely Open Source RDBMS
                    • C++, with a MicroKernel Design
                    • No Gotchas


Tuesday, March 29, 2011
Drizzle7
                          (Quick Update)




Tuesday, March 29, 2011
Today’s Pluggable
                             Interfaces
                    • Replication      • Table Functions
                    • Storage Engine   • Functions
                    • Logging          • Protocol
                    • Authentication   • Query Rewrite
                    • Authorization    • XA

Tuesday, March 29, 2011
HTTP                       Replication
                                         Client            Client
     Cloud Service            Client



                             HTTP Blob          MySQL         Drizzle
                             Streaming
                                                        SQL



                                 Listener
                                                              Logging
         Query Memcached           Parser
              Cache

                                 Optimizer
                Memcached                               Error Reporting
                                Executioner

                   Gearman     Storage System
                                                        MicroKernel

Tuesday, March 29, 2011
Replication

                    • Google Protocol Buffer Based
                    • Replicates row transformations.
                    • Integrates today with RabbitMQ, Casandra.
                          Memcached, Gearman




Tuesday, March 29, 2011
INSERT


                          INSERT
       Stored
   Transactionally
                          UPDATE


                          INSERT



Tuesday, March 29, 2011
Slave




                          Master   Slave




                                   Slave

Tuesday, March 29, 2011
Slave




                          Master   Slave




                                   Slave

Tuesday, March 29, 2011
Master




                          Master   Master




                                   Master


Tuesday, March 29, 2011
What group commit
                              problem?



Tuesday, March 29, 2011
Group Commit?
                                     Transaction
                                         Log

                          Database
                           Kernel


                                       Binlog


Tuesday, March 29, 2011
No Group Commit
                              Required

                          Database   Transaction
                           Kernel        Log




Tuesday, March 29, 2011
libDrizzle

                    • Supports Drizzle (and MySQL, and SQLite)
                    • Asynchronous
                    • BSD
                    • Lawyer free

Tuesday, March 29, 2011
NoSQL Stream Access
             Amazon S3      Client




                           Instance



                            Storage

Tuesday, March 29, 2011
Is there more?



Tuesday, March 29, 2011
No Gotchas

                    • No NULL when you don’t want NULL
                    • No ALTER TABLES that fake’ it
                    • Real datetime (64bit), with microseconds
                    • IPV6
                    • No updates that “half complete”

Tuesday, March 29, 2011
Authentication/
                          Authorization

                    • No Cost Authentication
                    • PAM, LDAP, HTTP


Tuesday, March 29, 2011
Table Functions

                   • TABLE_CACHE
                   • TABLE_DEFINITION_CACHE
                   • SHOW TEMPORARY TABLES
                   • All new SQL compliant information_schema

Tuesday, March 29, 2011
Data Dictionay

                    • Separate Information Schema for ANSI SQL
                          access.
                    • All based on Table Functions
                    • No Materialization
                    • Single Execution Path

Tuesday, March 29, 2011
Интернет является UTF-8.

                               Web UTF - 8

                            The Web is UTF-8.


Tuesday, March 29, 2011
How about locks?



Tuesday, March 29, 2011
SHOW PROCESSLIST
                          (now based on table functions)




Tuesday, March 29, 2011
--skip-grants
                          (none of the current GRANTs require LOCKS
                                            actually…)




Tuesday, March 29, 2011
store_lock()
                          (all engines are not created equally)




Tuesday, March 29, 2011
120+ Developers Since
                        Day One
                          26/36 on average each month




Tuesday, March 29, 2011
Drizzle 7+



Tuesday, March 29, 2011
Table                       Table

                 Schema   Table              Schema   Table

                          Table                       Table
                                   Users
                          Table                       Table

                 Schema   Table              Schema   Table

                          Table                       Table


                                  Instance
Tuesday, March 29, 2011
Users                         Users


                            Table                       Table

                   Schema   Table              Schema   Table

                            Table                       Table




                                    Instance
Tuesday, March 29, 2011
• Cuts the 30/40% hit from virtualizing
                    • Single instance maintenance
                    • Still allows for IO spread on San/NAS


Tuesday, March 29, 2011
Hot Backup

                    • Supports Partial Backup
                    • No locking
                    • Single solution, point-in-time recovery in a
                          single solution.
                    • Comes with the database.

Tuesday, March 29, 2011
http://drizzle.org
                          http://planetdrizzle.org
                          Freenode #drizzle


Tuesday, March 29, 2011

More Related Content

PDF
Java桌面应用开发
Gump Law
 
PDF
Ruby hollywood
ehuard
 
PDF
Ruby goes to hollywood
ehuard
 
PPT
LinuxCon Keynote
Brian Aker
 
PPT
Gearmam, from the_worker's_perspective copy
Brian Aker
 
PPT
Oscon keynote 2012
Brian Aker
 
PDF
Ptp overview
Bhekumuzi Xaba
 
PPT
Drizzle Keynote from O'Reilly's MySQL's Conference
Brian Aker
 
Java桌面应用开发
Gump Law
 
Ruby hollywood
ehuard
 
Ruby goes to hollywood
ehuard
 
LinuxCon Keynote
Brian Aker
 
Gearmam, from the_worker's_perspective copy
Brian Aker
 
Oscon keynote 2012
Brian Aker
 
Ptp overview
Bhekumuzi Xaba
 
Drizzle Keynote from O'Reilly's MySQL's Conference
Brian Aker
 

Similar to Drizzle 7.0, Future of Virtualizing (20)

PDF
Persistence Smoothie
Michael Bleigh
 
PDF
Rooted 2011 nosql security
Jose Palanco
 
PDF
AFCEA C4I Symposium: The 4th C in C4I Stands for Cloud:Factors Driving Adopti...
Patrick Chanezon
 
PDF
Games for the Masses (QCon London 2012)
Wooga
 
PDF
Froscon2011: How i learned to use sql and then learned not to use it
Henrik Ingo
 
PDF
Databases and the Cloud
Henrik Ingo
 
PDF
Cassandra at Morningstar (Feb 2011)
jeremiahdjordan
 
PDF
NoSQL - Post-Relational Databases - BarCamp Ruhr3
Jonathan Weiss
 
PDF
2011 June - Singapore GTUG presentation. App Engine program update + intro to Go
ikailan
 
PDF
P90 X Your Database!!
Denish Patel
 
PDF
Alternative Databases
Scott MacVicar
 
PDF
No sql findings
Christian van der Leeden
 
PPTX
Nosql
Brandon Byars
 
PDF
Scaling GIS Data in Non-relational Data Stores
Mike Malone
 
PDF
No SQL - BarCamp Nürnberg 2010
Jonathan Weiss
 
PPTX
DataStax C*ollege Credit: What and Why NoSQL?
DataStax
 
PDF
オープンソース開発者がDeNAを選ぶ理由
Kazuho Oku
 
PDF
Cassandra EU 2012 - CQL: Then, Now and When by Eric Evans
Acunu
 
PDF
Redis and Groovy and Grails - gr8conf 2011
Ted Naleid
 
Persistence Smoothie
Michael Bleigh
 
Rooted 2011 nosql security
Jose Palanco
 
AFCEA C4I Symposium: The 4th C in C4I Stands for Cloud:Factors Driving Adopti...
Patrick Chanezon
 
Games for the Masses (QCon London 2012)
Wooga
 
Froscon2011: How i learned to use sql and then learned not to use it
Henrik Ingo
 
Databases and the Cloud
Henrik Ingo
 
Cassandra at Morningstar (Feb 2011)
jeremiahdjordan
 
NoSQL - Post-Relational Databases - BarCamp Ruhr3
Jonathan Weiss
 
2011 June - Singapore GTUG presentation. App Engine program update + intro to Go
ikailan
 
P90 X Your Database!!
Denish Patel
 
Alternative Databases
Scott MacVicar
 
No sql findings
Christian van der Leeden
 
Scaling GIS Data in Non-relational Data Stores
Mike Malone
 
No SQL - BarCamp Nürnberg 2010
Jonathan Weiss
 
DataStax C*ollege Credit: What and Why NoSQL?
DataStax
 
オープンソース開発者がDeNAを選ぶ理由
Kazuho Oku
 
Cassandra EU 2012 - CQL: Then, Now and When by Eric Evans
Acunu
 
Redis and Groovy and Grails - gr8conf 2011
Ted Naleid
 
Ad

More from Brian Aker (7)

PPT
Gearmam, from the_worker's_perspective copy
Brian Aker
 
PDF
Gearman, from the worker's perspective
Brian Aker
 
PDF
Tricking out your Memcached Setup
Brian Aker
 
PPT
Drizzle Keynote at the MySQL User's Conference
Brian Aker
 
PPT
Drizzle @OpenSQL Camp
Brian Aker
 
PPT
No SQL Talk
Brian Aker
 
PDF
Drizzle Talk
Brian Aker
 
Gearmam, from the_worker's_perspective copy
Brian Aker
 
Gearman, from the worker's perspective
Brian Aker
 
Tricking out your Memcached Setup
Brian Aker
 
Drizzle Keynote at the MySQL User's Conference
Brian Aker
 
Drizzle @OpenSQL Camp
Brian Aker
 
No SQL Talk
Brian Aker
 
Drizzle Talk
Brian Aker
 
Ad

Recently uploaded (20)

PDF
Orbitly Pitch Deck|A Mission-Driven Platform for Side Project Collaboration (...
zz41354899
 
PPTX
cloud computing vai.pptx for the project
vaibhavdobariyal79
 
PDF
Structs to JSON: How Go Powers REST APIs
Emily Achieng
 
PDF
OFFOFFBOX™ – A New Era for African Film | Startup Presentation
ambaicciwalkerbrian
 
PPTX
AI in Daily Life: How Artificial Intelligence Helps Us Every Day
vanshrpatil7
 
PDF
Responsible AI and AI Ethics - By Sylvester Ebhonu
Sylvester Ebhonu
 
PDF
AI-Cloud-Business-Management-Platforms-The-Key-to-Efficiency-Growth.pdf
Artjoker Software Development Company
 
PDF
CIFDAQ's Market Wrap : Bears Back in Control?
CIFDAQ
 
PDF
NewMind AI Weekly Chronicles - July'25 - Week IV
NewMind AI
 
PDF
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
 
PDF
Brief History of Internet - Early Days of Internet
sutharharshit158
 
PDF
Economic Impact of Data Centres to the Malaysian Economy
flintglobalapac
 
PDF
A Strategic Analysis of the MVNO Wave in Emerging Markets.pdf
IPLOOK Networks
 
PDF
AI Unleashed - Shaping the Future -Starting Today - AIOUG Yatra 2025 - For Co...
Sandesh Rao
 
PDF
Oracle AI Vector Search- Getting Started and what's new in 2025- AIOUG Yatra ...
Sandesh Rao
 
PDF
GDG Cloud Munich - Intro - Luiz Carneiro - #BuildWithAI - July - Abdel.pdf
Luiz Carneiro
 
PPTX
Agile Chennai 18-19 July 2025 Ideathon | AI Powered Microfinance Literacy Gui...
AgileNetwork
 
PDF
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
PDF
Tea4chat - another LLM Project by Kerem Atam
a0m0rajab1
 
PDF
MASTERDECK GRAPHSUMMIT SYDNEY (Public).pdf
Neo4j
 
Orbitly Pitch Deck|A Mission-Driven Platform for Side Project Collaboration (...
zz41354899
 
cloud computing vai.pptx for the project
vaibhavdobariyal79
 
Structs to JSON: How Go Powers REST APIs
Emily Achieng
 
OFFOFFBOX™ – A New Era for African Film | Startup Presentation
ambaicciwalkerbrian
 
AI in Daily Life: How Artificial Intelligence Helps Us Every Day
vanshrpatil7
 
Responsible AI and AI Ethics - By Sylvester Ebhonu
Sylvester Ebhonu
 
AI-Cloud-Business-Management-Platforms-The-Key-to-Efficiency-Growth.pdf
Artjoker Software Development Company
 
CIFDAQ's Market Wrap : Bears Back in Control?
CIFDAQ
 
NewMind AI Weekly Chronicles - July'25 - Week IV
NewMind AI
 
Research-Fundamentals-and-Topic-Development.pdf
ayesha butalia
 
Brief History of Internet - Early Days of Internet
sutharharshit158
 
Economic Impact of Data Centres to the Malaysian Economy
flintglobalapac
 
A Strategic Analysis of the MVNO Wave in Emerging Markets.pdf
IPLOOK Networks
 
AI Unleashed - Shaping the Future -Starting Today - AIOUG Yatra 2025 - For Co...
Sandesh Rao
 
Oracle AI Vector Search- Getting Started and what's new in 2025- AIOUG Yatra ...
Sandesh Rao
 
GDG Cloud Munich - Intro - Luiz Carneiro - #BuildWithAI - July - Abdel.pdf
Luiz Carneiro
 
Agile Chennai 18-19 July 2025 Ideathon | AI Powered Microfinance Literacy Gui...
AgileNetwork
 
Automating ArcGIS Content Discovery with FME: A Real World Use Case
Safe Software
 
Tea4chat - another LLM Project by Kerem Atam
a0m0rajab1
 
MASTERDECK GRAPHSUMMIT SYDNEY (Public).pdf
Neo4j
 

Drizzle 7.0, Future of Virtualizing

  • 1. Virtualizing and Scaling for the Future Tuesday, March 29, 2011
  • 2. Who am I? Was Director of Architecture for MySQL Founder/CTO Data Differential Drizzle Gearman Memcached Tuesday, March 29, 2011
  • 4. • 2008 Sun buys MySQL • 2008 Drizzle forks from MySQL • 2009 Oracle buys Sun • 2010 Drizzle Developers split from Oracle • 2011 First GA Release, Drizzle7 Tuesday, March 29, 2011
  • 5. Drizzle • Entirely Open Source RDBMS • C++, with a MicroKernel Design • No Gotchas Tuesday, March 29, 2011
  • 6. Drizzle7 (Quick Update) Tuesday, March 29, 2011
  • 7. Today’s Pluggable Interfaces • Replication • Table Functions • Storage Engine • Functions • Logging • Protocol • Authentication • Query Rewrite • Authorization • XA Tuesday, March 29, 2011
  • 8. HTTP Replication Client Client Cloud Service Client HTTP Blob MySQL Drizzle Streaming SQL Listener Logging Query Memcached Parser Cache Optimizer Memcached Error Reporting Executioner Gearman Storage System MicroKernel Tuesday, March 29, 2011
  • 9. Replication • Google Protocol Buffer Based • Replicates row transformations. • Integrates today with RabbitMQ, Casandra. Memcached, Gearman Tuesday, March 29, 2011
  • 10. INSERT INSERT Stored Transactionally UPDATE INSERT Tuesday, March 29, 2011
  • 11. Slave Master Slave Slave Tuesday, March 29, 2011
  • 12. Slave Master Slave Slave Tuesday, March 29, 2011
  • 13. Master Master Master Master Tuesday, March 29, 2011
  • 14. What group commit problem? Tuesday, March 29, 2011
  • 15. Group Commit? Transaction Log Database Kernel Binlog Tuesday, March 29, 2011
  • 16. No Group Commit Required Database Transaction Kernel Log Tuesday, March 29, 2011
  • 17. libDrizzle • Supports Drizzle (and MySQL, and SQLite) • Asynchronous • BSD • Lawyer free Tuesday, March 29, 2011
  • 18. NoSQL Stream Access Amazon S3 Client Instance Storage Tuesday, March 29, 2011
  • 19. Is there more? Tuesday, March 29, 2011
  • 20. No Gotchas • No NULL when you don’t want NULL • No ALTER TABLES that fake’ it • Real datetime (64bit), with microseconds • IPV6 • No updates that “half complete” Tuesday, March 29, 2011
  • 21. Authentication/ Authorization • No Cost Authentication • PAM, LDAP, HTTP Tuesday, March 29, 2011
  • 22. Table Functions • TABLE_CACHE • TABLE_DEFINITION_CACHE • SHOW TEMPORARY TABLES • All new SQL compliant information_schema Tuesday, March 29, 2011
  • 23. Data Dictionay • Separate Information Schema for ANSI SQL access. • All based on Table Functions • No Materialization • Single Execution Path Tuesday, March 29, 2011
  • 24. Интернет является UTF-8. Web UTF - 8 The Web is UTF-8. Tuesday, March 29, 2011
  • 25. How about locks? Tuesday, March 29, 2011
  • 26. SHOW PROCESSLIST (now based on table functions) Tuesday, March 29, 2011
  • 27. --skip-grants (none of the current GRANTs require LOCKS actually…) Tuesday, March 29, 2011
  • 28. store_lock() (all engines are not created equally) Tuesday, March 29, 2011
  • 29. 120+ Developers Since Day One 26/36 on average each month Tuesday, March 29, 2011
  • 31. Table Table Schema Table Schema Table Table Table Users Table Table Schema Table Schema Table Table Table Instance Tuesday, March 29, 2011
  • 32. Users Users Table Table Schema Table Schema Table Table Table Instance Tuesday, March 29, 2011
  • 33. • Cuts the 30/40% hit from virtualizing • Single instance maintenance • Still allows for IO spread on San/NAS Tuesday, March 29, 2011
  • 34. Hot Backup • Supports Partial Backup • No locking • Single solution, point-in-time recovery in a single solution. • Comes with the database. Tuesday, March 29, 2011
  • 35. http://drizzle.org http://planetdrizzle.org Freenode #drizzle Tuesday, March 29, 2011