Introduction to NoSQL with Couchbase
0 likes1,474 views
The document introduces Couchbase Server 2.0, a NoSQL document database. It discusses how relational databases do not scale well for growing applications, while NoSQL databases like Couchbase can scale out horizontally across commodity servers to meet increasing demand. Couchbase Server provides features like flexible JSON document data model, easy scalability, high performance, and always-on availability. It also shows the Couchbase Server architecture and how data is distributed and replicated across nodes in a cluster.
![Connect
to
the
cluster
var driver = require('couchbase');
dbConfiguration = {
"hosts": ["localhost:8091"],
"bucket": "ideas"
};
driver.connect(dbConfiguration, function(err, cb) {
if (err) {
throw (err)
}
// your application code here
}
Monday, June 17, 13](https://image.slidesharecdn.com/web5-couchbase-130617083006-phpapp01/85/Introduction-to-NoSQL-with-Couchbase-26-320.jpg)
![Calling
a
view
from
your
app
var queryParams = {
stale: false,
key : "meetup"
};
cb.view("my_views", "by_type", queryParams, function(err, view) {
var keys = new Array();
for (var i = 0; i < view.length; i++) {
keys.push(view[i].id);
}
cb.get(keys, null, function(errs, docs, metas) {
console.log(docs);
});
});
Monday, June 17, 13](https://image.slidesharecdn.com/web5-couchbase-130617083006-phpapp01/85/Introduction-to-NoSQL-with-Couchbase-31-320.jpg)
Introduction to NoSQL with Couchbase
- 1. Monday, June 17, 13
- 2. Introducing Couchbase Server 2.0 Tugdual Grall Technical Evangelist Monday, June 17, 13
- 3. About me... • Tugdual “Tug” Grall Couchbase • Technical Evangelist eXo • CTO Oracle • Developer/Product Manager Mainly Java/SOA Developer in consulDng firms • Web @tgrall hHp://blog.grallandco.com tgrall NantesJUG co-‐founder Pet Project : hHp://www.resultri.com Monday, June 17, 13
- 4. RDBMS are not Enough? Monday, June 17, 13
- 5. Growth is the New Reality • Instagram gained nearly 1 million users overnight when then expanded to Android Monday, June 17, 13
- 6. Draw Something Viral Growth 191715131197533/12826242220181614121082/6 Draw Something by OMGPOP Daily Ac)ve Users (millions) 21 2 4 6 8 10 12 14 16 Monday, June 17, 13
- 7. RDBMS is good for many thing, but hard to scale RDBMS Scales Up Get a bigger, more complex server Users ApplicaNon Scales Out Just add more commodity web servers Users System Cost ApplicaDon Performance RelaNonal Database Web/App Server Tier System Cost ApplicaDon Performance Won’t scale beyond this point How do you take this growth? Monday, June 17, 13
- 8. Web/App Server Tier Memcached Tier MySQL Tier Scaling out RDBMS • Run Many SQL Servers • Data could be shared Done by the applicaDon code • Caching for faster response Nme Monday, June 17, 13
- 9. Scaling out flaWens the cost and performance curves NoSQL Database Scales Out Cost and performance mirrors app Ner Users NoSQL Distributed Data Store Web/App Server Tier ApplicaNon Scales Out Just add more commodity web servers Users System Cost ApplicaDon Performance ApplicaDon Performance System Cost NoSQL Technology Scales Out Monday, June 17, 13
- 10. Building new database to answer the following requirementsNo schema required before inserDng dataNo schema change required to change data formatAuto-‐sharding without applicaDon parDcipaDonDistributed queriesIntegrated main memory cachingData synchronizaDon ( mulD-‐datacenter) Dynamo October 2007 Cassandra August 2008 Bigtable November 2006 Voldemort February 2009 Very few organizaNons want to (fewer can) build and maintain database so[ware technology. But every organizaNon building interacNve web applicaNons needs this technology. A New Technology? Monday, June 17, 13
- 11. Lack of flexibility/ rigid schemas Inability to scale out data Performance challenges Cost All of these Other 49% 35% 29% 16% 12% 11% What Is Biggest Data Management Problem Driving Use of NoSQL in Coming Year? Source: Couchbase Survey, December 2011, n = 1351. Monday, June 17, 13
- 12. NoSQL Catalog Key-‐Value Memcached Membase Redis Data Structure Document Column Graph MongoDB Couchbase Cassandra Cache (memory only) Database (memory/disk) Neo4j HBase InfiniteGraph Coherence Monday, June 17, 13
- 13. Couchbase Server NoSQL Document Database Monday, June 17, 13
- 14. Couchbase Open Source Project • Leading NoSQL database project focused on distributed database technology and surrounding ecosystem • Supports both key-‐value and document-‐ oriented use cases • All components are available under the Apache 2.0 Public License • Obtained as packaged soiware in both enterprise and community ediDons. Couchbase Open Source Project Monday, June 17, 13
- 15. Easy Scalability Consistent High Performance Always On 24x365 Grow cluster without applicaDon changes, without downDme with a single click Consistent sub-‐millisecond read and write response Dmes with consistent high throughput No downDme for soiware upgrades, hardware maintenance, etc. Flexible Data Model JSON document model with no fixed schema. Couchbase Server Monday, June 17, 13
- 16. Flexible Data Model • No need to worry about the database when changing your applicaDon • Records can have different structures, there is no fixed schema • Allows painless data model changes for rapid applicaDon development { “ID”: 1, “FIRST”: “DipN”, “LAST”: “Borkar”, “ZIP”: “94040”, “CITY”: “MV”, “STATE”: “CA” } JSON JSON JSON JSON Monday, June 17, 13
- 17. AddiDonal Couchbase Server Features Built-‐in clustering – All nodes equal Data replicaDon with auto-‐failover Zero-‐downDme maintenance Built-‐in managed cached Append-‐only storage layer Online compacDon Monitoring and admin API & UI SDK for a variety of languages Monday, June 17, 13
- 18. Market AdopDon – Customers Internet Companies Enterprises Monday, June 17, 13
- 19. Heartbeat Process monitor Global singleton supervisor ConfiguraDon manager on each node Rebalance orchestrator Node health monitor one per cluster vBucket state and replicaDon manager hFp REST management API/Web UI HTTP 8091 Erlang port mapper 4369 Distributed Erlang 21100 -‐ 21199 Erlang/OTP storage interface Couchbase EP Engine 11210 Memcapable 2.0 Moxi 11211 Memcapable 1.0 Memcached New Persistence Layer 8092 Query API Query Engine Data Manager Cluster Manager Couchbase Server Architecture Monday, June 17, 13
- 20. Heartbeat Process monitor Global singleton supervisor ConfiguraDon manager on each node Rebalance orchestrator Node health monitor one per cluster vBucket state and replicaDon manager hFp REST management API/Web UI HTTP 8091 Erlang port mapper 4369 Distributed Erlang 21100 -‐ 21199 Erlang/OTP storage interface Couchbase EP Engine 11210 Memcapable 2.0 Moxi 11211 Memcapable 1.0 Memcached New Persistence Layer 8092 Query API Query Engine Couchbase Server Architecture Monday, June 17, 13
- 21. Couchbase OperaDons Monday, June 17, 13
- 22. 33 2 Single node -‐ Couchbase Write OperaDon Managed Cache Disk Queue Disk ReplicaDon Queue App Server Couchbase Server Node Doc 1Doc 1 Doc 1 To other node Monday, June 17, 13
- 23. COUCHBASE SERVER CLUSTER Basic OperaDon • Docs distributed evenly across servers • Each server stores both acPve and replica docs Only one server acDve at a Dme • Client library provides app with simple interface to database • Cluster map provides map to which server doc is on App never needs to know • App reads, writes, updates docs • MulPple app servers can access same document at same Pme User Configured Replica Count = 1 READ/WRITE/UPDATE ACTIVE SERVER 1 ACTIVE Doc 4 Doc 7 Doc Doc Doc SERVER 2 Doc 8 ACTIVE Doc 1 Doc 2 Doc Doc Doc REPLICA Doc 4 Doc 1 Doc 8 Doc Doc Doc REPLICA Doc 6 Doc 3 Doc 2 Doc Doc Doc REPLICA Doc 7 Doc 9 Doc 5 Doc Doc Doc SERVER 3 Doc 6 Doc 5 Doc 2 Doc Doc DocDoc 9 APP SERVER 1 COUCHBASE Client Library CLUSTER MAP COUCHBASE Client Library CLUSTER MAP APP SERVER 2 Monday, June 17, 13
- 25. NPM { "name": "my-node-application", "version": "1.0.0", "private": true, "dependencies": { "express": "3.x", "couchbase": "0.0.12", "ejs": ">= 0.0.1" } } Monday, June 17, 13
- 26. Connect to the cluster var driver = require('couchbase'); dbConfiguration = { "hosts": ["localhost:8091"], "bucket": "ideas" }; driver.connect(dbConfiguration, function(err, cb) { if (err) { throw (err) } // your application code here } Monday, June 17, 13
- 27. Insert Data var meetup = {"type" : "meetup", "language" : "javascript"}; cb.set("web5",meetup, function(err, meta) {}); var tmp = {"message" : "hello world!"}; cb.set("tmp", tmp, {"expiry" : 5},function(err, meta) {}); Monday, June 17, 13
- 28. Insert / Delete Data var meetup = {"type" : "meetup", "language" : "javascript"}; cb.set("barcelonajs",meetup, function(err, meta) {}); var tmp = {"message" : "hello world!"}; cb.set("tmp", tmp, {"expiry" : 5},function(err, meta) {}); cb.set("todelete", tmp, function(err, meta) {}); cb.remove("todelete", function(err, meta) {}); Monday, June 17, 13
- 29. Retrieve the Data cb.get("product:45", function(errs, doc, metas) { console.log("=== get the document ==="); console.log( doc ); }); var keys = new Array(); keys.push("product:1"); keys.push("product:45"); keys.push("product:65"); keys.push("product:80"); cb.get(keys, null, function(errs, docs, metas) { console.log("n=== get List of documents ==="); console.log( docs ); }); Monday, June 17, 13
- 30. Retrieve the Data What if I want all products or meetups? key : barcelonajs { "type": "meetup", "language": "javascript" } key : product:10 { "type": "product", "name": "Product with id 10" } Monday, June 17, 13
- 31. Calling a view from your app var queryParams = { stale: false, key : "meetup" }; cb.view("my_views", "by_type", queryParams, function(err, view) { var keys = new Array(); for (var i = 0; i < view.length; i++) { keys.push(view[i].id); } cb.get(keys, null, function(errs, docs, metas) { console.log(docs); }); }); Monday, June 17, 13
- 32. Demo Time Monday, June 17, 13
- 33. www.couchbase.com/download Couchbase Server Monday, June 17, 13
- 34. Q & A Monday, June 17, 13
- 35. Thank you! [email protected] @tgrall Get Couchbase Server at hHp://www.couchbase.com/download Monday, June 17, 13
- 36. Monday, June 17, 13