Oracle NoSQL Database release 3.0 overview

NoSQL Databases
Robert Greene, Anuj Sahni,
Product Management

The following is intended to outline our general product direction. It is intended
for information purposes only, and may not be incorporated into any contract.
It is not a commitment to deliver any material, code, or functionality, and should
not be relied upon in making purchasing decisions. The development, release,
and timing of any features or functionality described for Oracle’s products
remains at the sole discretion of Oracle.

NoSQL – in the eyes of the Oracle
Key-Value
Graph
Fundamentals

Design drivers
Systems
Friendly
Usability
Scalability
Predictably
Responsive
NoSQL – in the eyes of the Oracle

Systems Friendly
 Data Collaborations
– Orchestrating
– Monitoring
– Process and/or
Data movement
Eventing
NoSQL
HDFS
RDBMS
Useful Services
Cache

 OEP for event-driven &
streaming applications
 Oracle NoSQL DB accessed
from KV Cartridge
 NoSQL DB data directly
accessible via CQL queries
Features
NoSQL DB and Event Processing

Integration with RDF
RDF Use Cases
• Unified content metadata
for federated resources
• Validate semantic and
structural consistency
Social Media
Analysis
 Analyze social relations
using curated metadata
- Blogs, wikis, video
- Calendars, IM, voice
Semantic
Metadata Layer
 Find related content &
relations by navigating
connected entities
 “Reason” across entities
Text Mining &
Entity Analytics

Commodity Servers
NoSQL DB Driver
Processing Application
Data
Connector
Servers
Big Data
Acquisition
Real Time Access

Engineered Systems
NoSQL DB Driver
Processing Application
HDFS, Hadoop, CDH
Map Reduce
ORCH ‐ Stats
Map Reduce
Hive ‐ Activities
Map Reduce
Pig ‐ Sessionize
Big Data
Acquisition
Batch Processing
Big Data Appliance
Big Data
Acquisition
Real Time Access
Data
Connector

Usability– Major/Minor KV Paradigm
User mailbox data
Key Space : /user/id/-/folder/inbox/arrival date
/user/id/-/folder/deleted/arrival date
Value : {
“name" : "Email",
"namespace" : "com.companyX.email.avro",
"type" : "record",
"fields": [
{"name": "from", "type": "string", "default": ""},
{"name": "to", "type": "string", "default": ""},
{"name": "sender", "type": "string", "default": ""},
{"name": "cc", "type": "string", "default": ""},
{"name": "subject", "type": "string", "default": ""},
{“name”: “msgBody”, “type”: “string”, “default”: “”} ] }

Dev Usability– Modeled as Nested Tables
User mailbox data
UserID Folder
Name
Arrival
Date
From To Sender CC Subject Msg
Body
Parent Table Name: User
Major Key
Inherited from parent table
Primary Key “Value”
UserID Primary Key
Major Key
Child Table Name: Folder

 SNMP (Enterprise Edition Only)
– MIBs in SNMPv2 format
– Storage node SNMP agent – admin and rep nodes
– Performance metrics – Via polling
– Service change events – Via traps or polling
– Notifications (Traps) – Latency and throughput limits
 OEM Integrated for holistic RDBMS / NoSQL Monitoring
Standard Protocol Support
Admin Usability - Enterprise Manager Integration

 We did do it!
 Admin commands available to
describe safe upgrade order
 Scripted available hands-free
upgrade experience
 Read/Write availability throughout
the upgrade process
What’s the Big Deal
Admin Usability – Online Rolling Upgrades
0
2.5
5
7.5
10
12.5
15
17.5
72 (24x3) 144 (48x3) 216 (72x3)
TimetoUpgrade(min)
Total Nodes (Shards x Rep. Factor)
Online Rolling Upgrade
Ever tried to upgrade a 200 node system while it’s active?

Scalability Architecture – Applications View
 Elastic Shards
(split, add, contract)
Store
Partition
M
Partition
M
R
Partition
M
R R
Application
NoSQL Driver
R R
R
 Writes to elected
node
 Reads from any
node in system

 Increase Data Capacity
– Add more storage nodes
– New shards automatically created
 Increase Data Throughput
– More shards = better write
throughput
– More replicas/shard = better read
throughput
Smart Topology NoSQL DB Driver
Application
Master
Replica
Replica
StorageNode StorageNode StorageNode
Shard-1
Master
Replica
Replica
Shard-2
Scalability– Elastic Cluster Expansion

 Supports heterogeneous
storage topology
 Replicas move from over-
utilized to under-utilized storage
nodes
 Number of shards and
replication factor remain
unchanged
Improve Performance
Scalability - Rebalance an Unbalanced Store
Storage Node 1 Storage Node 2 Storage Node 3
Represents a vnode

 1.6 billion records
 94K insert/sec
 25K read/update/sec
 Low latency
 Linear scalability
YCSB – Benchmark Commodity Servers

• Twitter sees ~500M tweets/day
• This is 350K a minute
• Capture twitter activity with 3
commodity servers
• 1.25M ops/sec
• 2 billion records
• 2 TB of data
• 95% read, 5% update
• Low latency, High Scalability
YCSB - Benchmarking with SSD’s
0
1
2
3
4
0
200,000
400,000
600,000
800,000
1,000,000
1,200,000
1,400,000
6 (2x3) 12 (4x3) 24 (8x3) 30 (10x3)
AverageLatency(ms)
Throughput(ops/sec)
Cluster Size ( 3->15 servers )
Mixed Throughput
Throughput (ops/sec) Write Latency (ms)
Read Latency (ms)

YCSB – Benchmarking Predictability
Oracle NoSQL Database: Designed for Predictability
0
1
2
3
4
5
6
7
8
0
10,000
20,000
30,000
40,000
50,000
60,000
70,000
80,000
144
(48x3)
20% 40% 60% 80% 216
(72x3)
216*
(72x3)
AverageLatency(ms)
Throughput(ops/sec)
Nodes (Shards x RF)
95/5 Read/Update Throughput
Throughput (ops/sec) Read Latency (ms) Update Latency (ms)

 Simple Key-Value Data Model
 Horizontally Scalable
 Highly Available
 Elastic Configuration
 ACID Transactions
 Simple administration
 Transparent load balancing
 Commercial grade software and support
 Secondary Indexing
 Authentication / SSL Security
 Data Center support
Features
Oracle NoSQL Database
Scalable, Highly Available, Key-Value Database
Application
Storage Nodes
Datacenter B
Storage Nodes
Datacenter A
Application
NoSQL DB Driver
Application
NoSQL DB Driver
Application

Oracle NoSQL Database Subscription Model
 Oracle NoSQL Database Community Edition
– Open Source AGPL Edition
 Support is now available for Community Edition
– Price is $2,000/year per server
– No upfront license fee
– Provides for full Oracle support policy response
– Purchase online via the Oracle Store
 Offers affordable support option for startups
 Provides Oracle expertise for production deployment
New business-friendly support service
The Store
https://shop.oracle.com/

Oracle NoSQL DB Licensing
 Enterprise Edition
– Closed Source. Standard Oracle License.
 Community Edition has all of the basic
functionality and APIs. Gets you started.
 Enterprise Edition for large, production,
multi-data center, Oracle integration-
centric customers and/or non-GPL
compliant customers.
Community -or- Enterprise Edition

Oracle NoSQL DB Resources
 NoSQL DB Use Cases, White Papers, Data Sheets, Benchmarks
http://www.oracle.com/technetwork/products/nosqldb/overview/index.html
 NoSQL DB Documentation
http://www.oracle.com/technetwork/products/nosqldb/documentation/index.html
 NoSQL DB Downloads
http://www.oracle.com/technetwork/products/nosqldb/downloads/index.html
 NoSQL DB OTN Forum
http://forums.oracle.com/forums/forum.jspa?forumID=1388
 OU Training Classes
http://bit.ly/V5qbmY
 Great Application Development article on OTN:
http://www.oracle.com/technetwork/articles/bigdata/oracle-nosqldb-appdev-1891870.html

Oracle NoSQL Database release 3.0 overview

More Related Content

What's hot (20)

Similar to Oracle NoSQL Database release 3.0 overview (20)

More from Paulo Fagundes (10)

Recently uploaded (20)

Oracle NoSQL Database release 3.0 overview