BigchainDB: A Scalable Blockchain Database, In Python
2 likes973 views
This document introduces BigchainDB, a scalable blockchain database built using Python. BigchainDB takes a "blockchain-ify big data" approach by leveraging existing big data database techniques like Paxos to provide performance, while adding blockchain characteristics like decentralization, immutability, and digital assets. It uses a federated voting system across nodes to validate transactions in blocks for speed and scalability. Benchmarks show it can process thousands of writes per second across dozens of nodes. Examples of potential use cases include supply chain tracking for diamonds, energy, and medical journals.
BigchainDB: A Scalable Blockchain Database, In Python
- 1. BigchainDB: A Scalable Blockchain Database, In Python Trent McConaghy
- 4. Processing File System Database Applications The modern cloud application stack
- 5. “Magic Internet Money” Along came Bitcoin…
- 6. Processing File System Decentralized “Database” Partly-Decentralized Applications Bitcoin sparked a revolution Truly own digital assets, supply chain visibility, ….
- 7. What about planetary scale? 1.5 tx/s 50GB
- 8. Planetary scale: Netflix uses 37% of Internet bandwidth
- 9. “Big data” Distributed DBs http://1.bp.blogspot.com/-ZFtW7MFMqZQ/TrG5ujuDGdI/AAAAAAAAAWw/heceeMD50x4/s1600/scale.png Planetary scale: Netflix uses 37% of Internet bandwidth Writes / s vs. # nodes
- 10. To be Distributed, Big Data DBs Must Solve Consensus Byzantine Consensus (1982) Paxos (1990/1998) https://medium.com/the-bigchaindb-blog/the-writings-of-leslie-lamport-abridged-a67df77f464#.1lr34qt6s http://the-paper-trail.org/blog/consensus-protocols-paxos/
- 11. Two ways to scale up Big data-fy the blockchain • Builds on man-decades of work • Significant scalability hurdles? <or> Blockchain-ify big data • Builds on man-centuries (millennia?) of work • Scalability challenges already resolved • How to blockchain-ify? …
- 12. “Blockchain-ify” Decentralization: no single entity owns or controls Immutability: tamper-resistant Assets: Can issue & transfer assets Blockchain (noun): hashed-together chain of blocks (1991!) Blockchain (noun): storage that is decentralized + immutable + assets Blockchain (adj): decentralized + immutable + assets
- 14. How to Blockchain-ify Big Data Retain Big Data DB’s Performance • Let the Paxos derivative solve order. Get out of its way! • It naturally builds a log of all txs Add in blockchain characteristics • Decentralization: federation voting on txs. Group into blocks for speed. • Immutability: hash on prev. blocks • Assets: Digital signatures etc.
- 15. System Arch BigchainDB Federation RethinkDB Cluster Alice Bob ★ RethinkDB handles intra-cluster communication ★ BigchainDB Nodes accept new transactions via an API ★ BigchainDB Nodes bundle transactions in blocks and validate them
- 16. Two Tables Transaction set S (“backlog”) Block chain C txs when a signing node creates a new block txs when a block has invalid transactions tx G tx A tx L tx H tx E tx C tx D S1 S2 S3 S C null tx tx G B1 B2 tx L tx A tx H B2 tx E (genesis block)
- 17. Benchmarks 1/2 Storage: SSD Nodes: 32 EC2 instance: c3.8xlarge Cores: 32 Network: 10Gbps www.bigchaindb.com/whitepaper
- 18. Writes / s vs. # nodes Benchmarks 2/2 www.bigchaindb.com/whitepaper
- 20. Immutability Decentralized control Assets High Throughput Low Latency High Capacity Rich Permissioning Big Data Query Capabilities Traditional blockchains
- 21. User: Vertical: Diamond Supply Chain Value prop: identify & prevent fraud. 7-40% in $80B industry
- 22. User: Vertical: Energy Supply Chain Value prop: manage $ flow in energy deregulation
- 23. User: Vertical: Medical Journals / Supply Chain Value prop: government- mandated transparent $ flow
- 24. Users: ascribe.io, 5000 artists, 25 marketplaces & non-profits Value Props: secure provenance in $64B art industry, IP mgmt. Verticals: Art Supply Chain, Intellectual Property
- 25. PYTHON & USAGE
- 36. Decentralization of the Cloud Proc’ing FS Dec. DB Partly Dec. Apps Proc’ing FS DB Apps Dec. Proc’ing Dec. FS Dec. DB Dec. Apps Centralized Partly Decentralized Fully Decentralized
- 37. BigchainDB: A Scalable Blockchain Database, In Python bigchaindb.com bigchaindb.readthedocs.org github.com/bigchaindb