RDM#2- The Distributed Web
5 likes974 views
The document discusses the Lisbon Research & Development Meetup and focuses on topics related to the distributed web, machine learning, and decentralized data protocols such as IPFS. Key concepts include directed acyclic graphs, data serving mechanisms, p2p networks, and the importance of resilient applications. It also introduces various technical implementations and the potential for permanent distributed web services.
RDM#2- The Distributed Web
- 1. RDM#2 LISBON Research & Development Meetup
- 2. LISBON David Dias, P2P SE&R @ Protocol Labs João Ascensão, Data Scientist @ Uniplaces tw: @daviddias gh: @diasdavid tw: @jtascensao gh: @jtascensao
- 4. LISBON Space to invest time in learning things that are hard to grasp
- 9. LISBON what most people are doing
- 10. PROTOCOL LABS
- 11. LISBON FORMAT - New topics / Research - Hacking + Digesting + Publishing
- 12. LISBON TODAY - The Distributed Web - Machine Learning / AI
- 22. Serve data to everywhere
- 23. • Motivations • IPFS, the Protocol • MerkleDAG (Directed Acyclic Graph) • DHT (Distributed Hash Table)
- 24. • Motivations • IPFS, the Protocol, MerkleDAG, IPNS, Network • IPFS in action • IPFS, the project • filecoin • libp2p • starship • gx • full IPFS JavaScript implementation • mutable file system and the files API • Other DHT • Structure P2P Networks • Unstructured P2P Networks • NAT Traversal • Relay/Turn • registry-mirror • smart chunking • Transports • Multiplexers • Self Describing Data Types • Search • Station • and more
- 31. http://10.20.30.40/foo/bar/baz.png 10.20.30.40 you
- 32. http://10.20.30.40/foo/bar/baz.png 10.20.30.40 you
- 37. 200 MB
- 38. 200 MB x 30 x 8 = 48 GB
- 39. 2,544,837,694
- 41. Bandwidth
- 44. Latency
- 53. low bw interference congestion travelisp outagedatacenter
- 56. a protocol to upgrade the web
- 62. SFS web DHT+
- 64. routing network exchange merkledag naming applicationsThe Stack Defining the Data Moving the Data Using the Data IPLD libp2p IPNS
- 67. 8AyaTQMhJklMo Ga3WaDgwcAEPc KQeipgDu64qaj kr3fNcVt1LVMD hash( ) -> KQsXSobGtbNhF KQsXSobGtbNhF sv3qA44E7iXAy gcuSfVhW8RV3z R9F3MFvbVaqf9
- 68. 8AyaTQMhJklMo Ga3WaDgwcAEPc KQeipgDu64qaj kr3fNcVt1LVMD hash( ) -> KQsXSobGtbNhF KQsXSobGtbNhF sv3qA44E7iXAy gcuSfVhW8RV3z R9F3MFvbVaqf9 MERKLE LINK
- 75. cvs/svn
- 76. cvs/svn
- 77. cvs/svn
- 83. merkledag
- 84. in IPFS data forms a dag it’s called the merkle dag because the links are hashes
- 85. any data structures are represented as dags
- 86. unix files and dirs any data structures are represented as dags
- 87. blob, tree, commit unix files and dirs any data structures are represented as dags
- 88. blob, tree, commit unix files and dirs any data structures are represented as dags blocks, txns, wallets
- 89. blob, tree, commit unix files and dirs any data structures are represented as dags blocks, txns, wallets kv-stores
- 90. blob, tree, commit unix files and dirs any data structures are represented as dags blocks, txns, wallets kv-stores
- 91. unixfs as a dag
- 92. files are dag nodes unixfs as a dag
- 93. files are dag nodes BIG files may be split into many unixfs as a dag
- 94. directories are also dag nodes files are dag nodes BIG files may be split into many unixfs as a dag
- 95. which link to others directories are also dag nodes files are dag nodes BIG files may be split into many unixfs as a dag
- 104. DHT
- 105. DHT are the Holy Grail* of P2P Networks *from a survey paper
- 106. 1 5 6 10 50 55
- 107. 1 10 12 20 30 50 54 58 70 88 81 83 88 90 92 95 97 99 101105 300411 500
- 108. 1 10 12 20 30 50 54 58 70 88 81 83 88 90 92 95 97 99 101105 300411 500
- 109. 1 10 12 20 30 50 54 58 70 88 81 83 88 90 92 95 97 99 101105 300411 500 hash( )
- 110. 1 10 12 20 30 50 54 58 70 88 81 83 88 90 92 95 97 99 101105 300411 500 hash( ) = 91
- 111. 1 10 12 20 30 50 54 58 70 88 81 83 88 90 92 95 97 99 101105 300411 500 hash( ) = 91
- 112. 1 10 12 20 30 50 54 58 70 88 81 83 88 90 92 95 97 99 101105 300411 500 Who has fim , which hash( ) = 91?
- 113. The Distributed Web
- 114. • Applications with no-origin • Leverage network cache • Resilient to network splits
- 115. Serve data to everywhere
- 116. Serve data from everywhere
- 117. David Dias - http://daviddias.me IPFS http://ipfs.io Protocol Labs http://ipn.io
- 118. Thank you! David Dias - http://daviddias.me IPFS http://ipfs.io Protocol Labs http://ipn.io