VoxxedDays Minsk - Building scalable WebSocket backend
4 likes929 views
The document discusses building a high-performance websocket backend, emphasizing key features like bidirectional communication and the need for efficient data handling. It covers techniques for optimizing data transfer, including resampling and delta delivery, to minimize bandwidth usage while maintaining performance. The conclusion highlights the advantages of proper bandwidth control and best practices for websocket implementation.
VoxxedDays Minsk - Building scalable WebSocket backend
- 1. 1 VOXXED DAYS MINSK 2018 BUILDING SCALABLE WEBSOCKET BACKEND KONSTANTIN SLISENKO LEAD SOFTWARE ENGINEER MAY 26, 2018
- 2. 2 [email protected] Konstantin Slisenko • Java Team Lead at EPAM • I’m building trading software • 8+ years with Java • 3+ years with WebSocket github.com/kslisenko
- 3. 3
- 4. 4
- 5. 5 WHAT IS WEBSOCKET standard: tools.ietf.org/html/rfc6455
- 6. 6 HTTP WHAT IS WEBSOCKET GET /demo HTTP/1.1 Upgrade: WebSocket Connection: Upgrade standard: tools.ietf.org/html/rfc6455
- 7. 7 HTTP WHAT IS WEBSOCKET HTTP/1.1 101 Web Socket Protocol Handshake Upgrade: WebSocket Connection: Upgrade GET /demo HTTP/1.1 Upgrade: WebSocket Connection: Upgrade standard: tools.ietf.org/html/rfc6455
- 8. 8 TCP HTTP WHAT IS WEBSOCKET HTTP/1.1 101 Web Socket Protocol Handshake Upgrade: WebSocket Connection: Upgrade GET /demo HTTP/1.1 Upgrade: WebSocket Connection: Upgrade DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA standard: tools.ietf.org/html/rfc6455
- 9. 9 • Permanent connection WEBSOCKET PROVIDES
- 10. 10 • Permanent connection • Bidirectional communication WEBSOCKET PROVIDES
- 11. 11 • Permanent connection • Bidirectional communication • Sending text or binary data WEBSOCKET PROVIDES
- 12. 12 • Permanent connection • Bidirectional communication • Sending text or binary data • Guaranteed delivery (TCP/IP) WEBSOCKET PROVIDES
- 13. 13 • API and application protocol WEBSOCKET DOESN’T PROVIDE
- 14. 14 • API and application protocol • Network failure handling* WEBSOCKET DOESN’T PROVIDE *Only basic handling
- 15. 15 • API and application protocol • Network failure handling* • Network slowness handling* WEBSOCKET DOESN’T PROVIDE *Only basic handling
- 16. 16 • API and application protocol • Network failure handling* • Network slowness handling* • Bandwidth/frequency limitation WEBSOCKET DOESN’T PROVIDE *Only basic handling
- 17. 17 ONE DOES NOT SIMPLY BUILD HIGH PERFORMANCE APPLICATION USING ONLY STANDARD WEBSOCKET FEATURES
- 18. 18 High performance WebSocket backend Basic WebSocket backend
- 22. 22 data subscribe WebSocket any protocol data data subscribe WebSocket subscribe IBM AAPL IBM AAPL
- 25. 25
- 26. 26 TOO MUCH DATA? SEND LESS DATA!
- 27. 27 High performance WebSocket backend Max frequency limit Basic WebSocket backend
- 28. 28 HOW DO WE SEND LESS DATA?
- 29. 29 RESAMPLING No limits (10 updates/s)
- 30. 30 RESAMPLING No limits (10 updates/s) 2 updates/s
- 31. 31 No limits (10 updates/s) 200 300 400 500 700 900 2 updates/s (last available) 900 1000600 600 100 100 RESAMPLING + CONFLATION
- 32. 32 No limits (10 updates/s) 100 200 300 400 500 600 700 800 2 updates/s (average) 300 900 1000 RESAMPLING + CONFLATION 800 100 + 200 + 300 + 400 + 500 5 = 300 600 + 700 + 800 + 900 + 1000 5 = 800
- 37. 37 data data subscribe data subscribe subscribeAAPL IBM IBM TSLA TSLA data info info info info rate limit rate limit rate limit rate limit IBM data AAPL data
- 39. 39 MAX FREQUENCY LIMIT 2 KB/s* Max frequency limit 33 KB/s* No limits -95% * for demo application including gzip compression
- 41. 41 WHAT ELSE, CAP? SEND EVEN LESS DATA!
- 42. 42 High performance WebSocket backend Schema Max frequency limit Basic WebSocket backend
- 44. 44 AAPL snapshot BID=10 schema ASK=15 LAST=12 BID SIZE=20 ASK SIZE=30 BID=10 ASK=15 SCHEMA BID ASK
- 45. 45 AAPL snapshot BID=10 schema ASK=15 LAST=12 BID SIZE=20 ASK SIZE=30 BID=10 ASK=15 BID=10 ASK=15 LAST=12 BID SIZE=20 ASK SIZE=30 SCHEMA BID ASK schema *
- 46. 46 High performance WebSocket backend Max frequency limit Basic WebSocket backend Delta delivery Schema
- 47. 47 DELTA DELIVERY BID=10 ASK=15 LAST=12 BID SIZE=20 ASK SIZE=30 BID=15 ASK=15 LAST=12 BID SIZE=20 ASK SIZE=30 BID=20 ASK=20 LAST=12 BID SIZE=20 ASK SIZE=30 BID=20 ASK=20 LAST=12 BID SIZE=50 ASK SIZE=30 message message message message
- 48. 48 DELTA DELIVERY BID=10 ASK=15 LAST=12 BID SIZE=20 ASK SIZE=30 BID=15 ASK=15 LAST=12 BID SIZE=20 ASK SIZE=30 BID=20 ASK=20 LAST=12 BID SIZE=20 ASK SIZE=30 BID=20 ASK=20 LAST=12 BID SIZE=50 ASK SIZE=30 message message message message
- 49. 49 DELTA DELIVERY BID=10 ASK=15 LAST=12 BID SIZE=20 ASK SIZE=30 BID=15 ASK=15 LAST=12 BID SIZE=20 ASK SIZE=30 BID=20 ASK=20 LAST=12 BID SIZE=20 ASK SIZE=30 BID=20 ASK=20 LAST=12 BID SIZE=50 ASK SIZE=30 message message message message BID=10 ASK=15 LAST=12 BID SIZE=20 ASK SIZE=30 BID=15 BID=20 ASK=20 BID SIZE=50 snapshot update update update
- 50. 50 High performance WebSocket backend Delta delivery Schema Max frequency limit Basic WebSocket backend Position-based protocol
- 51. 51 { symbol: AAPL, bid: 10, ask: 12, last: 11, bidSize: 100, askSize: 200 } AAPL|10|12|11|100|200 ? bytes ? bytes
- 52. 52 { symbol: AAPL, bid: 10, ask: 12, last: 11, bidSize: 100, askSize: 200 } AAPL|10|12|11|100|200 85 bytes 21 bytes
- 53. 53 { symbol: AAPL, bid: 10, ask: 12, last: 11, bidSize: 100, askSize: 200 } AAPL||12|||200 46 bytes 14 bytes
- 55. 55 SCHEMA + DELTA DELIVERY + POSITION-BASED PROTOCOL 400 B/s* Using schema 2 KB/s* No schema -80% * for demo application including gzip compression 370 B/s* Delta delivery -8% 310 B/s* Position-based -15%
- 56. 56 GOOD JOB!
- 57. 57 High performance WebSocket backend Position-based protocol Delta delivery Schema Max frequency limit Basic WebSocket backend Dynamic bandwidth control
- 58. 58
- 63. 63 DYNAMIC BANDWIDTH CONTROL DataData Data Data ACK ACK ACK ACK ACK
- 65. 65 DYNAMIC BANDWIDTH CONTROL 420 B/s* Bandwidth control 310 B/s* No control +35% * for demo application including gzip compression
- 66. 66 ARE WE READY FOR PRODUCTION?
- 67. 67
- 72. 72 CONCLUSION
- 73. 73 No improvements 2 KB/s*Max frequency limit 400 B/s*Schema 370 B/s*Delta delivery 310 B/s*Position-based 420 B/s*Bandwidth control -95% -80% -8% -15% +35% 33 KB/s* * for demo application including gzip compression BANDWIDTH OPTIMIZATION*
- 74. 74 READ High Performance Browser Networking What every web developer should know about networking and web performance Free reading: https://hpbn.co/ By Ilya Grigorik Publisher: O'Reilly Media Release Date: September 2013
- 76. 76 More Than Just WebSockets for Real-Time Multiplayer Games and Collaboration On YouTube and Slideshare By Alessandro Alinone (CEO of Lightstreamer)
- 77. 77 1. Improve user-experience 2. Reduce bandwidth 3. Handle network failures TAKE AWAYS