Scalable Smart Caching for Spring Developers
0 likes160 views
The document discusses caching strategies at Netflix and Pivotal Cloud Cache (PCC). It notes that Netflix relies heavily on caches to provide a low latency data layer for its stateless services. PCC is Pivotal's distributed in-memory cache optimized for Pivotal Cloud Foundry apps that provides high availability, scalability, and fault tolerance. The document outlines PCC's topology and components, discusses caching design patterns like look-aside caching, and provides an example of live coding with PCC.
Scalable Smart Caching for Spring Developers
- 1. Scalable Smart Caching for Spring Developers By Nikhil Chandrappa and Pulkit Chandra Pivotal
- 2. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Internet Scale Caching @ Netflix “The Netflix customer experience relies heavily on caches to provide a high-volume, low latency, globally available data layer that backs our stateless services. Throughout a typical customer experience, from sitting down on the couch through playing a movie, caches play a role in every interaction.” #CachesEverywhere
- 3. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Internet Scale Caching @ Netflix
- 4. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Internet Scale Caching @ Netflix
- 5. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Pivotal Cloud Cache (PCC) ● Distributed In-Memory cache optimized for PCF Apps ● Automated Provisioning and Management ● High Availability and Linear Scalability ● Fault Tolerant, No Single Point of Failure ● Disk based Persistence ● WAN replication between PCF Foundations ● PCF-AZ aware!
- 6. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Caching Design Patterns Look-Aside Cache
- 7. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Design Pattern: In-line Caching 7 Fast KV Store front-ending RDBMS 1000s of transactions per second 100s of transactions per second
- 8. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Developer Essentials
- 9. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ PCC Topology 12 Cache Server Cache Server Cache Server Locator 1 2 33 1 Locator PCC Client Connection Pool 54.209.251.110 54.209.251.111 54.209.251.112 Locator Cache Server 2 54.209.251.113 ● Cluster Spanning Multi PCF AZs ● PCC Native Redundancy prevents data loss ● BOSH resurrects the lost VM PCF AZ 1 PCF AZ 2
- 10. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ PCC Members Cache Server ● In-Memory Storage for Data Regions Cache Server Cache Server Cache Server Locator Locator ● Cluster Discovery & Config ● Load Balancing for Servers Cache Server Cache Server Cache Server Locator
- 11. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Regions 1 1 ● Synonymous to a Table in NoSQL terminology ● Stores Data in <Key,Value> pairs with unique Keys ● Divided into buckets across Cache Members
- 12. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Regions 1 2 Replicated Partitioned GEM Server GEM Server GEM Server GEM Server GEM Server GEM Server HASH
- 13. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Cluster Scaling Out 1 3 cf update-service pcc-dev-cluster -c '{"num_servers": 6}'
- 14. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Live Coding: PCC Look-Aside Caching