Scylla Summit 2022: How ScyllaDB Powers This Next Tech Cycle
0 likes•1,081 views
The document discusses the advancements in ScyllaDB and how it is positioned to support the next technological cycle through improved database infrastructure, highlighting significant changes in database types and capabilities. It outlines the evolution of ScyllaDB across various generations, culminating in version 5.0, which introduces enhancements such as repair-based node operations, new IO schedulers, and seamless integration with Kubernetes. ScyllaDB aims for extreme efficiency and scalability, with a focus on multi-tenancy and cost-effectiveness in cloud environments.
Scylla Summit 2022: How ScyllaDB Powers This Next Tech Cycle
- 1. How ScyllaDB Powers This Next Tech Cycle Dor Laor CEO
- 2. What Changed in Databases?
- 3. Changes in Infrastructure Amazing NVMe drivers 100 Gbps Ethernet 128 core machines {Intel, AMD, ARM} 1 TB ram machines 5G (don’t forget the chip)
- 4. Changes in Databases Column Store Document K/V Graph NewSQL / Distributed SQL DBaaS consumption
- 5. 2022 Modern Stack Requirements Ability to work at scale Ability to work all the time Ability to respond fast Ability to work in all environments Ability to move fast Ability to analyze
- 6. Is your DATABASE ready for this next tech cycle?
- 7. You’re about to Query your Database (more) Data Enrichment Real Time Analytics AI/ML Multiple Data Sources Stream Cache Geo Replicate Multi Cloud Data Tiers
- 8. Effects on the Database 10x - 100x Queries P99 becomes P36 Cost skyrocket Things break at Scale
- 9. Database Efficiency Score = ƒ(query/vcpu, workload/ram, cost/storage);
- 10. Database Over Provision Score = ƒ(idle, tables/clusters, readonly/DCs);
- 11. Database Scale Score = ƒ(10x scale cost/ability, P99@Scale, Time to scale, Ease of scale);
- 12. Database Maintenance Score = ƒ(Backup, Repair, Replace, Scale, Upgrade, Observe, Trace)
- 13. Database Freedom Score = ƒ(License, Environment, Ecosystem tools);
- 14. ScyllaDB State of the Union
- 15. ScyllaDB Journey ■ Gen #1 - Brute Power
- 16. ScyllaDB Journey ■ Gen #1 - Brute Power ■ Gen #2 - API Compatible, Compaction, solved! R1 Can I propose a value? Check condition R2 R3 Accept new value Learn decision Decision made o k ! o k ! r o w c h e c k s u m o k ! a c k ok!
- 17. ScyllaDB Journey ■ Gen #1 - Brute Power ■ Gen #2 - API Compatible, compaction - solved ■ Gen #3 - Extras: CDC, K8S, Indexes, ICS, Alterator,..
- 18. ScyllaDB Journey ■ Gen #1 - Brute Power ■ Gen #2 - API Compatible, compaction - solved ■ Gen #3 - Extras: CDC, K8S, Indexes, ICS, Alternator... ■ Gen #4 - ScyllaDB 5.0, Scylla Cloud, Scylla Operator for Kubernetes
- 19. ScyllaDB 5.0 ■ Major Improvements • Repair Based Node Operations Enabled • New IO scheduler • Repair - a solved problem • Large partitions - a solved problem • Many others
- 20. ScyllaDB 5.0 ■ Major Improvements • Repair Based Node Operations Enabled • New IO scheduler • Repair - a solved problem • Large partitions - a solved problem • Many others ■ Raft Consensus at Zero cost • Rock solid base - Schema, Topology • Extreme Elasticity - Tablets • Eventual Immediate Consistency • Synchronous Indexing ■
- 21. ScyllaDB 5.0 ■ Major Improvements • Repair Based Node Operations Enabled • New IO scheduler • Repair - a solved problem • Large partitions - a solved problem • Many others ■ Raft Consensus at Zero cost • Rock solid base - Schema, Topology • Extreme Elasticity - Tablets • Immediate Consistency • Synchronous Indexing ■ Drivers • New Rust driver • New C++ based on ^^ • Workload definitions per role ■ Others • Scylla Advisor • First class K8S support • DNS & Node uuid
- 22. ScyllaDB 5.0 Enables Scylla Cloud & K8S ■ Extreme elasticity ■ Excellent isolation and control between workloads ■ Manage 1000s of clusters ■ Mega nodes or tiny pods ■ Cluster consolidation
- 23. Scylla Cloud 2022 Roadmap Today - Perfect Single Tenant land ■ Extreme efficiency ■ Perfect security & isolation ■ Clear and simple units - servers ■ > 5x Cost effectiveness vs all others ■ Easy to consume
- 24. Scylla Cloud 2022 Roadmap Today - Perfect Single Tenant land ■ Extreme efficiency ■ Perfect security & isolation ■ Clear and simple units - servers ■ > 5x Cost effectiveness vs all others ■ Easy to consume Coming - Multi tenancy ■ Separation of compute & storage ■ Serverless, pay per usage ■ Elastic w/ APIs control ■ More efficient than today’s implementation ■ Preserves ScyllaDB goodware™
- 25. Thank you! Stay in touch Star us on github! @dorlaor [email protected]