Keynote: Jay Kreps, Confluent | Kafka ♥ Cloud | Kafka Summit 2020
1 like•5,097 views
The document discusses the transition from traditional databases to cloud-native data systems, highlighting the importance of event streams and real-time data processing through platforms like Apache Kafka. It emphasizes the advantages of cloud-native technologies, including scalability and flexibility, while noting the challenges users face with Kafka implementation. Ultimately, it presents Kafka as a leading solution due to its performance, community support, and evolving capabilities in the event streaming landscape.
Keynote: Jay Kreps, Confluent | Kafka ♥ Cloud | Kafka Summit 2020
- 1. KAFKA CLOUD
- 2. THE RISE OF EVENT STREAMS AND APACHE KAFKA
- 4. Old Paradigm: Classical Databases Slow, daily batch processing Point-in-time queries on static data Databases Data management = Storage
- 5. Hidden Assumption: Human Drives All Activity Databases APP
- 6. This Leads To A Giant Mess APPS APPSAPPS APPS DB DB APP APP DB DB DB DATA WAREHOUSE SAAS SAAS SAAS DB DB DB DB APP SAAS DATA WAREHOUSE DB APP SAAS DB APP SAAS DB APP DB LINE OF BUSINESS 01 LINE OF BUSINESS 02 PUBLIC CLOUD
- 7. THE NEW REALITY: THE “USER” OF THE SOFTWARE IS MORE SOFTWARE
- 8. New Paradigm: Event Streams Continuous stream processing Data Management = Storage + Flow Real-time event streams Real-time event streams
- 9. Event Streaming Platform EVENT STREAMING PLATFORM APP ksqlDB DB APP APP APP APP APP APP APP DB DB ksqlDB DB APP APP APP APP
- 10. THE RISE OF CLOUD NATIVE DATA SYSTEMS
- 11. THERE IS NO CLOUD IT’S JUST SOMEONE ELSE’S COMPUTER
- 12. “Cloud native technologies empower organizations to build and run scalable applications in modern, dynamic environments such as public, private, and hybrid clouds. Containers, service meshes, microservices, immutable infrastructure, and declarative APIs exemplify this approach.”
- 13. DATA CODE
- 14. My Experience
- 15. Cloud Native Data Systems Aurora DynamoDB Kinesis S3 Spanner Snowflake
- 16. What is a Cloud-Native Data System? ELASTIC USAGE-BASED COST MODEL INFINITE API-DRIVEN OPERATIONS SECURE AND RELIABLE SERVERLESS GLOBAL MULTITENANT
- 17. Cloud Native Data Systems are the Future
- 18. THE PROBLEM
- 19. Most people’s experience of Kafka is far from cloud native
- 21. So why is Kafka winning?
- 23. Performance 600 400 200 0 KAFKA PULSAR RABBITMQ Throughput (MB/s) Maximum steady state throughput using the Open Messaging Benchmark on identical 3 node clusters. Equal Produce/Consume workload. Full details available at http://confluent.io/blog
- 24. A point of view
- 25. Community 23,363 Stack Overflow Questions 210 Meetups 54,364 Meetup Attendees 10,286 Jiras for Apache Kafka 46,626 Emails sent to the Apache Kafka Mailing list 626 KIPs
- 26. ksqlDB E C O S Y S T E M
- 27. Open Platforms Win x86 Linux Email TCP-IP
- 29. Capability 1: Elastic demo coming via movie magic
- 31. Capability 2: Cost Effective
- 32. Capability 3: Infinite Storage demo coming via movie magic
- 34. Four More Months To Go Elastic ... ... ... Cost Effective Infinite Everywhere ... May June July August September October November December
- 37. Build VS. Buy $
- 38. The Way To Be Like Google Isn’t To Build Like Google
- 39. Not Just About One Cloud Service, Kafka Itself Improves
- 42. Event Streaming Platform in Every Company EVENT STREAMING PLATFORM APP ksqlDB DB APP APP APP APP APP APP APP DB DB ksqlDB DB APP APP APP APP
- 43. KAFKA CLOUD