What's New in Confluent Platform 5.5
0 likes•179 views
Confluent Platform 5.5 introduces several enhancements, including support for protobuf and json in the schema registry, improved connectivity for non-Java clients with exactly-once semantics, and the ksqlDB flow view for better application management. The new features aim to make event streaming more accessible and efficient for developers, with a focus on multi-language development and ease of use through enhanced admin functions. Overall, the update strengthens the ecosystem with rich pre-built tools and increased operational flexibility.
What's New in Confluent Platform 5.5
- 1. What’s New in Confluent Platform 5.5 April 2020 Nick Bryan, Product Marketing Manager
- 2. Confluent Platform Dynamic Performance & Elasticity Auto Data Balancer | Tiered Storage Flexible DevOps Automation Operator | Ansible GUI-driven Mgmt & Monitoring Control Center Efficient Operations at Scale Freedom of Choice Committer-driven Expertise Event Streaming Database ksqlDB Rich Pre-built Ecosystem Connectors | Hub | Schema Registry Multi-language Development Non-Java Clients | REST Proxy Global Resilience Multi-region Clusters | Replicator Data Compatibility Schema Registry | Schema Validation Enterprise-grade Security RBAC | Secrets | Audit Logs ARCHITECTOPERATORDEVELOPER Open Source | Community licensed Unrestricted Developer Productivity Production-stage Prerequisites Fully Managed Cloud SoftwareSelf-managed Software Training Partners Enterprise Support Professional Services Apache Kafka
- 3. Confluent Platform Dynamic Performance & Elasticity Auto Data Balancer | Tiered Storage Flexible DevOps Automation Operator | Ansible GUI-driven Mgmt & Monitoring Control Center Efficient Operations at Scale Freedom of Choice Committer-driven Expertise Event Streaming Database ksqlDB Rich Pre-built Ecosystem Connectors | Hub | Schema Registry Multi-language Development Non-Java Clients | REST Proxy Global Resilience Multi-region Clusters | Replicator Data Compatibility Schema Registry | Schema Validation Enterprise-grade Security RBAC | Secrets | Audit Logs ARCHITECTOPERATORDEVELOPER Open Source | Community licensed Unrestricted Developer Productivity Production-stage Prerequisites Fully Managed Cloud SoftwareSelf-managed Software Training Partners Enterprise Support Professional Services Apache Kafka
- 4. CP 5.5 makes Apache Kafka and event streaming more broadly accessible to developers Rich Pre-built Ecosystem Protobuf, JSON, and plug-in schema support for Schema Registry and throughout the platform 4 Multi-language Development Exactly-once semantics for non-Java clients Admin functions for REST Proxy (preview) Event Streaming Database ksqlDB 0.7 ksqlDB Flow View within Control Center
- 5. 5 Schema Registry expands the Kafka ecosystem with Protobuf, JSON, and plug-in schema support Schema Registry Custom Plug- Ins Supported Data Formats Rich Pre-built Ecosystem App 1 ! Schema Registry Kafka topic ! Serializer App 1 Serializer
- 6. Allow developers and businesses to adopt event streaming broadly Organizations no longer need to adjust event streaming apps to use Avro to use Schema Registry Applications with other formats also need to work with Schema Registry Plug-ins provide a way for Kafka users to address the “long tail” of data formats Protobuf and JSON are both very prevalent data formats The two data formats were the most commonly requested by customers by a significant margin Why add Protobuf, JSON, and plug-in schema support to Schema Registry? 6 Rich Pre-built Ecosystem
- 7. Kafka Connect Converters for Protobuf and JSON ksqlDB and Kafka Streams Enrich messages in either data format REST Proxy Register and retrieve schemas Control Center Create topic schemas directly in the GUI Schema Validation Broker-side enforcement of schemas 7 Protobuf and JSON schemas are also supported across all components of Confluent Platform Rich Pre-built Ecosystem
- 8. Protobuf and JSON Schema Demo
- 9. CP 5.5 makes Apache Kafka and event streaming more broadly accessible to developers Rich Pre-built Ecosystem Protobuf, JSON, and plug-in schema support for Schema Registry and throughout the platform 9 Multi-language Development Exactly-once semantics for non-Java clients Admin functions for REST Proxy (preview) Event Streaming Database ksqlDB 0.7 ksqlDB Flow View within Control Center
- 10. Confluent enhances multi-language development with exactly-once semantics for librdkafka-based clients 10 Clients with EOS 0 1 2 3 4 5 6 7 8 Producer Write idempotently Read exactly once Consumer Multi-language Development
- 11. Why add exactly-once semantics to non-Java clients? 11 Exactly-once semantics ensures critical messages are never duplicated For example, a message that could trigger a financial trade cannot be produced or consumed more than once Feature parity between the clients make event streaming accessible to all developers Organizations with many developer teams need a broad range of clients to allow Kafka to become their central nervous system Multi-language Development
- 12. REST Proxy introduces admin functions to improve Kafka connectivity (Preview State) 12 REST Proxy REST Proxy Applications Schema Registry REST / HTTP List and describe brokers Create, delete, list, and describe topics List and describe configs for topics New Admin Functions Multi-language Development
- 13. Why introduce admin functions for REST Proxy? 13 Removes need to switch over from REST Proxy to Java Admin client, CLI, or Control Center to run admin functions REST Proxy can now both perform administrative tasks and produce and consume messages Feature parity between REST Proxy and the clients provides greater flexibility and more choices to developers Many developers prefer REST because of its language-agnostic nature and simplicity Multi-language Development
- 14. CP 5.5 makes Apache Kafka and event streaming more broadly accessible to developers Rich Pre-built Ecosystem Protobuf, JSON, and plug-in schema support for Schema Registry and throughout the platform 14 Multi-language Development Exactly-once semantics for non-Java clients Admin functions for REST Proxy (preview) Event Streaming Database ksqlDB 0.7 ksqlDB Flow View within Control Center
- 15. Confluent Platform 5.5 launches with ksqlDB 0.7 to further simplify the development of event streaming applications 15 COUNT_DISTINCT Aggregate Count distinct values within a field COUNT_DISTINCT → 3 Support for more data types Record keys can now be of type String, INT, BIGINT, or DOUBLE Higher availability of pull queries1 Reroute queries to replica table partitions if the leader partition is down Pull Query 1 - Pull queries are still in preview Event Streaming Database
- 16. Why expand the functionality of ksqlDB? 16 ksqlDB is becoming the tool of choice to build event streaming applications that leverage stream processing ksqlDB continues to be adopted widely to create these modern applications Expanding the feature set further simplifies the process of building event streaming applications Adding more aggregates, support for more data types, etc. Event Streaming Database
- 17. Control Center provides greater visibility and discovery of ksqlDB applications 17 Visualize what queries, streams, and tables are being used in a ksqlDB application ksqlDB Flow View Application Overview Event Streaming Database
- 18. Control Center provides greater visibility and discovery of ksqlDB applications 18 Drill down into table or stream nodes to quickly visualize their schema and messages ksqlDB Flow View Table / Stream Node Doubleclick Event Streaming Database
- 19. Drill down into query nodes to view the code and understand how inputs are being manipulated Control Center provides greater visibility and discovery of ksqlDB applications 19 ksqlDB Flow View Query Node Doubleclick Event Streaming Database
- 20. Why add the ksqlDB Flow View to Confluent Control Center? 20 Provides developers with a simple mental model of how tables, streams, and queries are interacting Applications often have many different queries that are more easily understood visually than reviewing the editor Enables developers to quickly discover and understand a ksqlDB application that others have built ksqlDB applications are often built by many different developers and teams, so discoverability is crucial Event Streaming Database
- 21. CP 5.5 makes Apache Kafka and event streaming more broadly accessible to developers Rich Pre-built Ecosystem Protobuf, JSON, and plug-in schema support for Schema Registry and throughout the platform 21 Multi-language Development Exactly-once semantics for non-Java clients Admin functions for REST Proxy (preview) Event Streaming Database ksqlDB 0.7 ksqlDB Flow View within Control Center
- 22. Confluent Platform 5.5 launches with the latest Apache Kafka 2.5 version
- 23. Thank you! Try Confluent cnfl.io/download Confluent Blog cnfl.io/blog Community cnfl.io/meetups