Blueprint: Kafka Publisher of Ceilometer
0 likes1,150 views
The document discusses the integration of Ceilometer with Kafka at the OpenStack Summit in Paris, highlighting Kafka as a distributed messaging system that facilitates real-time data publishing. It outlines various use cases, including visualization and machine learning applications, and emphasizes the ease of configuring Ceilometer to publish data to Kafka. The main takeaway is that minimal configuration is required for external open-source systems to leverage Ceilometer's capabilities.
![Kafka Publisher of Ceilometer
OpenStack Summit @ Paris
Komei Shimamura, Yathiraj Udupi, Debo Dutta
[kshimamu|yudupi|dedutta]@cisco.com](https://image.slidesharecdn.com/kafka-ceilometer-141112024409-conversion-gate02/85/Blueprint-Kafka-Publisher-of-Ceilometer-1-320.jpg)
Blueprint: Kafka Publisher of Ceilometer
- 1. Kafka Publisher of Ceilometer OpenStack Summit @ Paris Komei Shimamura, Yathiraj Udupi, Debo Dutta [kshimamu|yudupi|dedutta]@cisco.com
- 2. Kafka: Distributed Messaging System ‣ Publish-Subscribe Architecture ‣ Component: Publisher, Broker, and Consumer ‣ Support for Publishing Messages Real-timely OpenStack Summit @ Paris publish fetch BR CN BR: broker, CN: consumer, PR: publisher 2 PR PR PR BR CN CN 1 2 3 send
- 3. Real-time Data Achieve - Use Cases ‣ Visualisation ‣ Kafka - ElasticSearch - kibana ‣ Machine Learning / Fault Detection ‣ Kafka - Storm ‣ i.e. this VM would accidentally terminate after10 min ‣ Machine Learning / Recommendation ‣ Kafka - Storm - Jubatus ‣ i.e. next VM should be launched at this host OpenStack Summit @ Paris 3 OpenStack can now cooperate with External OSS!
- 4. How to Publish to Kafka from Ceilometer ‣ Just Configure pipeline.yaml Ceilometer has several publishers Specify Kafka broker Add New Publisher As a Option OpenStack Summit @ Paris User Can Name Publishing 4 Data As a Topic Ceilometer Can Publish its Data easily !
- 5. Summery ‣ Kafka is a Broker of Real-time Messages ‣ Minimal configuration is needed ‣ External OSS can take advantage of Ceilometer OpenStack Summit @ Paris 5 PR BR CN Ceilometer Kafka Broker A lot of External OSS Thank you!