Downloaded 16 times
OV
Uploaded byOmid Vahdaty
PPTX, PDF1,309 views
Kafka website activity architecture
The document discusses various use cases for Apache Kafka, including website activity tracking, messaging, and stream processing. It highlights the complexities of implementing multi-data center (DC) clusters, emphasizing security and latency issues, and suggests best practices typically employed on AWS. Contact information for the author, Omid Vahdaty, is also provided.
Kafka website activity architecture
- 1. Kafka website activityarchitecture Omid Vahdaty, Cloud Architect
- 2. Kakfa Architecture usecases ● https://kafka.apache.org/uses ○ Website Activity Tracking ○ Messaging ○ Log Aggregation ○ Metrics ○ Stream Processing ○ Event Sourcing ○ Commit Log
- 3.
- 4. Decouple compute andstorage/ Inflight analytics
- 6. Kafka multi DCcluster (multi cloud) ● Active Active ● Active Passive ● Active Active with aggregation cluster ● Active Active with DC tagging on topics
- 7. Kafka multi DCcluster ● http://www.slideshare.net/HadoopSummit/building-largescale-stream- infrastructures-across-multiple-data-centers-with-apache-kafka ● http://www.slideshare.net/ToddPalino/more-datacenters-more-problems ● http://www.slideshare.net/ToddPalino/kafka-at-scale-multitier-architectures ● Typically done on AWS on single region (several AV zones) ○ Rely on intra - cluster replication ○ Stretched cluster across regions are NOT RECOMMENDED ■ Security considerations. ■ Network latency considerations.
- 8. Stay in touch... ●Omid Vahdaty ● +972-54-2384178