Apache Cassandra Lunch 120: Apache Cassandra Monitoring Made Easy with AxonOps
0 likes111 views
AxonOps provides a cloud-based management tool for Apache Cassandra, offering observability, alerting, backups, and repair functionalities. Cassandra is a highly available, fault-tolerant database used in various sectors including IoT, social media, and financial services, but requires proper monitoring and management. The platform simplifies managing Cassandra by offering a single agent installation with pre-configured dashboards and tools for effective maintenance.
Apache Cassandra Lunch 120: Apache Cassandra Monitoring Made Easy with AxonOps
- 1. © 2022 AxonOps. All rights reserved. https://axonops.com Apache Cassandra Monitoring Made Easy with AxonOps Johnny Miller Co-Founder AxonOps [email protected] https:/ /axonops.com
- 2. © 2022 AxonOps. All rights reserved. https://axonops.com What is Apache Cassandra? ▪ database ▪ highly available and fault tolerant ▫ data center/region aware ▫ rack/availability zone aware ▫ masterless with no single point of failure ▪ low latency / high throughput ▪ linearly scalable ▪ Open-sourced in 2008, became a top-level Apache project in 2010
- 3. © 2022 AxonOps. All rights reserved. https://axonops.com Adoption https:/ /db-engines.com/
- 4. © 2022 AxonOps. All rights reserved. https://axonops.com Use Cases ▪ internet of things ▪ social media ▪ telecommunications ▪ online streaming media ▪ online advertising ▪ messaging ▪ security/fraud ▪ travel ▪ financial services
- 5. © 2022 AxonOps. All rights reserved. https://axonops.com Masterless Architecture Scalable Highly Available & Fault Tolerant Highly Performant Tunable Consistency Multi-DC/Region/ Cloud Open Source Multiple Use Cases
- 6. © 2022 AxonOps. All rights reserved. https://axonops.com Why do I love Cassandra?
- 7. © 2022 AxonOps. All rights reserved. https://axonops.com However, it is not magic! ▪ Like any DB, it needs to be ▫ Monitored ▫ Managed ▫ Backed-up ▫ Secured
- 8. © 2022 AxonOps. All rights reserved. https://axonops.com Monitoring & Managing Cassandra
- 9. © 2022 AxonOps. All rights reserved. https://axonops.com nodetool ▪ Swiss Army Knife for Cassandra ▪ Has many options - steep learning curve ▪ Invokes a java process - speaks to Cassandra over JMX
- 10. © 2022 AxonOps. All rights reserved. https://axonops.com nodetool - demo ▪
- 11. © 2022 AxonOps. All rights reserved. https://axonops.com Metrics exposed as JMX MBeans
- 12. © 2022 AxonOps. All rights reserved. https://axonops.com logs
- 13. © 2022 AxonOps. All rights reserved. https://axonops.com Backups ▪ nodetool snapshot - snapshot of the Cassandra data at a specific point in time ▪ commit logs
- 14. © 2022 AxonOps. All rights reserved. https://axonops.com Snapshot Triggers ▪ nodetool snapshot command ▪ Dropping keyspace/table - cassandra.yaml - auto_snapshot: true ▪ Incremental backups - cassandra.yaml - incremental_backups: false ▪ Snapshot before compaction - cassandra.yaml - snapshot_before_compaction
- 15. © 2022 AxonOps. All rights reserved. https://axonops.com Point in Time Recovery ▪ Essentially commitlog archiving and restoration mechanism built into Cassandra ▪ Configuration file is located at: /etc/cassandra/commitlog_archiving.properties ▪ Restore time is configured in this file ▪ Snapshotting is sufficient for most circumstances. Only required if an exact point-in-time-recovery is required.
- 16. © 2022 AxonOps. All rights reserved. https://axonops.com Repair ▪ The nodetool repair command repairs inconsistencies across all of the replicas for a given range of data. ▫ Sequential, parallel, or all DC parallel ▫ Repair specific DC ▫ Full, partition range, or subrange ▫ Concurrency - number of concurrent repairs across multiple tables - maximum 4 ▫ Specific keyspaces / tables ▪ Must be run regularly on your Cassandra Cluster
- 17. © 2022 AxonOps. All rights reserved. https://axonops.com Operating System ▪ Storage ▪ Network ▪ IO ▪ Time (NTP) ▪ Plus more…..
- 18. © 2022 AxonOps. All rights reserved. https://axonops.com Why AxonOps?
- 19. © 2022 AxonOps. All rights reserved. https://axonops.com Metrics & Logs ▪ Prometheus ▪ Grafana ▪ Datadog ▪ Metricbeat ▪ Graphite ▪ Elasticsearch ▪ Etc.. etc..
- 20. © 2022 AxonOps. All rights reserved. https://axonops.com Repairs ▪ nodetool ▪ Cassandra reaper Bash script ▪ Etc.. etc..
- 21. © 2022 AxonOps. All rights reserved. https://axonops.com Backups ▪ nodetool snapshot ▪ bash script ▪ Medusa ▪ Etc..etc..
- 22. © 2022 AxonOps. All rights reserved. https://axonops.com Lots of tools, lots of complexity and lots of cost!
- 23. © 2022 AxonOps. All rights reserved. https://axonops.com AxonOps ▪ AxonOps is a Cassandra management tool hosted in the cloud by us. ▪ It provides observability, alerting, backups, and repair - everything you need to manage your Apache Cassandra clusters successfully. ▪ Built by Cassandra Experts with years of actual hands-on experience.
- 24. © 2022 AxonOps. All rights reserved. https://axonops.com AxonOps is simple ▪ Install a single agent and that’s it - all the logs, metrics and tools necessary to manage Cassandra in production. ▫ Pre-configured dashboards ▫ Full backup management ▫ Intelligent and Adaptive Repairs ▫ Rich suite of integrations with tools like ServiceNOW, Slack, PagerDuty, Teams etc.. ▫ Plus more!! ▪
- 25. © 2022 AxonOps. All rights reserved. https://axonops.com Demo
- 26. © 2022 AxonOps. All rights reserved. https://axonops.com
- 27. © 2022 AxonOps. All rights reserved. https://axonops.com Additional Resources ▪ https:/ /axonops.com ▪ https:/ /docs.axonops.com ▪ https:/ /axonops.com/slack ▪ https:/ /cassandra.apache.org ▪ https:/ /cassandra.apache.org/doc/latest/ ▪ https:/ /github.com/apache/cassandra
- 28. © 2022 AxonOps. All rights reserved. https://axonops.com