Big data and non relational database
Download as PPTX, PDF0 likes392 views
The document outlines modules for managing big data and non-relational database applications, detailing their scheduling, agenda, and key topics such as visibility, monitoring strategies, and performance analysis. It covers essential components of Hadoop and Spark, as well as issues related to disk and memory in NoSQL databases like MongoDB, Cassandra, and Redis. The document also emphasizes forecasting utilization trends and capacity planning, providing contact information for further inquiry and an online demo.
Big data and non relational database
- 1. Discovery & mapping Big Data and Non relational database
- 2. Applications Manager An all round on-premises application performance solution for IT Ops and DevOps
- 3. Week Module Date Schedule Status 1. Visibility: From web application interface to the database Aug 21 6:00 AM GMT 11:00 AM EDT Completed Completed 2. Big Data and the Non Relational database Aug 28 6:00 AM GMT 11:00 AM EDT In Progress Upcoming 3. Implementing the right website monitoring strategy Sept 4 6:00 AM GMT 11:00 AM EDT Upcoming Upcoming 4. Monitoring Cloud applications and Containers Sept 11 6:00 AM GMT 11:00 AM EDT Upcoming Upcoming
- 4. Agenda Big data apps: Apache Hadoop & Spark NoSQL databases in Big Data frameworks Disk and memory issues in NoSQL databases Forecasting utilization trends and planning capacity
- 5. Discovery & mapping Big data apps
- 7. The key Hadoop components • HDFS • MapReduce • YARN • NoSQL Database
- 8. HDFS
- 9. MapReduce
- 10. YARN
- 11. Apache Spark architecture Spark Driver program Spark Scheduler Worker node Worker node HDFS NoSQ L Mesos /YARN
- 12. Spark key components • Drivers and Workers in Spark • Memory and resource utilization • Spark cores and applications • Spark RDDs • NoSQL database
- 13. Workers
- 14. Memory
- 15. Memory
- 17. RDDs
- 18. The NoSQL databases in Big Data set ups
- 19. MongoDB - Network & connections • Connections used • Connections available • Network traffic received • Network traffic sent
- 20. MongoDB - Lock & asserted errors • Read Lock, Write Lock • Message, User asserts
- 22. Cassandra - Keyspace latency • Read Latency (/min) • Write Latency (/min)
- 23. Redis - Keys • Number of keys • Expired keys
- 24. Redis - Clients • Connected clients • Blocked clients
- 25. Discovery & mapping Disk and Memory issues in NoSQL databases
- 28. Cassandra Memory Utilization • Free Memory • Used Memory
- 29. Cassandra-Cluster • Node state • Unreachable nodes
- 32. Discovery & mapping Forecasting utilization trends and planning capacity
- 33. Trend analysis report Pull at a glance report of the DB server to have a quick glance at all monitored attributes
- 34. Trend analysis report Quick glance at the performance of all monitored attributes: • History Report • Hour of Day Report • Day of Week Report • Statistical Report • Heat Chart
- 35. Compare performance attribute reports of different monitors. View & compare reports
- 36. • Balance hardware costs with computing needs. • Plan future utilization requirements. Forecast report
- 37. Contact : [email protected] Online Demo : demo.appmanager.com Quick Recap Big Data and the non-relational database • Big data apps: Apache Hadoop & Spark • NoSQL databases in Big Data frameworks • Disk and memory issues in NoSQL DBs • Forecasting utilization trends and planning capacity
- 38. Contact : [email protected] Online Demo : demo.appmanager.com