How to create custom dashboards in Elastic Search / Kibana with Performance Vision Data
1 like1,130 views
The document discusses the integration of performance analysis tools with Elasticsearch, highlighting its importance for network and application performance monitoring. It addresses challenges such as disparate systems and the need for centralized metrics and collaboration among stakeholders. The document emphasizes the benefits of using open-source tools like Elasticsearch due to their speed, scalability, and compatibility with modern microservices architecture.
How to create custom dashboards in Elastic Search / Kibana with Performance Vision Data
- 1. Performance Vision and Elastic Search / Hotrod Brett Airey September 2015
- 3. What we do ! • Network Performance analysis. • Application Performance analysis. • Build Big Data Systems (Splunk & Hotrod) • Troubleshooting IT incidents full stack. • Manage and traffic-shape networks for maximum performance. ( Bandwidth still issue outside of major cities) • Custom Logging pipeline for Clients
- 4. The Challenges • Securactive - Technical Tool for the Tech’s • Disparate systems all have own Reporting • No Central point for Correlation and Collaboration. • Aggregation of Data , lose the ability to drill in to the fine resolution in a reasonable time period. Need more transparency of key Metrics
- 5. The Dream for resolving Incidents all stakeholders metrics in one place Incident COMMON TIME SERIES NETWORK METRICS ALL DEVICE ACCESS LOGS CHANGE CONTROL EVENTS SERVER RESOURCE METRICS APPLICATION METRICS / LOGS STORAGE PERFORMANCE METRICS APM NPM (Securactive )
- 6. Why we believe tools like Elasticsearch is the way • Open-source (Important community for us) • In memory searching, so it’s fast, scalable. • Has proven performance. • Hardware requirements low spec. • Works well with Docker “ Micro Services”
- 7. How we are doing it • HTML “API” into Securactive • Program ….. • Import • Naming convention - Std names ie Host,ipadd • HOTROD “ Panoptix”
- 8. Why HotRod into Elasticsearch • Authentication as standard. • Reader app to track highwatermark. • Alerting on variances to baseline. • Limit user view through role based access. • Loosley coupled, ability to change components with relative ease.
- 9. So how does it all work.. I am sure in the future versions we will get nicely formatted JSON. Performance Vision Elastic DB Hotrod/Elastic Interface
- 10. How it all fits Together
- 11. Harvesting Data from Securactive
- 13. HotRod RESTful endpoint (API)
- 15. Screen Shots Quick select periods and aggregation as well as Refresh interval for Dashboards
- 16. Screen Shots Visualise your key metrics
- 17. Screen Shots Visualise your Data using the extensive graphs available
- 18. HotRod is Opensource panoptix-za/HotRod · GitHub