Observability and monitoring
Observability and monitoring are critical principles that enable identifying resource-intensive components within a system, allowing for targeted optimization efforts. Monitoring involves collecting and displaying data to measure performance against standards, identify deviations, and provide feedback. Observability involves analyzing a system’s inputs and outputs to understand its health and diagnose issues.
For instance, by observing the data lifecycle and cleanup of video files, a video streaming company was able to see that 13 petabytes of their data were not needed. In fact, due to a flaw in their clean-up scripts, the company was holding onto data that should have been deleted a long time ago. Often it is through the insights of system observability that application owners gain a deeper understanding of the solution, which leads to many benefits, including making the solution more sustainable.
To identify resource-intensive components...
