I’m trying to see if there is a way to track and alert off trends. For Example: We have an application that spikes above our threshold for 1 minute, then goes back down. It does this 10 times per day but never goes above the threshold for the 5 minutes we have set. Is there a way to capture ALL of the spikes and then alert saying “Application X has spiked 10 times within the past 6 hours”.
This would allow us to see what could be going on before the application actually spikes and stays above the limit for the 5 minute threshold; which could impact user experience. I know we can set an alert for a 1 minute spike but that could end up flooding our inbox with alerts that the helpdesk could end up ignoring since there could be a lot of them.
Any thoughts on if this is possible and how we can achieve this would be appreciated.