I’ve got an alert policy setup to send a slack notification when the NRQL results return a value below a threshold. There have been several cases in the past week which should have resulted in a notification going out, but nothing happened.
- No prior incidents are open
- Changed indecent preference from “By policy” to “By condition and signal”
- Verified test notifications can be sent to slack
I did create a new app after those the prior incidents worked, since the prior app was shared with a larger app. The query driving the alerts was updated to reference the new app id, but otherwise with no other logical changes.
I’ve tried a few other random things (delete and recreated the alert policy and messing with thresholds or aggregation windows) but no luck.
So I’m wondering if there’s some other setting/configuration that’s missing, or if there are open incidents that I can’t find, or something related to the new app id being created that’s causing this unexpected behavior.