I attempted to follow the process outlined here to recreate this sort of test and I’m not seeing consistent results. My scenario:
- I have a Scripted Synthetic Monitor that is set to run from 1 location every 5 minutes. (link to the exact monitor for NR https://synthetics.newrelic.com/accounts/1595621/monitors/a7726877-8516-48ac-b221-f96601abcf58 )
- I’ve setup The NRQL Alert to a Static baseline with a critical threshold to evaluate “When the sum of query results is below 1 at least once in 5 minutes” and left the evaluation offset to 3 minutes. ( link to the exact alert policy for NR https://alerts.newrelic.com/accounts/1595621/policies/481684/conditions/10761476/edit?selectedField=thresholds ).
However what I’m seeing is that the results sometimes jump to 2 and fall to 0 resulting in false positives. This is not ideal, did I misunderstand how this is supposed to work?