Alert didn't get triggered

###Alerts Question Template

  • Please describe what are you seeing:
    Hi,
    Here at Goibibo, we have created alerts for time when the web servers were returning more than 100 4xx/5xx for atleast 10 minutes. Yesterday, while we observed that the servers were returning this, the alert wasn’t triggered.

Can you please help me with the debugging please? Let me know if more information is required for it.

Regards,
Preetika

  • How does this differ from what were you expecting to see?

  • If you aren’t seeing expected alert or data, please provide a link to the incident or violation (policy, condition, data app etc.)
    Alert policy - Pigeon-dev
    Alert Condition - Pigeon 5XX Error Rate for External ALB and Pigeon 5XX Error Rate for Internal ALB. Time frame for this to be checked - 11:50 AM - 12:20 PM (IST)

Helpful Resources
Relic Solution: The key to consistent alert notifications

Troubleshooting downtime document

Hi @Preetika.Shukla

Please provide a link to the alert policy Pigeon-dev so we can take a look at why an alert violation was not opened.

@dkoyano

Here you go: https://alerts.newrelic.com/accounts/75783/policies/166148?page=0

Regards,
Preetika

Hi @Preetika.Shukla checking the query in Insights over the last 3 days it looks like the Maximum value returned is 96, are we covering the correct timeframe here? If not could you send a permalink of the correct time, thanks :slight_smile:

@rdouglas

Please find the time line when this was being thrown:

https://rpm.newrelic.com/accounts/75783/applications/9104219?tw[end]=1561359237&tw[start]=1561357412

Regards,
Preetika

Hi @Preetika.Shukla, i’m still not seeing this in Insights , the timeframe you specified (which links to an application that has no data reporting at that time either) odes not reflect what you are seeing. Could you please provide a NRQL query that covers the correct timeframe and i’d be happy to look into it :slight_smile: