Your data. Anywhere you go.

New Relic for iOS or Android


Download on the App Store    Android App on Google play


New Relic Insights App for iOS


Download on the App Store


Learn more

Close icon

Notification failure when incident closed


#1

Webhook “NOTIFICATION FAILED”, happened a few times a day for several days.
When a New Relic incident become closed, we have webhook to send notification, in our case, to Service Now.
But recently, we noticed several notifications failed to be sent. For example
https://alerts.newrelic.com/accounts/1926897/incidents/70920433/eventslog
https://alerts.newrelic.com/accounts/1926897/incidents/70920324/eventslog
https://alerts.newrelic.com/accounts/1926897/incidents/70925213/eventslog
https://alerts.newrelic.com/accounts/1926897/incidents/71608599/eventslog
Please let me know the cause and solution to fix.


#2

Hey @crystals -

I took a look and see that the links you sent reference two different alert notification channels. Upon further investigation I see that they both hit the same base URL; which is where the issue lies.

I see error details that list connection to that URL failing…

Unable to invoke Webhook: I/O error on POST request for \"https://ti*-***-**ow.****.com/hooks/***-newrelic\": Read timed out; nested exception is java.net.SocketTimeoutException: Read timed out

I have obfuscated the URL here - but will DM you the full error message.

Could you look at the URL and check if it has had any issues accepting connections?