Delayed webhook alert notifications
Affected components
- Alerting
Updates
RESOLVED
Between October 31, 23:50 UTC and November 1, 11:51 UTC, webhook alert notifications were delayed by up to 6.4 hours. Notifications to endpoints that remained unreachable may not have been delivered. Check execution and other alert channels were not affected.
MONITORING
A fix has been implemented and we are monitoring the results.
IDENTIFIED
The backlog of delayed webhook notifications has been delivered and new webhook notifications are going out normally again. We have identified the cause and are monitoring delivery.
IDENTIFIED
The issue has been identified and we are working on a fix.
INVESTIGATING
Webhook alert notifications, including integrations delivered via webhook, have been delayed by up to several hours. Check execution and email, Slack and other alert channels are not affected.
INVESTIGATING
We are investigating the issue.