An alert when a safety check pauses your A/B test
AddedA safety check can end an A/B test without anyone clicking anything. Until now you could only find out by opening the widget. AISA now opens a Test paused alert when that happens.
- The alert shows on the Alerts page with the site and the widget's name, and an Open the test button that leads to the widget's Experiment tab.
- Your organization's admins get an email. It goes out with the next hourly check, so it can arrive up to an hour after the pause. If one check finds several alerts, they share one email.
- The email and the alert show no figures. The Experiment tab is where you read what happened.
No alert opens when you stop a test, promote the candidate, switch the widget off or delete it.
The alert closes by itself when you start a new test on the widget, when the widget is deleted, or 14 days after it opened. The Resolved tab keeps it with the reason.
The REST endpoint GET /api/v1/alerts and the list_alerts tool of the MCP server list these alerts too, with the kind experiment_guardrail_paused and a subject of type experiment.
Resources
