Incident Report: US Database Cluster Outage

Summary

At approximately 04:10 AEST on 1st of October 2025, Relevance experienced a platform outage when our US database cluster entered a failure state. While the cluster appeared online, it was unable to process operations correctly, which caused the global API to become unavailable by 04:30 AEST.

On-call team was automatically paged. They began investigating and identified the issue was in our database infrastructure rather than our ...

Incident Report: Feature Flag Provider Outage

Summary

At ~17:00 UTC, our feature flag provider experienced an outage that led to elevated errors and slower response times in their API. Our caching system initially mitigated the impact, but as the outage worsened, cached values began to expire, resulting in elevated latency and slowness across our platform. Normal service was restored by ~18:40 UTC.

Timeline (UTC)

• 17:00 – Feature flag provider outage begins, causin...