Catalogue

Cards
165
Records
486
Workloads
19
Corpus version
74847648e25a
Workload
Kind
Setup

18 of 486 records match.

KindRecordOrganisationYearSetup
Failure

One customer's endpoint outage made deliveries time out, filled the shared worker pool and delayed Directory Sync webhooks for everyone

workos-2025-directory-sync-webhooks#f1

WorkOS2025
Failure

A dormant topology error and non-staged legacy rollout withdrew the BGP routes of Cloudflare's 1.1.1.1 Resolver globally, making it unavailable for 62 minutes

cloudflare-2025-1111-outage#f1

Cloudflare2025Multi-region
Failure

Automatic removal of IP bindings on 23 percent of edge servers delayed full recovery after BGP readvertisement

cloudflare-2025-1111-outage#f2

Cloudflare2025Multi-region
Failure

NOTIFY inside transactions serialized all commits globally on Postgres, causing three downtimes

recall-2025-postgres-listen-notify#f1

Recall.ai2025
Failure

Missed deployment events across controller leadership changes delayed rollouts by up to 10 hours

uber-2024-kubernetes-compute-migration#f1

Uber2024Multi-region
Failure

A surge of duplicate webhooks and the retry setup filled one queue's provider quota, so new events were not delivered for hours

onfido-2024-webhooks#f1

Onfido2024
Failure

Hidden dependencies on PDX-04-only Kafka and ClickHouse broke HA control-plane services during a full-facility power loss

cloudflare-2023-control-plane-outage#f1

Cloudflare2023Multi-region
Failure

Failing over control-plane services to European disaster recovery sites triggered an API thundering herd

cloudflare-2023-control-plane-outage#f2

Cloudflare2023Multi-region
Failure

Faulty breakers and a full cold bootstrap of PDX-04 prolonged recovery; log push data from the outage was not recovered

cloudflare-2023-control-plane-outage#f3

Cloudflare2023Multi-region
Failure

Widely deployed NIC's 128-packet timestamp buffer overflowed and its driver silently substituted software timestamps

meta-2022-precision-time-protocol#f1

Meta2022Multi-region
Failure

Recurring 2020 CI/CD cascading failures when growth peaks overloaded Git, Checkpoint queues, and CI search

slack-2022-checkpoint-circuit-breakers#f1

Slack2022
Failure

Consul streaming channel contention and BoltDB freelist write amplification stall the sole coordination cluster

roblox-2021-consul-outage#f1

Roblox2021
Failure

Cold-start cache deployment failures prolong recovery after Consul stabilises

roblox-2021-consul-outage#f2

Roblox2021
Failure

Resuming from the last sent MySQL auto-increment id made the new webhook sender skip transactions in testing

nylas-2018-webhooks#f1

Nylas2018Sharded
Failure

Rebuilding a lagging replica by hand ended with the primary's data directory being wiped

gitlab-2017-database-outage#f1

GitLab2017One database
Failure

Daily pg_dump backups had been silently failing, and Azure disk snapshots were not enabled on the database servers

gitlab-2017-database-outage#f2

GitLab2017One database
Failure

Inherited string comparison in custom encrypted type caused false 2FA recovery-code audit alerts during rollout

github-2022-activerecord-column-encryption#f1

GitHub
Failure

Recurring noisy-neighbor bursts and expensive queries starved bare-metal Postgres clusters and blocked PgBouncer pools

cloudflare-2022-postgres-tenant-isolation#f1

CloudflareMulti-region