Catalogue

Cards
165
Records
486
Workloads
19
Corpus version
74847648e25a
Workload
Kind
Setup

19 of 486 records match.

KindRecordOrganisationYearSetup
Failure

A dormant topology error and non-staged legacy rollout withdrew the BGP routes of Cloudflare's 1.1.1.1 Resolver globally, making it unavailable for 62 minutes

cloudflare-2025-1111-outage#f1

Cloudflare2025Multi-region
Failure

Automatic removal of IP bindings on 23 percent of edge servers delayed full recovery after BGP readvertisement

cloudflare-2025-1111-outage#f2

Cloudflare2025Multi-region
Failure

Missed deployment events across controller leadership changes delayed rollouts by up to 10 hours

uber-2024-kubernetes-compute-migration#f1

Uber2024Multi-region
Failure

Full-dataset production traffic acted like full table scans on Pinot, maxing out SSDs and breaching 10-second broker timeouts

uber-2024-job-counting-pinot#f1

Uber2024Sharded
Failure

Periodic 10-second rate-limiter bursts from upstream breached Pinot's 10-second broker timeout

uber-2024-job-counting-pinot#f2

Uber2024Sharded
Failure

Alertmanager inhibitions sometimes failed, and the failed ones had circular inhibition rules, found only when users reported being alerted

cloudflare-2024-alerts-observability#f1

Cloudflare2024
Failure

Hidden dependencies on PDX-04-only Kafka and ClickHouse broke HA control-plane services during a full-facility power loss

cloudflare-2023-control-plane-outage#f1

Cloudflare2023Multi-region
Failure

Failing over control-plane services to European disaster recovery sites triggered an API thundering herd

cloudflare-2023-control-plane-outage#f2

Cloudflare2023Multi-region
Failure

Faulty breakers and a full cold bootstrap of PDX-04 prolonged recovery; log push data from the outage was not recovered

cloudflare-2023-control-plane-outage#f3

Cloudflare2023Multi-region
Failure

Unintended automatic systemd update deleted Cilium CNI routes across five independent regions at once

datadog-2023-multiregion-systemd-outage#f1

Datadog2023Multi-region
Failure

Widely deployed NIC's 128-packet timestamp buffer overflowed and its driver silently substituted software timestamps

meta-2022-precision-time-protocol#f1

Meta2022Multi-region
Failure

Recurring 2020 CI/CD cascading failures when growth peaks overloaded Git, Checkpoint queues, and CI search

slack-2022-checkpoint-circuit-breakers#f1

Slack2022
Failure

Consul streaming channel contention and BoltDB freelist write amplification stall the sole coordination cluster

roblox-2021-consul-outage#f1

Roblox2021
Failure

Cold-start cache deployment failures prolong recovery after Consul stabilises

roblox-2021-consul-outage#f2

Roblox2021
Failure

A viral customer's pageviews backlog the shared queue for all sites while the database runs out of disk IOPS

fathom-2020-viral-customer-backlog#f1

Fathom Analytics2020One database
Failure

Unindexed backlog tables and a text-typed site ID kept the database slow after the disk was fixed

fathom-2020-viral-customer-backlog#f2

Fathom Analytics2020One database
Failure

Outage of one InfluxDB cluster dropped metrics from direct relays and left datacenters out of sync

hulu-2019-metrics-pipeline#f1peak of 100,000 requests/s or more

Hulu2019Multi-region
Failure

ZooKeeper conflict resolution marks ClickHouse tables read-only and causes Flink push-ingestion failures

lyft-2023-clickhouse-analytics#f1

Lyft
Failure

Uncompressed streaming Spark log writes caused SSD write-amplification and premature SSD burnout

uber-2022-spark-clp-logging#f1

Uber