Catalogue

Cards
165
Records
486
Workloads
19
Corpus version
74847648e25a
Workload
Kind
Setup

20 of 486 records match.

KindRecordOrganisationYearSetup
Failure

Tarpit rate limiting held sockets open until the load balancers ran out of connection slots and rejected real traffic

healthchecks-2025-tarpit-outage#f1

Healthchecks.io2025
Failure

Recurring Amazon EBS latency spikes and I/O stalls trigger daily database partial failures and correlated single-AZ events

planetscale-2025-ebs-failure-handling#f1

PlanetScale2025
Failure

Full-dataset production traffic acted like full table scans on Pinot, maxing out SSDs and breaching 10-second broker timeouts

uber-2024-job-counting-pinot#f1

Uber2024Sharded
Failure

Periodic 10-second rate-limiter bursts from upstream breached Pinot's 10-second broker timeout

uber-2024-job-counting-pinot#f2

Uber2024Sharded
Failure

Alertmanager inhibitions sometimes failed, and the failed ones had circular inhibition rules, found only when users reported being alerted

cloudflare-2024-alerts-observability#f1

Cloudflare2024
Failure

Hidden dependencies on PDX-04-only Kafka and ClickHouse broke HA control-plane services during a full-facility power loss

cloudflare-2023-control-plane-outage#f1

Cloudflare2023Multi-region
Failure

Failing over control-plane services to European disaster recovery sites triggered an API thundering herd

cloudflare-2023-control-plane-outage#f2

Cloudflare2023Multi-region
Failure

Faulty breakers and a full cold bootstrap of PDX-04 prolonged recovery; log push data from the outage was not recovered

cloudflare-2023-control-plane-outage#f3

Cloudflare2023Multi-region
Failure

Unintended automatic systemd update deleted Cilium CNI routes across five independent regions at once

datadog-2023-multiregion-systemd-outage#f1

Datadog2023Multi-region
Failure

A bulk deletion script fed site IDs instead of app IDs deleted 883 customer sites with no warning

atlassian-2022-site-deletion-restore#f1

Atlassian2022Multi-region
Failure

Restoring hundreds of sites out of shared multi-tenant data stores had no batch tooling and took up to two weeks

atlassian-2022-site-deletion-restore#f2

Atlassian2022Multi-region
Failure

Recurring huge rogue transactions stalled shared MySQL primaries and triggered unwanted failovers

linkedin-2022-mysql-ha#f1

LinkedIn2022
Failure

A bug in per-tenant limit enforcement let one tenant overload a shared cluster, and error handling made the overload spread

grafana-2021-hosted-prometheus-outage#f1

Grafana Labs2021Multi-region
Failure

A viral customer's pageviews backlog the shared queue for all sites while the database runs out of disk IOPS

fathom-2020-viral-customer-backlog#f1

Fathom Analytics2020One database
Failure

Unindexed backlog tables and a text-typed site ID kept the database slow after the disk was fixed

fathom-2020-viral-customer-backlog#f2

Fathom Analytics2020One database
Failure

Outage of one InfluxDB cluster dropped metrics from direct relays and left datacenters out of sync

hulu-2019-metrics-pipeline#f1peak of 100,000 requests/s or more

Hulu2019Multi-region
Failure

Millions of message tombstones in one channel triggered 10-second Cassandra stop-the-world GC pauses

discord-2017-message-storage#f1

Discord2017Sharded
Failure

ZooKeeper conflict resolution marks ClickHouse tables read-only and causes Flink push-ingestion failures

lyft-2023-clickhouse-analytics#f1

Lyft
Failure

Uncompressed streaming Spark log writes caused SSD write-amplification and premature SSD burnout

uber-2022-spark-clp-logging#f1

Uber
Failure

Recurring noisy-neighbor bursts and expensive queries starved bare-metal Postgres clusters and blocked PgBouncer pools

cloudflare-2022-postgres-tenant-isolation#f1

CloudflareMulti-region