Catalogue

Cards
165
Records
486
Workloads
19
Corpus version
74847648e25a
Workload
Kind
Setup

19 of 486 records match.

KindRecordOrganisationYearSetup
Failure

Recurring Amazon EBS latency spikes and I/O stalls trigger daily database partial failures and correlated single-AZ events

planetscale-2025-ebs-failure-handling#f1

PlanetScale2025
Failure

Full-dataset production traffic acted like full table scans on Pinot, maxing out SSDs and breaching 10-second broker timeouts

uber-2024-job-counting-pinot#f1

Uber2024Sharded
Failure

Periodic 10-second rate-limiter bursts from upstream breached Pinot's 10-second broker timeout

uber-2024-job-counting-pinot#f2

Uber2024Sharded
Failure

Alertmanager inhibitions sometimes failed, and the failed ones had circular inhibition rules, found only when users reported being alerted

cloudflare-2024-alerts-observability#f1

Cloudflare2024
Failure

Hidden dependencies on PDX-04-only Kafka and ClickHouse broke HA control-plane services during a full-facility power loss

cloudflare-2023-control-plane-outage#f1

Cloudflare2023Multi-region
Failure

Failing over control-plane services to European disaster recovery sites triggered an API thundering herd

cloudflare-2023-control-plane-outage#f2

Cloudflare2023Multi-region
Failure

Faulty breakers and a full cold bootstrap of PDX-04 prolonged recovery; log push data from the outage was not recovered

cloudflare-2023-control-plane-outage#f3

Cloudflare2023Multi-region
Failure

Unintended automatic systemd update deleted Cilium CNI routes across five independent regions at once

datadog-2023-multiregion-systemd-outage#f1

Datadog2023Multi-region
Failure

A bulk deletion script fed site IDs instead of app IDs deleted 883 customer sites with no warning

atlassian-2022-site-deletion-restore#f1

Atlassian2022Multi-region
Failure

Restoring hundreds of sites out of shared multi-tenant data stores had no batch tooling and took up to two weeks

atlassian-2022-site-deletion-restore#f2

Atlassian2022Multi-region
Failure

Recurring huge rogue transactions stalled shared MySQL primaries and triggered unwanted failovers

linkedin-2022-mysql-ha#f1

LinkedIn2022
Failure

A bug in per-tenant limit enforcement let one tenant overload a shared cluster, and error handling made the overload spread

grafana-2021-hosted-prometheus-outage#f1

Grafana Labs2021Multi-region
Failure

A viral customer's pageviews backlog the shared queue for all sites while the database runs out of disk IOPS

fathom-2020-viral-customer-backlog#f1

Fathom Analytics2020One database
Failure

Unindexed backlog tables and a text-typed site ID kept the database slow after the disk was fixed

fathom-2020-viral-customer-backlog#f2

Fathom Analytics2020One database
Failure

Outage of one InfluxDB cluster dropped metrics from direct relays and left datacenters out of sync

hulu-2019-metrics-pipeline#f1peak of 100,000 requests/s or more

Hulu2019Multi-region
Failure

Millions of message tombstones in one channel triggered 10-second Cassandra stop-the-world GC pauses

discord-2017-message-storage#f1

Discord2017Sharded
Failure

ZooKeeper conflict resolution marks ClickHouse tables read-only and causes Flink push-ingestion failures

lyft-2023-clickhouse-analytics#f1

Lyft
Failure

Uncompressed streaming Spark log writes caused SSD write-amplification and premature SSD burnout

uber-2022-spark-clp-logging#f1

Uber
Failure

Recurring noisy-neighbor bursts and expensive queries starved bare-metal Postgres clusters and blocked PgBouncer pools

cloudflare-2022-postgres-tenant-isolation#f1

CloudflareMulti-region