Catalogue

Cards
165
Records
486
Workloads
19
Corpus version
74847648e25a
Workload
Kind
Setup

23 of 486 records match; the first 20 are shown.

KindRecordOrganisationYearSetup
Failure

Daily peak event burst saturated shared database primary, and with no automatic circuit breaker the throttling was manual

github-2026-actions-db-saturation#f1

GitHub2026
Failure

Brief pod reduction during routine rollout saturated remaining sites, OOMed service-mesh sidecars, and triggered invalid-job runner retries

github-2026-actions-rollout-saturation#f1

GitHub2026Multi-region
Failure

Traffic peak overloaded one datacenter's load balancers while a service-mesh sidecar failed to scale, and a client retry bug amplified authentication traffic

github-2026-load-balancer-sidecar-overload#f1

GitHub2026Multi-region
Failure

Connection pools that recycled every 15 minutes synchronized into a thundering herd after a managed Postgres upgrade

clerk-2025-database-connection-recycling#f1

Clerk2025
Failure

Recurring incidents where errors on the Pushes MySQL cluster early in RepositoryPushJob kept unrelated pull requests from synchronizing

github-2024-push-processing#f1

GitHub2024
Failure

Full-dataset production traffic acted like full table scans on Pinot, maxing out SSDs and breaching 10-second broker timeouts

uber-2024-job-counting-pinot#f1

Uber2024Sharded
Failure

Periodic 10-second rate-limiter bursts from upstream breached Pinot's 10-second broker timeout

uber-2024-job-counting-pinot#f2

Uber2024Sharded
Failure

Alertmanager inhibitions sometimes failed, and the failed ones had circular inhibition rules, found only when users reported being alerted

cloudflare-2024-alerts-observability#f1

Cloudflare2024
Failure

Hidden dependencies on PDX-04-only Kafka and ClickHouse broke HA control-plane services during a full-facility power loss

cloudflare-2023-control-plane-outage#f1

Cloudflare2023Multi-region
Failure

Failing over control-plane services to European disaster recovery sites triggered an API thundering herd

cloudflare-2023-control-plane-outage#f2

Cloudflare2023Multi-region
Failure

Faulty breakers and a full cold bootstrap of PDX-04 prolonged recovery; log push data from the outage was not recovered

cloudflare-2023-control-plane-outage#f3

Cloudflare2023Multi-region
Failure

Unintended automatic systemd update deleted Cilium CNI routes across five independent regions at once

datadog-2023-multiregion-systemd-outage#f1

Datadog2023Multi-region
Failure

Recurring 2020 CI/CD cascading failures when growth peaks overloaded Git, Checkpoint queues, and CI search

slack-2022-checkpoint-circuit-breakers#f1

Slack2022
Failure

A viral customer's pageviews backlog the shared queue for all sites while the database runs out of disk IOPS

fathom-2020-viral-customer-backlog#f1

Fathom Analytics2020One database
Failure

Unindexed backlog tables and a text-typed site ID kept the database slow after the disk was fixed

fathom-2020-viral-customer-backlog#f2

Fathom Analytics2020One database
Failure

Outage of one InfluxDB cluster dropped metrics from direct relays and left datacenters out of sync

hulu-2019-metrics-pipeline#f1peak of 100,000 requests/s or more

Hulu2019Multi-region
Failure

Database contention filled Redis memory, and a full Redis could neither accept nor release jobs

slack-2017-job-queue#f1peak under 100,000 requests/s

Slack2017Sharded
Failure

ZooKeeper conflict resolution marks ClickHouse tables read-only and causes Flink push-ingestion failures

lyft-2023-clickhouse-analytics#f1

Lyft
Failure

A hundred checker Lambdas each opened a database connection at once, and Postgres refused further connections

onlineornot-2023-lambda-write-fan-in#f1

OnlineOrNotOne database
Failure

Unrelated connection leak failed Cadence inventory workflows, recovered by touching database timestamps

doordash-2022-dashmart-inventory-cdc#f1

DoorDash

3 more records. Sign in to see all 23.