Catalogue
- Cards
- 165
- Records
- 486
- Workloads
- 19
- Corpus version
- 74847648e25a
27 of 486 records match; the first 20 are shown.
| Kind | Record | Organisation | Year | Setup |
|---|---|---|---|---|
| Failure | Daily peak event burst saturated shared database primary, and with no automatic circuit breaker the throttling was manual | GitHub | 2026 | |
| Failure | Brief pod reduction during routine rollout saturated remaining sites, OOMed service-mesh sidecars, and triggered invalid-job runner retries | GitHub | 2026 | Multi-region |
| Failure | Traffic peak overloaded one datacenter's load balancers while a service-mesh sidecar failed to scale, and a client retry bug amplified authentication traffic | GitHub | 2026 | Multi-region |
| Failure | Connection pools that recycled every 15 minutes synchronized into a thundering herd after a managed Postgres upgrade | Clerk | 2025 | |
| Failure | Traffic from one collaborative drawing site spikes load to 100,000 req/s while nginx logs too-many-open-files errors | OpenFreeMap | 2025 | |
| Failure | Recurring brief live viewing interruptions triggered manual stream restarts and 10x traffic increases | Netflix | 2025 | Multi-region |
| Failure | Recurring incidents where errors on the Pushes MySQL cluster early in RepositoryPushJob kept unrelated pull requests from synchronizing | GitHub | 2024 | |
| Failure | Full-dataset production traffic acted like full table scans on Pinot, maxing out SSDs and breaching 10-second broker timeouts | Uber | 2024 | Sharded |
| Failure | Periodic 10-second rate-limiter bursts from upstream breached Pinot's 10-second broker timeout | Uber | 2024 | Sharded |
| Failure | Alertmanager inhibitions sometimes failed, and the failed ones had circular inhibition rules, found only when users reported being alerted | Cloudflare | 2024 | |
| Failure | Linux TCP even/odd ephemeral port split causes bimodal connect() latency past half port utilization | Cloudflare | 2024 | |
| Failure | Hidden dependencies on PDX-04-only Kafka and ClickHouse broke HA control-plane services during a full-facility power loss | Cloudflare | 2023 | Multi-region |
| Failure | Failing over control-plane services to European disaster recovery sites triggered an API thundering herd | Cloudflare | 2023 | Multi-region |
| Failure | Faulty breakers and a full cold bootstrap of PDX-04 prolonged recovery; log push data from the outage was not recovered | Cloudflare | 2023 | Multi-region |
| Failure | Unintended automatic systemd update deleted Cilium CNI routes across five independent regions at once | Datadog | 2023 | Multi-region |
| Failure | Recurring 2020 CI/CD cascading failures when growth peaks overloaded Git, Checkpoint queues, and CI search | Slack | 2022 | |
| Failure | Interleaved two-round cache fill and transient invalidation error left stale metadata cached at the latest version | Meta | 2022 | |
| Failure | A viral customer's pageviews backlog the shared queue for all sites while the database runs out of disk IOPS | Fathom Analytics | 2020 | One database |
| Failure | Unindexed backlog tables and a text-typed site ID kept the database slow after the disk was fixed | Fathom Analytics | 2020 | One database |
| Failure | Outage of one InfluxDB cluster dropped metrics from direct relays and left datacenters out of sync | Hulu | 2019 | Multi-region |
7 more records. Sign in to see all 27.