Catalogue
- Cards
- 165
- Records
- 486
- Workloads
- 19
- Corpus version
- 74847648e25a
28 of 486 records match; the first 20 are shown.
| Kind | Record | Organisation | Year | Setup |
|---|---|---|---|---|
| Decision | Replace managed object storage with Versity S3 Gateway on one server, backed up by rsync, to stop provider slowdowns | Healthchecks.io | 2026 | One server |
| Decision | Build an S3 and Spark data lake for update-heavy block data while keeping Snowflake and Fivetran for simpler workloads | Notion | 2024 | Sharded |
| Decision | Use Debezium-to-Kafka incremental CDC with one topic per table and RDS export-to-S3 only for bootstrapping | Notion | 2024 | Sharded |
| Decision | Choose Apache Hudi over Iceberg and Delta Lake and align S3 partitioning with Postgres's 480 shards | Notion | 2024 | Sharded |
| Decision | Land raw CDC data in S3 before processing and handle skewed shards differently in Scala Spark | Notion | 2024 | Sharded |
| Decision | Replace paginated job lookups with a dedicated Apache Pinot hybrid table for arbitrary-window job tenure counts | Uber | 2024 | Sharded |
| Failure | Full-dataset production traffic acted like full table scans on Pinot, maxing out SSDs and breaching 10-second broker timeouts | Uber | 2024 | Sharded |
| Decision | Prune off-heap MMAP Pinot segments with on-heap Bloom filters, 32 daily segments and a 30-minute consumer cache | Uber | 2024 | Sharded |
| Failure | Periodic 10-second rate-limiter bursts from upstream breached Pinot's 10-second broker timeout | Uber | 2024 | Sharded |
| Decision | Cover upstream trip data up to a week late with dynamic T-7d backfills and T-1d Hive COUNT(*) checks | Uber | 2024 | Sharded |
| Decision | Replace ad-hoc multi-hop legacy pipelines with one open-source Kafka and Flink platform | DoorDash | 2022 | Sharded |
| Decision | Put a customized async Confluent Kafka Rest Proxy in front of Kafka instead of direct clients in every service | DoorDash | 2022 | Sharded |
| Decision | Use replication factor 2, leader-only acknowledgments and 50ms to 100ms linger for non-transactional events | DoorDash | 2022 | Sharded |
| Decision | Register Protobuf event schemas in Confluent Schema Registry at build time in CI/CD instead of at runtime | DoorDash | 2022 | Sharded |
| Decision | Stage Kafka events to S3 Parquet via per-event Flink jobs before loading Snowflake with Snowpipe | DoorDash | 2022 | Sharded |
| Decision | Automate multi-repo Terraform event onboarding with a GitHub App, Cadence workflows and Retool UIs | DoorDash | 2022 | Sharded |
| Decision | Stop using DynamoDB and serve key/value lookups, ingest and rate limiting from one fixed-size SingleStore cluster | Fathom Analytics | 2021 | One database |
| Decision | Keep database connections open by moving the dashboard and queue off per-request Lambda connections | Fathom Analytics | 2021 | One database |
| Failure | A viral customer's pageviews backlog the shared queue for all sites while the database runs out of disk IOPS | Fathom Analytics | 2020 | One database |
| Failure | Unindexed backlog tables and a text-typed site ID kept the database slow after the disk was fixed | Fathom Analytics | 2020 | One database |
8 more records. Sign in to see all 28.