Catalogue / bluesky-2025-lossy-timelines

Bluesky drops some timeline writes for users who follow huge numbers of accounts to stop hot shards, at over a million timeline writes a second

Bluesky, 2025. Following feed timeline fanout.

Organisation
Bluesky
Evidence
Reported from production
Source
When Imperfect Systems are Good, Actually: Bluesky's Lossy Timelines

Jaz's Blog, published 2025-02-19

Records

Failure#f1

Users who follow hundreds of thousands of accounts made hot shards that slowed the timelines sharing them

Decision#d1

Drop timeline writes with a probability set by how many accounts a user follows, accepting imperfect timelines

Decision#d2

Cache high-follow accounts in a Redis sorted set loaded into memory every 30 seconds instead of reading follow counts per write

Sign in to read what was chosen, what was rejected and what it cost, each with its place in the source. An account is free.