Catalogue / dropbox-2018-edgestore-transactions

Dropbox adds cross-shard two-phase commit to Edgestore at 10M RPS using an external transaction record and copy-on-write staging

Dropbox, 2018. Edgestore distributed metadata store.

Organisation
Dropbox
Evidence
Reported from production
Source
Cross shard transactions at 10 million requests per second

Dropbox.Tech, published 2018-11-09

Records

Decision#d1

Add modified two-phase commit with an external transaction record for cross-shard transactions in Edgestore

Decision#d2

Stage cross-shard commits with copy-on-write raw mutations in a secondary MySQL table instead of materialized copies

Decision#d3

Validate cross-shard 2PC with an offline precedence-graph test harness and live MySQL binlog shadow writes

Sign in to read what was chosen, what was rejected and what it cost, each with its place in the source. An account is free.