Catalogue / doordash-2022-dashmart-inventory-cdc

DoorDash processes DashMart inventory updates via CockroachDB changefeeds, Kafka, and Cadence

DoorDash. DashMart real-time inventory change-processing pipeline.

Organisation
DoorDash
Evidence
Reported from production
Source
Leveraging CockroachDB’s Change Feed for Real-Time Inventory Data Processing

DoorDash Engineering, published 2022-11-21

Records

Decision#d1

Propagate inventory updates through CockroachDB changefeeds, Kafka, and long-running Cadence workflows

Decision#d2

Run one Kafka consumer per inventory table with pluggable subprocessors instead of one consumer per use case

Failure#f1

Unrelated connection leak failed Cadence inventory workflows, recovered by touching database timestamps

Sign in to read what was chosen, what was rejected and what it cost, each with its place in the source. An account is free.