Catalogue / datadog-2025-cdc-replication

Datadog builds a multi-tenant asynchronous CDC platform on Debezium, Kafka Connect, Temporal and Schema Registry

Datadog, 2025. Multi-tenant CDC data replication platform.

Organisation
Datadog
Evidence
Reported from production
Source
Replication redefined: How we built a low-latency, multi-tenant data replication platform

Datadog Engineering, published 2025-11-04

Records

Decision#d1

Offload search and faceted filtering from shared Postgres to a dedicated search platform fed by denormalizing CDC

Decision#d2

Build the replication platform on asynchronous CDC via Debezium and Kafka Connect rather than synchronous replication

Decision#d3

Automate multi-step CDC pipeline provisioning with Temporal workflows

Decision#d4

Protect CDC pipelines from schema drift with pre-apply SQL validation and a backward-compatible Kafka Schema Registry

Decision#d5

Customize pipelines via Kafka Connect single message transforms, custom forks, and a centralized enrichment API

Sign in to read what was chosen, what was rejected and what it cost, each with its place in the source. An account is free.