Catalogue / netflix-2022-data-mesh

Netflix builds Data Mesh as a schema-enforced Kafka and Flink data movement and processing platform

Netflix, 2022. Data Mesh streaming data movement and processing platform.

Organisation
Netflix
Evidence
Reported from production
Source
Data Mesh — A Data Movement and Processing Platform @ Netflix

Netflix TechBlog, published 2022-08-01

Records

Decision#d1

Split Data Mesh into a declarative controller and composable Flink processors over shared Kafka topics

Decision#d2

Enforce Avro schemas on every pipeline with field-level lineage and automated consumer upgrades

Decision#d3

Pair managed database CDC connectors with a common application event-emission library

Sign in to read what was chosen, what was rejected and what it cost, each with its place in the source. An account is free.