Catalogue / netflix-2024-pushy

Netflix scales its Pushy WebSocket proxy to 300,000 messages per second with connection-based autoscaling and direct push

Netflix, 2024. Pushy WebSocket proxy and messaging ecosystem.

Organisation
Netflix
Evidence
Reported from production
Source
Pushy to the Limit: Evolving Netflix's WebSocket proxy for the future

Netflix TechBlog, published 2024-09-10

Records

Decision#d1

Scale Pushy exponentially on connection count and raise per-node target from 60,000 to 200,000 connections

Decision#d2

Rewrite the fixed-size Mantis message processor as a standalone Spring Boot service

Decision#d3

Migrate the Push Registry from Dynomite to Netflix's managed KeyValue service

Decision#d4

Shift backend callers from the async queue to direct push for synchronous delivery feedback

Decision#d5

Route device-to-device messages over a generic JSON layer with Kafka presence tracking and local hot-path caching

Decision#d6

Add Pushy heartbeats, idle cleanup and client reconnect improvements to catch silent disconnects

Sign in to read what was chosen, what was rejected and what it cost, each with its place in the source. An account is free.