Catalogue / cloudflare-2024-pingora-origin-trie

Cloudflare replaces linear header stripping with a custom contiguous Rust trie in pingora-origin to cut CPU by over 1%

Cloudflare, 2024. Pingora-origin (Rust HTTP proxy service forwarding non-cached requests to customer origins).

Organisation
Cloudflare
Evidence
Reported from production
Source
A good day to trie-hard: saving compute 1% at a time

The Cloudflare Blog, published 2024-09-10

Records

Decision#d1

Invert outbound header stripping to look up each request header in a static set instead of removing 100+ internal names

Decision#d2

Build a custom bit-packed contiguous Rust trie (trie-hard) for fast miss detection on internal HTTP headers

Sign in to read what was chosen, what was rejected and what it cost, each with its place in the source. An account is free.