Catalogue / segment-2018-goodbye-microservices

Segment folds over 140 per-destination microservices, queues and repos back into one monolith fed by Centrifuge

Twilio Segment, 2018. Server-side destinations pipeline.

Organisation
Twilio Segment
Evidence
Reported from production
Source
Goodbye Microservices: From 100s of problem children to 1 superstar

Twilio Blog, published 2018-07-10

Records

Decision#d1

Give every destination its own queue and service so one slow destination cannot delay the rest

Decision#d2

Split each destination's code into its own repo to isolate test failures

Decision#d3

Consolidate the over 140 destination services into one service, with Centrifuge planned to replace the queues

Decision#d4

Merge all destination code into one repo with a single version of every dependency

Decision#d5

Record and replay destination HTTP traffic in tests so the merged repo's suite is fast and reliable

Sign in to read what was chosen, what was rejected and what it cost, each with its place in the source. An account is free.