Catalogue / onlineornot-2023-lambda-write-fan-in

OnlineOrNot stops each uptime-check Lambda writing to Postgres directly and batches results through SNS and a queue

OnlineOrNot. Uptime check scheduling and result storage.

Organisation
OnlineOrNot
Evidence
Reported from production
Source
Scaling AWS Lambda and Postgres to thousands of simultaneous uptime checks

OnlineOrNot blog, published 2023-09-16

Records

Failure#f1

A hundred checker Lambdas each opened a database connection at once, and Postgres refused further connections

Decision#d1

Fan results in through SNS and a batching queue so one Lambda writes to Postgres, instead of upgrading the database

Sign in to read what was chosen, what was rejected and what it cost, each with its place in the source. An account is free.