Catalogue / lyft-2020-kubernetes-cronjobs

Lyft runs nearly 500 Kubernetes CronJobs and documents start-delay, missed-run, and alerting pitfalls

Lyft. Multi-tenant Kubernetes CronJob platform.

Organisation
Lyft
Evidence
Reported from production
Source
How we learned to improve Kubernetes CronJobs at Scale (Part 1 of 2)

Lyft Engineering, published 2020-08-03

Records

Decision#d1

Migrate scheduled tasks from dedicated Linux hosts running Unix cron to multi-tenant Kubernetes CronJobs

Failure#f1

Controller rate-limiting, top-of-hour bursts, and sidecar startup caused CronJobs to miss runs and get stuck

Sign in to read what was chosen, what was rejected and what it cost, each with its place in the source. An account is free.