Decision#d1
Catalogue / instacart-2023-ray-distributed-ml
Instacart replaces shared Celery ML task queues with ephemeral KubeRay clusters on AWS EKS
Instacart, 2023. Distributed ML training platform on Griffin (Ray on Kubernetes).
Records
Decision#d2
Isolate Python environments per Ray cluster behind a unified Griffin launcher API for dev and Airflow runs
Sign in to read what was chosen, what was rejected and what it cost, each with its place in the source. An account is free.