Catalogue / canva-2023-pir-summarizer

Canva automates Post Incident Report summaries with few-shot GPT-4-chat, HTML redaction, and Jira webhook tracking

Canva, 2023. Post Incident Report (PIR) automated summarization pipeline.

Organisation
Canva
Evidence
Reported from production
Source
Summarizing Post Incident Reviews with GPT-4

Canva Engineering Blog, published 2023-11-14

Records

Decision#d1

Use few-shot GPT-4-chat (gpt-4-32k) instead of fine-tuning davinci-002 or using the completion API

Decision#d2

Redact internal data pre-LLM, use soft 600-character prompt targets with retries, and track edits via Jira webhooks

Sign in to read what was chosen, what was rejected and what it cost, each with its place in the source. An account is free.