Catalogue / github-2025-copilot-secret-scanning

GitHub builds and scales LLM password scanning with MetaReflection prompts, mirror testing, and dynamic workload limits

GitHub, 2025. Copilot secret scanning (generic password detection in GitHub Secret Protection).

Organisation
GitHub
Evidence
Reported from production
Source
Finding leaked passwords with AI: How we built Copilot secret scanning

The GitHub Blog, published 2025-03-04

Records

Decision#d1

Pair GPT-4 confirmation and MetaReflection hybrid prompts with expanded offline evaluation to curb LLM false positives

Decision#d2

Share LLM capacity across push and full-history scans with dynamic rate-limit ranges and filepath exclusions

Decision#d3

Validate prompt and filter changes via mirror testing on public-preview repositories before GA

Sign in to read what was chosen, what was rejected and what it cost, each with its place in the source. An account is free.