Rubric

How we grade AI deployments

Every Tuesday, Deploy Grade grades one real AI deployment. Each one is scored 0–4 on five criteria, the scores are weighted, and the result maps to a letter. Every grade is Deploy Grade’s opinion, based only on the public evidence available on the date we publish.

The five criteria

CriterionWeightA 4 looks likeA 0 looks like
Evidence30%Audited or regulator-filed numbers (e.g., SEC filings), consistent across sourcesAnonymous or unsourced claims
Measured outcome25%Defined metrics with a baseline, period and trendNo measurable outcome
Cost and payback transparency20%Cost of the system and dollars saved or earned, enough to estimate paybackNo cost information
Durability and risk controls15%Human fallback, monitoring, published failure modes, results sustained 12+ monthsNo controls disclosed, or known failures unaddressed
Transferability10%A typical 10–500-person company could copy it with off-the-shelf toolsRequires unique scale, data or budget

From score to letter

Weighted score = 0.30 × Evidence + 0.25 × Outcome + 0.20 × Cost and payback + 0.15 × Durability + 0.10 × Transferability.

LetterWeighted score
A3.4 or higher
B2.6 to 3.39
C1.8 to 2.59
D1.0 to 1.79
Fbelow 1.0

Worked example (Deploy Grade #1, Klarna): Evidence 4, Outcome 3, Cost and payback 2, Durability 2, Transferability 2. That’s 1.20 + 0.75 + 0.40 + 0.30 + 0.20 = 2.85, a B.

What a grade means, and what it doesn’t

A low grade means the public evidence is weak. It doesn’t prove the system performs badly. Companies can raise their grade by publishing better data, and we’ll re-grade and note the change.

We don’t contact graded companies before publication, and no company pays for or reviews a grade. Sponsors never touch grades. Grades are not investment advice.

Sourcing standard

Corrections

Spot an error? Write deploygrade@pm.me. We fix errors in the web version and note the fix at the top of the issue.

Subscribe free