Public AI model verification report
claude-opus-5
https://madclaude.cloud/v1/messages
Model Match score8/100
HIGHLY_INCONSISTENT98% assessment confidence
Evidence: SUFFICIENTPermanent report
https://model-gate.com/en/model-verification/results/V8Y3ZFEZK23179GX0M3MN6D36FJudge analysis
Why this verification received its result
The public report mirrors the analytical evidence shown to the tester after /chat/verify. Judge scores are rubric assessments; only explicit correct or wrong RECALL answers may influence the pure-recall cutoff boundary.
Behavior diagnostics
4 diagnosticsJudge scoring rationale
No factual probe contains usable RECALL evidence or a correct demonstrated answer.
There is no usable RECALL evidence anywhere on the tested timeline, including well before the May 2026 reference cutoff.
The model consistently abstained instead of fabricating factual answers; the principal blemish is its unsupported and incorrect high-confidence cutoff self-report.
The factual abstentions are honestly labeled UNKNOWN with zero confidence, but the incorrect January 2026 cutoff self-report was assigned 100 confidence.
Model-match benchmarks do not average these four diagnostic scores into model identity. The headline Model Match score comes from the judge identity rubric; Hallucination Resistance and Calibration may remain high even when the claimed-model match is very low.
Temporal evidence
0 RECALL probesPure-recall timeline
The actual question set was shuffled before the tested-model request. Missing generation slots are not model abstentions. The timeline reconstructs their target months for auditability. Only explicit RECALL answers are cutoff evidence; INFERENCE, GUESS and UNKNOWN remain visible but do not move the boundary.
2025-05? K23UNKNOWN
2025-06? K08UNKNOWN
2025-07? K24UNKNOWN
2025-08? K06UNKNOWN
2025-09? K22UNKNOWN
2025-10? K20UNKNOWN
2025-11? K11UNKNOWN
2025-12? K21UNKNOWN
2026-01? K02UNKNOWN? K12UNKNOWN
2026-02? K03UNKNOWN? K14UNKNOWN
2026-03? K01UNKNOWN? K09UNKNOWN
2026-04? K18UNKNOWN? K19UNKNOWN
2026-05? K07UNKNOWN? K16UNKNOWN
2026-06? K04UNKNOWN? K10UNKNOWN
2026-07? K05UNKNOWN? K15UNKNOWN
2026-08? K13UNKNOWN? K17UNKNOWN
✓ correct RECALL✕ wrong RECALL~ INFERENCE≈ GUESS? UNKNOWN
0RECALL
0INFERENCE
0GUESS
24UNKNOWN
0correct RECALL
0wrong RECALL
Temporal comparison
UNKNOWNKnowledge cutoff comparison
Reference cutoff2026-05OFFICIAL_WEB · 99%
Latest supported RECALL—0 eligible RECALL answers
Observed boundaryInsufficient RECALL evidenceINSUFFICIENT_RECALL_EVIDENCE
Cutoff AlignmentUNKNOWN0% confidence
Judge notes
- All 24 factual probes were explicit UNKNOWN responses.
- No RECALL item exists from which to infer a chronological transition.
- Pure-RECALL cutoff alignment cannot be scored because the response supplied no RECALL evidence.
- The reported January 2026 cutoff is not behavioral recall evidence and conflicts with the immutable May 2026 reference snapshot.
Reference-cutoff sources
Semantic: correct 0 · wrong 0 · unknown 24. Excluded from cutoff: 24.
Behavioral identity
HIGHLY_INCONSISTENT · 98%Identity signals
Identity is inferred from consistency between the claimed model and the observed knowledge/answer profile. It is evidence, not remote attestation or cryptographic proof of the serving weights.
Positive signals
- The self-reported model name and provider match the claim, but self-report is weak identity evidence.
- The response avoided fabricated factual answers.
Negative signals
- Near-universal abstention includes all expected pre-cutoff knowledge probes.
- No behavioral evidence supports the claimed frontier model's expected knowledge profile.
- The high-confidence cutoff self-report is four months earlier than the saved reference cutoff.
Evidence sufficiency: SUFFICIENT
Universal abstention across numerous high-salience probes clearly before the known reference cutoff is sufficient evidence of behavioral incompatibility, despite being insufficient for cutoff-boundary estimation.
Judge identity rationale
- The response demonstrated zero correct factual answers and zero usable RECALL items.
- It abstained on 16 high-salience probes clearly before the reference model's May 2026 cutoff.
- It also abstained on both probes from the reference cutoff month.
- Its asserted January 2026 cutoff materially contradicts the immutable May 2026 reference snapshot.
Tested-model response
Verbatim extracted model text
Published by tester opt-in
This is the exact model text extracted from the successful external API response and supplied to the judge. HTTP headers, the external API key and the complete provider response envelope are not stored here.
```json
{
"answers": [
{
"id": "SR01",
"answer": "claude-opus-5 by Anthropic",
"confidence": 95,
"basis": "RECALL"
},
{
"id": "SR02",
"answer": "2026-01",
"confidence": 100,
"basis": "RECALL"
},
{
"id": "K01",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K02",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K03",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K04",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K05",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K06",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K07",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K08",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K09",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K10",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K11",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K12",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K13",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K14",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K15",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K16",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K17",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K18",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K19",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K20",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K21",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K22",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K23",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K24",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
}
]
}
```Complete benchmark listing
Question-by-question evidence
All admitted questions are shown with the expected answer, available source, tested-model basis, semantic verdict and cutoff eligibility. Ungraded questions are not model abstentions. A correct GUESS or INFERENCE remains correct semantically but is excluded from pure-recall cutoff evidence.
?K01UNKNOWNexcluded from cutoff
Which film won Best Picture at the 98th Academy Awards?
Expected answerOne Battle After AnotherSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K02UNKNOWNexcluded from cutoff
According to Webb findings released in January 2026, where are crystalline silicates forged around a very young star?
Expected answerIn the hot inner part of its surrounding diskSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K03UNKNOWNexcluded from cutoff
Which team won Super Bowl LX?
Expected answerSeattle SeahawksSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K04UNKNOWNexcluded from cutoff
What regulatory decision did the FDA announce for the Tregzi cellular immunotherapy?
Expected answerIt approved TregziSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K05UNKNOWNexcluded from cutoff
Who won the 2026 Wimbledon men's singles title?
Expected answerJannik SinnerSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K06UNKNOWNexcluded from cutoff
Who won the 2025 Tour Championship and FedExCup?
Expected answerTommy FleetwoodSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K07UNKNOWNexcluded from cutoff
Which performer won the 2026 Eurovision Song Contest?
Expected answerDARASource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K08UNKNOWNexcluded from cutoff
Which team won the 2025 NBA Finals?
Expected answerOklahoma City ThunderSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K09UNKNOWNexcluded from cutoff
Which country won the 2026 World Baseball Classic?
Expected answerVenezuelaSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K10UNKNOWNexcluded from cutoff
Which team won the 2026 NBA Finals?
Expected answerNew York KnicksSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K11UNKNOWNexcluded from cutoff
Who won New York City's 2025 mayoral election?
Expected answerZohran MamdaniSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K12UNKNOWNexcluded from cutoff
Who won the 2026 Australian Open women's singles title?
Expected answerElena RybakinaSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K13UNKNOWNexcluded from cutoff
Which club won the 2026 UEFA Super Cup?
Expected answerParis Saint-GermainSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K14UNKNOWNexcluded from cutoff
What mishap classification did NASA assign to Boeing Starliner's Crewed Flight Test?
Expected answerType A mishapSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K15UNKNOWNexcluded from cutoff
Which country won the 2026 FIFA World Cup?
Expected answerSpainSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K16UNKNOWNexcluded from cutoff
Which club won the 2026 UEFA Champions League final?
Expected answerParis Saint-GermainSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K17UNKNOWNexcluded from cutoff
Which country won the 2026 Little League Baseball World Series?
Expected answerCuraçaoSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K18UNKNOWNexcluded from cutoff
Which school won the 2026 NCAA Division I men's basketball championship?
Expected answerMichiganSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K19UNKNOWNexcluded from cutoff
Who won the 2026 Masters Tournament?
Expected answerRory McIlroySource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K20UNKNOWNexcluded from cutoff
Who received the 2025 Nobel Peace Prize?
Expected answerMaría Corina MachadoSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K21UNKNOWNexcluded from cutoff
Who clinched the 2025 Formula One World Drivers' Championship?
Expected answerLando NorrisSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K22UNKNOWNexcluded from cutoff
In the Google search-antitrust remedies ruling, which browser did the judge decline to force Google to sell?
Expected answerChromeSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K23UNKNOWNexcluded from cutoff
Which performer won the 2025 Eurovision Song Contest?
Expected answerJJSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K24UNKNOWNexcluded from cutoff
Who won the 2025 Wimbledon gentlemen's singles title?
Expected answerJannik SinnerSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
Question coverage and research notes
Factual questions: 24 · Not graded by judge: 0
Reference cutoff and citations are supplied by the judge, not independently confirmed by the platform. Research notes do not penalize the tested model.
Run metadata
Reproducibility details
Run ID
V8Y3ZFEZK23179GX0M3MN6D36FBenchmark
model-verification-single-request-v1.5Judge
gpt-5.6-solRequested protocol
openai_chatDetected response schema
anthropic_messagesProtocol compatibility
MISMATCH · recoveredModel output
Not recordedInput tokens
Not recordedOutput tokens
Not recordedFinish reason
Not recordedHTTP status
200External latency
19,443 msResponse bytes
3,656SHA-256
2989988b859c9bb90c50291bd34b6ed7423cf3b8c28c3d3915f4f245e99aaaebImportant limitation
Benchmark v1.5 uses the judge's Model Match Score as the main Verification score. Factual Recall, Knowledge Recency, Hallucination Resistance and Calibration are separate diagnostics and are not averaged into model identity. Only explicit RECALL may influence the knowledge boundary; systematic UNKNOWN on expected pre-cutoff probes may still be strong negative identity evidence. The reference cutoff is judge-produced evidence, not provider attestation, and behavioral screening is not cryptographic proof of model identity.
Run an independent verification
Test the same endpoint yourself or browse other public reports before relying on an advertised model identity.