Public AI model verification report
claude-opus-5
https://madclaude.cloud/v1/messages
Legacy quality score38/100
SUSPICIOUS65% assessment confidence
Permanent report
https://model-gate.com/en/model-verification/results/MBAJ09XSXC0CSHVAV73EJTBTRQJudge analysis
Why this verification received its result
The public report mirrors the analytical evidence shown to the tester after /chat/verify. Judge scores are rubric assessments; only explicit correct or wrong RECALL answers may influence the pure-recall cutoff boundary.
Behavior diagnostics
4 diagnosticsJudge scoring rationale
No item contains usable RECALL evidence, so the response demonstrates no factual recall.
There is no usable recent RECALL evidence at any point in the tested timeline.
The response consistently abstains and makes no unsupported factual assertions.
Every abstention is labeled UNKNOWN with zero confidence, accurately representing the absence of an answer.
Historical benchmark note: this archived v1.4 overall score used the former fixed diagnostic aggregation. It is retained for reproducibility and must not be interpreted as a v1.5 Model Match score.
Temporal evidence
0 RECALL probesPure-recall timeline
The actual question set was shuffled before the tested-model request. Missing generation slots are not model abstentions. The timeline reconstructs their target months for auditability. Only explicit RECALL answers are cutoff evidence; INFERENCE, GUESS and UNKNOWN remain visible but do not move the boundary.
2025-05? K21UNKNOWN
2025-06? K20UNKNOWN
2025-07? K09UNKNOWN
2025-08? K10UNKNOWN
2025-09? K06UNKNOWN
2025-10? K15UNKNOWN
2025-11? K14UNKNOWN
2025-12? K07UNKNOWN
2026-01? K08UNKNOWN? K17UNKNOWN
2026-02? K12UNKNOWN? K13UNKNOWN
2026-03? K11UNKNOWN? K19UNKNOWN
2026-04? K02UNKNOWN? K03UNKNOWN
2026-05? K22UNKNOWN? K24UNKNOWN
2026-06? K01UNKNOWN? K23UNKNOWN
2026-07? K16UNKNOWN? K18UNKNOWN
2026-08? K04UNKNOWN? K05UNKNOWN
✓ correct RECALL✕ wrong RECALL~ INFERENCE≈ GUESS? UNKNOWN
0RECALL
0INFERENCE
0GUESS
24UNKNOWN
0correct RECALL
0wrong RECALL
Temporal comparison
UNKNOWNKnowledge cutoff comparison
Reference cutoff2026-05OFFICIAL_WEB · 100%
Latest supported RECALL—0 eligible RECALL answers
Observed boundaryInsufficient RECALL evidenceINSUFFICIENT_RECALL_EVIDENCE
Cutoff AlignmentUNKNOWN0% confidence
Judge notes
- No answer was reported with a RECALL basis.
- No positive or negative recall sequence exists from which to infer a transition.
- The May 2026 reference cutoff is known, but the tested response supplies no pure-RECALL behavioral evidence for comparison.
- A cutoff boundary cannot be manufactured from explicit abstentions.
Reference-cutoff sources
Semantic: correct 0 · wrong 0 · unknown 24. Excluded from cutoff: 24.
Behavioral identity
SUSPICIOUS · 65%Identity signals
Identity is inferred from consistency between the claimed model and the observed knowledge/answer profile. It is evidence, not remote attestation or cryptographic proof of the serving weights.
Positive signals
- The response is internally consistent and avoids fabrication.
- All required answer IDs are present and recoverable.
Negative signals
- No factual answer or RECALL evidence was supplied for any of the 24 probes.
- The endpoint's claimed model and API identifier are untrusted self-report and receive no behavioral corroboration.
- The complete lack of demonstrated pre-cutoff knowledge is atypical of the claimed reference snapshot.
Judge identity rationale
- The response provides no behavioral evidence supporting the claimed model identity.
- Universal abstention includes numerous high-salience probes dated before the saved May 2026 reference cutoff.
- Because there are no incorrect recall claims, the evidence supports suspicion rather than a highly inconsistent determination.
Tested-model response
Verbatim extracted model text
Published by tester opt-in
This is the exact model text extracted from the successful external API response and supplied to the judge. HTTP headers, the external API key and the complete provider response envelope are not stored here.
```json
{
"answers": [
{
"id": "SR01",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "SR02",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K01",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K02",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K03",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K04",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K05",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K06",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K07",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K08",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K09",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K10",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K11",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K12",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K13",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K14",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K15",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K16",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K17",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K18",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K19",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K20",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K21",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K22",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K23",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K24",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
}
]
}
```Complete benchmark listing
Question-by-question evidence
All admitted questions are shown with the expected answer, available source, tested-model basis, semantic verdict and cutoff eligibility. Ungraded questions are not model abstentions. A correct GUESS or INFERENCE remains correct semantically but is excluded from pure-recall cutoff evidence.
?K01UNKNOWNexcluded from cutoff
Who won Colombia's 2026 presidential runoff election?
Expected answerAbelardo de la EspriellaSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K02UNKNOWNexcluded from cutoff
Who won the 2026 Masters Tournament?
Expected answerRory McIlroySource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K03UNKNOWNexcluded from cutoff
Which party won Hungary's 2026 parliamentary election?
Expected answerTisza PartySource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K04UNKNOWNexcluded from cutoff
Which instability did the Inouye Solar Telescope provide the first experimental confirmation of in the Sun's photosphere?
Expected answerKelvin-Helmholtz instabilitySource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K05UNKNOWNexcluded from cutoff
Who was declared the winner of Zambia's 2026 presidential election?
Expected answerHakainde HichilemaSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K06UNKNOWNexcluded from cutoff
Which series won Outstanding Drama Series at the 77th Emmy Awards?
Expected answerThe PittSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K07UNKNOWNexcluded from cutoff
Who clinched the 2025 Formula One World Drivers' Championship at the Abu Dhabi Grand Prix?
Expected answerLando NorrisSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K08UNKNOWNexcluded from cutoff
Which film won Best Motion Picture — Drama at the 2026 Golden Globes?
Expected answerHamnetSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K09UNKNOWNexcluded from cutoff
Who won the 2025 Wimbledon gentlemen's singles title?
Expected answerJannik SinnerSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K10UNKNOWNexcluded from cutoff
Which club won the 2025 UEFA Super Cup?
Expected answerParis Saint-GermainSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K11UNKNOWNexcluded from cutoff
Which country won the 2026 World Baseball Classic?
Expected answerVenezuelaSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K12UNKNOWNexcluded from cutoff
Which team won Super Bowl LX?
Expected answerSeattle SeahawksSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K13UNKNOWNexcluded from cutoff
Which artist won Album of the Year at the 2026 Grammy Awards?
Expected answerBad BunnySource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K14UNKNOWNexcluded from cutoff
Who won New York City's 2025 mayoral election?
Expected answerZohran MamdaniSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K15UNKNOWNexcluded from cutoff
Who received the 2025 Nobel Peace Prize?
Expected answerMaria Corina MachadoSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K16UNKNOWNexcluded from cutoff
Who won the 2026 Wimbledon ladies' singles title?
Expected answerLinda NoskovaSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K17UNKNOWNexcluded from cutoff
Who won the 2026 Australian Open women's singles title?
Expected answerElena RybakinaSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K18UNKNOWNexcluded from cutoff
Which country won the 2026 FIFA World Cup?
Expected answerSpainSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K19UNKNOWNexcluded from cutoff
Which film won Best Picture at the 98th Academy Awards?
Expected answerOne Battle After AnotherSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K20UNKNOWNexcluded from cutoff
Which team won the 2025 NBA championship?
Expected answerOklahoma City ThunderSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K21UNKNOWNexcluded from cutoff
Which cardinal was elected pope and took the name Leo XIV in the May 2025 conclave?
Expected answerRobert Francis PrevostSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K22UNKNOWNexcluded from cutoff
Which film won the Palme d'Or at the 2026 Cannes Film Festival?
Expected answerFjordSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K23UNKNOWNexcluded from cutoff
Which team won the 2026 NBA championship?
Expected answerNew York KnicksSource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K24UNKNOWNexcluded from cutoff
Which performer won the 2026 Eurovision Song Contest?
Expected answerDARASource ↗
Tested-model answerUNKNOWN0% · UNKNOWN
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
Question coverage and research notes
Factual questions: 24 · Not graded by judge: 0
Reference cutoff and citations are supplied by the judge, not independently confirmed by the platform. Research notes do not penalize the tested model.
Run metadata
Reproducibility details
Run ID
MBAJ09XSXC0CSHVAV73EJTBTRQBenchmark
model-verification-single-request-v1.4Judge
gpt-5.6-solRequested protocol
openai_chatDetected response schema
anthropic_messagesProtocol compatibility
MISMATCH · recoveredModel output
Not recordedInput tokens
Not recordedOutput tokens
Not recordedFinish reason
Not recordedHTTP status
200External latency
15,654 msResponse bytes
3,702SHA-256
d783ad1531895d72131fa6c7040adf91ec505a5a1cf65146e95e2eb001047f04Important limitation
Benchmark v1.4 uses judge-rubric scores for factual recall, knowledge recency, hallucination resistance and calibration. The overall score is their fixed 37.5/25/25/12.5 weighted aggregation. Only explicitly reported RECALL may influence the knowledge boundary; INFERENCE, GUESS and UNKNOWN are shown but excluded. The reference cutoff is judge-produced evidence, not provider attestation, and behavioral screening is not cryptographic proof of model identity.
Run an independent verification
Test the same endpoint yourself or browse other public reports before relying on an advertised model identity.