Public AI model verification report
claude-opus-4-6
https://api.model-gate.com/v1/chat/completions
Legacy quality score60/100
CONSISTENT88% assessment confidence
Permanent report
https://model-gate.com/en/model-verification/results/68TGGQW6SM9411Y4XDAPH3BR3HJudge analysis
Why this verification received its result
The public report mirrors the analytical evidence shown to the tester after /chat/verify. Judge scores are rubric assessments; only explicit correct or wrong RECALL answers may influence the pure-recall cutoff boundary.
Behavior diagnostics
4 diagnosticsJudge scoring rationale
No separate judge rationale was retained for this archived result.
No separate judge rationale was retained for this archived result.
No separate judge rationale was retained for this archived result.
No separate judge rationale was retained for this archived result.
Historical benchmark note: this archived v1.4 overall score used the former fixed diagnostic aggregation. It is retained for reproducibility and must not be interpreted as a v1.5 Model Match score.
Temporal evidence
0 RECALL probesPure-recall timeline
The actual question set was shuffled before the tested-model request. Missing generation slots are not model abstentions. The timeline reconstructs their target months for auditability. Only explicit RECALL answers are cutoff evidence; INFERENCE, GUESS and UNKNOWN remain visible but do not move the boundary.
2024-09? K20UNKNOWN
2024-10? K14UNKNOWN
2024-11? K13UNKNOWN
2024-12? K22UNKNOWN
2025-01? K02UNKNOWN
2025-02? K10UNKNOWN? K18UNKNOWN
2025-03? K01UNKNOWN? K17UNKNOWN
2025-04? K03UNKNOWN? K16UNKNOWN
2025-05? K07UNKNOWN? K11UNKNOWN
2025-06? K09UNKNOWN? K21UNKNOWN
2025-07? K15UNKNOWN? K19UNKNOWN
2025-08? K06UNKNOWN? K24UNKNOWN
2025-09? K04UNKNOWN? K12UNKNOWN
2025-10? K05UNKNOWN
2025-11? K08UNKNOWN
2025-12? K23UNKNOWN
✓ correct RECALL✕ wrong RECALL~ INFERENCE≈ GUESS? UNKNOWN
0RECALL
0INFERENCE
0GUESS
0UNKNOWN
0correct RECALL
0wrong RECALL
Temporal comparison
CONSISTENTKnowledge cutoff comparison
Reference cutoff2025-05OFFICIAL_WEB · 100%
Latest supported RECALL—0 eligible RECALL answers
Observed boundaryInsufficient RECALL evidenceINSUFFICIENT_RECALL_EVIDENCE
Cutoff AlignmentCONSISTENT88/100 · 87% confidence
Judge notes
- Recall is broadly strong from September 2024 through April 2025, with only one isolated February abstention.
- May is mixed across its dense probes, while June and July retain partial or strong knowledge before a sustained failure cluster in August and September.
- The observed transition range overlaps and immediately follows the official May 2025 reference cutoff.
- Correct later-control answers in October and November are isolated; the COP30 host was also knowable well before the event, so these do not establish a later sustained boundary.
Reference-cutoff sources
Semantic: correct 16 · wrong 2 · unknown 6. Excluded from cutoff: 0.
Behavioral identity
CONSISTENT · 88%Identity signals
Identity is inferred from consistency between the claimed model and the observed knowledge/answer profile. It is evidence, not remote attestation or cryptographic proof of the serving weights.
Positive signals
- Correct on nearly all probes from September 2024 through April 2025.
- Mixed near-boundary performance in May.
- Sustained weak performance across both August and September dense evidence.
- Self-identifies as an Anthropic Claude model.
Negative signals
- Missed the February 2025 Album of the Year despite otherwise strong pre-cutoff recall.
- Answered several June and July events correctly after the nominal cutoff.
- Correctly guessed the October 2025 Nobel Peace Prize recipient.
- Did not identify its exact version and supplied no cutoff self-report.
Judge identity rationale
- The behavioral boundary broadly aligns with the immutable May 2025 reference cutoff.
- Strong-recall performance is consistently high across most months before the reference cutoff.
- The August-September failure cluster supplies a meaningful temporal transition rather than relying on one obscure missed fact.
- Limited post-cutoff knowledge is not treated as proof of substitution and is compatible with inference, advance-publicized facts, or selective updates.
- The self-report supports the provider family but does not independently establish the exact model variant.
Tested-model response
Verbatim extracted model text
Archived summary
This run predates opt-in full-report retention. The challenge, answer key and normalized judge assessment are available, but the exact tested-model response text was intentionally discarded by that benchmark-era privacy policy.
Complete benchmark listing
Question-by-question evidence
All admitted questions are shown with the expected answer, available source, tested-model basis, semantic verdict and cutoff eligibility. Ungraded questions are not model abstentions. A correct GUESS or INFERENCE remains correct semantically but is excluded from pure-recall cutoff evidence.
✓K01UNKNOWNexcluded from cutoff
What was the name of Firefly Aerospace's lunar lander that successfully touched down on the Moon?
Expected answerBlue GhostSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 85%
Judge note: Matches Blue Ghost.
✓K02UNKNOWNexcluded from cutoff
What was the name of Blue Origin's rocket that reached orbit on its maiden flight?
Expected answerNew GlennSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 90%
Judge note: Matches New Glenn.
✓K03UNKNOWNexcluded from cutoff
What was the designation of the Blue Origin mission that carried an all-women crew including Katy Perry and Gayle King?
Expected answerNS-31Source ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 45%
Judge note: Matches NS-31.
?K04UNKNOWNexcluded from cutoff
Who won the men's 100 metres at the 2025 World Athletics Championships in Tokyo?
Expected answerOblique SevilleSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
✓K05UNKNOWNexcluded from cutoff
Which Venezuelan opposition leader was awarded the 2025 Nobel Peace Prize?
Expected answerMaria Corina MachadoSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 60%
Judge note: Matches Maria Corina Machado.
?K06UNKNOWNexcluded from cutoff
At which Alaska military installation did Donald Trump meet Vladimir Putin for their 2025 summit?
Expected answerJoint Base Elmendorf-RichardsonSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
✓K07UNKNOWNexcluded from cutoff
What landmark global health instrument did the World Health Assembly adopt?
Expected answerWHO Pandemic AgreementSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 55%
Judge note: Explicitly includes WHO Pandemic Agreement.
✓K08UNKNOWNexcluded from cutoff
Which Brazilian city hosted the COP30 climate conference?
Expected answerBelemSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 90%
Judge note: Matches Belem.
✓K09UNKNOWNexcluded from cutoff
Which new Nintendo console launched alongside Mario Kart World?
Expected answerNintendo Switch 2Source ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 85%
Judge note: Matches Nintendo Switch 2.
?K10UNKNOWNexcluded from cutoff
Which album won Album of the Year at the 67th Grammy Awards?
Expected answerCowboy CarterSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
?K11UNKNOWNexcluded from cutoff
Which performer won the 2025 Eurovision Song Contest for Austria with Wasted Love?
Expected answerJJSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
✕K12UNKNOWNexcluded from cutoff
Which numbered iPhone generation did Apple debut at its September product event?
Expected answeriPhone 17Source ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: WRONGReported confidence: 75%
Judge note: Answered iPhone 16; expected iPhone 17.
✓K13UNKNOWNexcluded from cutoff
Which city hosted the COP29 climate conference that concluded with a new climate-finance agreement?
Expected answerBakuSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 92%
Judge note: Matches Baku.
✓K14UNKNOWNexcluded from cutoff
Which Japanese organization was awarded the 2024 Nobel Peace Prize?
Expected answerNihon HidankyoSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 95%
Judge note: Matches Nihon Hidankyo.
?K15UNKNOWNexcluded from cutoff
Which national team defeated Spain on penalties to win UEFA Women's Euro 2025?
Expected answerEnglandSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
✓K16UNKNOWNexcluded from cutoff
Which pope died at the Vatican on Easter Monday 2025?
Expected answerPope FrancisSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 85%
Judge note: Matches Pope Francis.
✓K17UNKNOWNexcluded from cutoff
Which film won Best Picture at the 97th Academy Awards?
Expected answerAnoraSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 65%
Judge note: Matches Anora.
✓K18UNKNOWNexcluded from cutoff
Which political alliance became the largest group in Germany's 2025 Bundestag election?
Expected answerCDU/CSUSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 85%
Judge note: Matches CDU/CSU.
✓K19UNKNOWNexcluded from cutoff
Which network of Indian forts became the country's 44th UNESCO World Heritage property?
Expected answerMaratha Military Landscapes of IndiaSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 50%
Judge note: Matches Maratha Military Landscapes of India.
✓K20UNKNOWNexcluded from cutoff
Which mission conducted the first commercial spacewalk?
Expected answerPolaris DawnSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 92%
Judge note: Matches Polaris Dawn.
✓K21UNKNOWNexcluded from cutoff
Which private astronaut mission launched Peggy Whitson and Shubhanshu Shukla to the International Space Station?
Expected answerAxiom Mission 4Source ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 70%
Judge note: Matches Axiom Mission 4.
✓K22UNKNOWNexcluded from cutoff
Which Paris cathedral formally reopened five years after a devastating fire?
Expected answerNotre-Dame de ParisSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 97%
Judge note: Matches Notre-Dame de Paris.
?K23UNKNOWNexcluded from cutoff
Who won Chile's 2025 presidential runoff election?
Expected answerJose Antonio KastSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: UNKNOWNReported confidence: 0%
Judge note: Explicit abstention.
✕K24UNKNOWNexcluded from cutoff
What new flagship AI system did OpenAI introduce?
Expected answerGPT-5Source ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: WRONGReported confidence: 40%
Judge note: Answered GPT-4o; expected GPT-5.
Question coverage and research notes
Factual questions: 24 · Not graded by judge: 0
Reference cutoff and citations are supplied by the judge, not independently confirmed by the platform. Research notes do not penalize the tested model.
Run metadata
Reproducibility details
Run ID
68TGGQW6SM9411Y4XDAPH3BR3HBenchmark
model-verification-single-request-v1.3Judge
gpt-5.6-solRequested protocol
openai_chatDetected response schema
Legacy / not recordedProtocol compatibility
MATCH / legacyModel output
Not recordedInput tokens
Not recordedOutput tokens
Not recordedFinish reason
Not recordedHTTP status
200External latency
10,087 msResponse bytes
2,591SHA-256
37edfee0969ea8c1529cf6db6830118353b483a27995cedcf20b25e5b40b8ff1Important limitation
The reference cutoff is a judge-produced snapshot grounded in hosted web evidence when available (official sources preferred, otherwise the best defensible estimate). It is not provider attestation. Single-request behavioral screening is not cryptographic proof of the underlying model identity.
Run an independent verification
Test the same endpoint yourself or browse other public reports before relying on an advertised model identity.