Public AI model verification report
deepseek-v4-flash
https://api.model-gate.com/v1/chat/completions
Legacy quality score87/100
SUSPICIOUS76% assessment confidence
Permanent report
https://model-gate.com/en/model-verification/results/A8T2GNQWKPJS4M16YAF7M0PGP4Judge analysis
Why this verification received its result
The public report mirrors the analytical evidence shown to the tester after /chat/verify. Judge scores are rubric assessments; only explicit correct or wrong RECALL answers may influence the pure-recall cutoff boundary.
Behavior diagnostics
4 diagnosticsJudge scoring rationale
No separate judge rationale was retained for this archived result.
No separate judge rationale was retained for this archived result.
No separate judge rationale was retained for this archived result.
No separate judge rationale was retained for this archived result.
Historical benchmark note: this archived v1.4 overall score used the former fixed diagnostic aggregation. It is retained for reproducibility and must not be interpreted as a v1.5 Model Match score.
Temporal evidence
0 RECALL probesPure-recall timeline
The actual question set was shuffled before the tested-model request. Missing generation slots are not model abstentions. The timeline reconstructs their target months for auditability. Only explicit RECALL answers are cutoff evidence; INFERENCE, GUESS and UNKNOWN remain visible but do not move the boundary.
2024-09? K06UNKNOWN
2024-10? K23UNKNOWN
2024-11? K11UNKNOWN
2024-12? K21UNKNOWN
2025-01? K13UNKNOWN
2025-02? K10UNKNOWN? K19UNKNOWN
2025-03? K05UNKNOWN? K12UNKNOWN
2025-04? K15UNKNOWN? K20UNKNOWN
2025-05? K03UNKNOWN? K17UNKNOWN
2025-06? K07UNKNOWN? K22UNKNOWN
2025-07? K18UNKNOWN? K24UNKNOWN
2025-08? K02UNKNOWN? K08UNKNOWN
2025-09? K14UNKNOWN? K16UNKNOWN
2025-10? K01UNKNOWN
2025-11? K04UNKNOWN
2025-12? K09UNKNOWN
✓ correct RECALL✕ wrong RECALL~ INFERENCE≈ GUESS? UNKNOWN
0RECALL
0INFERENCE
0GUESS
0UNKNOWN
0correct RECALL
0wrong RECALL
Temporal comparison
LATER_THAN_REFERENCEKnowledge cutoff comparison
Reference cutoff2025-05ESTIMATED_WEB · 45%
Latest supported RECALL—0 eligible RECALL answers
Observed boundaryInsufficient RECALL evidenceINSUFFICIENT_RECALL_EVIDENCE
Cutoff AlignmentLATER_THAN_REFERENCE28/100 · 55% confidence
Judge notes
- The response is consistently correct through September 2025 and also answers a November 2025 item correctly.
- Correct answers across June, August, and September provide sustained post-reference evidence rather than one isolated later hit.
- Mixed results in July and failures in October and December make the terminal boundary imprecise.
- The saved May 2025 reference cutoff is a low-confidence ESTIMATED_WEB value, which materially limits alignment confidence.
Reference-cutoff sources
Semantic: correct 21 · wrong 3 · unknown 0. Excluded from cutoff: 0.
Behavioral identity
SUSPICIOUS · 76%Identity signals
Identity is inferred from consistency between the claimed model and the observed knowledge/answer profile. It is evidence, not remote attestation or cryptographic proof of the serving weights.
Positive signals
- Strong performance on essentially all events before and near the saved reference cutoff.
- No systematic strong-recall failures substantially before the reference cutoff.
Negative signals
- Conflicting model-family self-report.
- Sustained correct recall across multiple months after the estimated reference cutoff.
- Correct recall of several September and November 2025 events is anomalously late for the saved snapshot.
Judge identity rationale
- SR01 identifies the model as Claude from Anthropic, directly conflicting with the claimed DeepSeek identity, although self-description remains weak evidence.
- The observed behavioral boundary is several months later than the saved May 2025 reference estimate.
- Post-reference knowledge is broad across sports, technology, culture, and world events, making it more notable than a small number of isolated later facts.
- The reference cutoff itself has only 45 percent confidence, so the recency discrepancy cannot independently establish model substitution.
Tested-model response
Verbatim extracted model text
Archived summary
This run predates opt-in full-report retention. The challenge, answer key and normalized judge assessment are available, but the exact tested-model response text was intentionally discarded by that benchmark-era privacy policy.
Complete benchmark listing
Question-by-question evidence
All admitted questions are shown with the expected answer, available source, tested-model basis, semantic verdict and cutoff eligibility. Ungraded questions are not model abstentions. A correct GUESS or INFERENCE remains correct semantically but is excluded from pure-recall cutoff evidence.
✕K01UNKNOWNexcluded from cutoff
Which Venezuelan opposition leader was awarded the 2025 Nobel Peace Prize?
Expected answerMaria Corina MachadoSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: WRONGReported confidence: 75%
Judge note: Machado is correct, but the answer incorrectly adds Edmundo Gonzalez Urrutia as a co-recipient.
✓K02UNKNOWNexcluded from cutoff
Which two countries signed a joint peace declaration at the White House?
Expected answerArmenia and AzerbaijanSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 62%
Judge note: Matches Armenia and Azerbaijan.
✓K03UNKNOWNexcluded from cutoff
What papal name did Cardinal Robert Francis Prevost take after his election?
Expected answerLeo XIVSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 85%
Judge note: Matches Pope Leo XIV.
✓K04UNKNOWNexcluded from cutoff
Which city hosted the first G20 Leaders' Summit held on the African continent?
Expected answerJohannesburgSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 80%
Judge note: Matches Johannesburg.
✓K05UNKNOWNexcluded from cutoff
Which film won Best Picture at the 97th Academy Awards?
Expected answerAnoraSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 95%
Judge note: Matches Anora.
✓K06UNKNOWNexcluded from cutoff
Which mission completed the first commercial spacewalk?
Expected answerPolaris DawnSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 88%
Judge note: Matches Polaris Dawn.
✓K07UNKNOWNexcluded from cutoff
Which team won the 2025 NBA championship?
Expected answerOklahoma City ThunderSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 45%
Judge note: Matches Oklahoma City Thunder.
✓K08UNKNOWNexcluded from cutoff
Which flagship model did OpenAI release in its API platform?
Expected answerGPT-5Source ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 80%
Judge note: Matches GPT-5.
✕K09UNKNOWNexcluded from cutoff
Which footballer won The Best FIFA Men's Player award for 2025?
Expected answerOusmane DembeleSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: WRONGReported confidence: 48%
Judge note: Expected Ousmane Dembele, not Vinicius Junior.
✓K10UNKNOWNexcluded from cutoff
Which political alliance won the largest share of votes in Germany's 2025 federal election?
Expected answerCDU/CSUSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 90%
Judge note: Matches CDU/CSU.
✓K11UNKNOWNexcluded from cutoff
Which international court issued arrest warrants for Benjamin Netanyahu and Yoav Gallant?
Expected answerInternational Criminal CourtSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Matches the International Criminal Court.
✓K12UNKNOWNexcluded from cutoff
Which commercial lunar lander successfully touched down in Mare Crisium?
Expected answerBlue GhostSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 88%
Judge note: Matches Blue Ghost.
✓K13UNKNOWNexcluded from cutoff
Which Blue Origin rocket reached orbit on its maiden launch?
Expected answerNew GlennSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 95%
Judge note: Matches New Glenn.
✓K14UNKNOWNexcluded from cutoff
Which standard iPhone generation did Apple unveil at its September product event?
Expected answeriPhone 17Source ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 90%
Judge note: Matches iPhone 17.
✓K15UNKNOWNexcluded from cutoff
Which pontiff died at the Vatican on Easter Monday?
Expected answerPope FrancisSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 98%
Judge note: Matches Pope Francis.
✓K16UNKNOWNexcluded from cutoff
Which party retained a parliamentary majority in Moldova's election?
Expected answerParty of Action and SolidaritySource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 72%
Judge note: Matches the Party of Action and Solidarity.
✓K17UNKNOWNexcluded from cutoff
What landmark global health accord did the World Health Assembly adopt?
Expected answerWHO Pandemic AgreementSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 75%
Judge note: Pandemic Agreement is an accepted answer.
✓K18UNKNOWNexcluded from cutoff
Which British band began its long-awaited reunion tour in Cardiff after a 16-year hiatus?
Expected answerOasisSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 95%
Judge note: Matches Oasis.
✓K19UNKNOWNexcluded from cutoff
Which album won Album of the Year at the 2025 Grammy Awards?
Expected answerCowboy CarterSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 90%
Judge note: Matches Cowboy Carter.
✓K20UNKNOWNexcluded from cutoff
What was the mission designation of Blue Origin's flight carrying Katy Perry, Gayle King and four other women?
Expected answerNS-31Source ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 92%
Judge note: Matches NS-31.
✓K21UNKNOWNexcluded from cutoff
Which Paris cathedral reopened after five years of restoration following its 2019 fire?
Expected answerNotre-Dame de ParisSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 98%
Judge note: Matches Notre-Dame de Paris.
✓K22UNKNOWNexcluded from cutoff
Which new Nintendo console launched worldwide?
Expected answerNintendo Switch 2Source ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 95%
Judge note: Matches Nintendo Switch 2.
✓K23UNKNOWNexcluded from cutoff
Which Japanese organization was awarded the 2024 Nobel Peace Prize?
Expected answerNihon HidankyoSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: CORRECTReported confidence: 95%
Judge note: Matches Nihon Hidankyo.
✕K24UNKNOWNexcluded from cutoff
Which national team won UEFA Women's Euro 2025?
Expected answerEnglandSource ↗
Tested-model answer—Exact model response was not retained for this archived run.
Judge verdict: WRONGReported confidence: 65%
Judge note: Expected England, not Spain.
Question coverage and research notes
Factual questions: 24 · Not graded by judge: 0
Reference cutoff and citations are supplied by the judge, not independently confirmed by the platform. Research notes do not penalize the tested model.
Run metadata
Reproducibility details
Run ID
A8T2GNQWKPJS4M16YAF7M0PGP4Benchmark
model-verification-single-request-v1.3Judge
gpt-5.6-solRequested protocol
openai_chatDetected response schema
Legacy / not recordedProtocol compatibility
MATCH / legacyModel output
Not recordedInput tokens
Not recordedOutput tokens
Not recordedFinish reason
Not recordedHTTP status
200External latency
222,372 msResponse bytes
2,597SHA-256
e13bdc27a0f0f92d7830a6c409fc8ffed2214bb814e138471d9cc7ca27be7e71Important limitation
The reference cutoff is a judge-produced snapshot grounded in hosted web evidence when available (official sources preferred, otherwise the best defensible estimate). It is not provider attestation. Single-request behavioral screening is not cryptographic proof of the underlying model identity.
Run an independent verification
Test the same endpoint yourself or browse other public reports before relying on an advertised model identity.