Public AI model verification report
deepseek-v4-flash
https://api.model-gate.com/v1/chat/completions
Legacy quality score100/100
PLAUSIBLE60% assessment confidence
Permanent report
https://model-gate.com/en/model-verification/results/A57ZK57ERM62N3S1XETMXFKK0XJudge analysis
Why this verification received its result
The public report mirrors the analytical evidence shown to the tester after /chat/verify. Judge scores are rubric assessments; only explicit correct or wrong RECALL answers may influence the pure-recall cutoff boundary.
Behavior diagnostics
4 diagnosticsJudge scoring rationale
No separate judge rationale was retained for this archived result.
No separate judge rationale was retained for this archived result.
No separate judge rationale was retained for this archived result.
No separate judge rationale was retained for this archived result.
Historical benchmark note: this archived v1.4 overall score used the former fixed diagnostic aggregation. It is retained for reproducibility and must not be interpreted as a v1.5 Model Match score.
Temporal evidence
0 RECALL probesPure-recall timeline
The actual question set was shuffled before the tested-model request. Missing generation slots are not model abstentions. The timeline reconstructs their target months for auditability. Only explicit RECALL answers are cutoff evidence; INFERENCE, GUESS and UNKNOWN remain visible but do not move the boundary.
Monthly timeline is not available for this archived benchmark result.
✓ correct RECALL✕ wrong RECALL~ INFERENCE≈ GUESS? UNKNOWN
0RECALL
0INFERENCE
0GUESS
0UNKNOWN
0correct RECALL
0wrong RECALL
Temporal comparison
UNKNOWNKnowledge cutoff comparison
Reference cutoffUNKNOWNUNKNOWN · 0%
Latest supported RECALL—0 eligible RECALL answers
Observed boundaryInsufficient RECALL evidenceINSUFFICIENT_RECALL_EVIDENCE
Cutoff AlignmentUNKNOWN0% confidence
Judge notes
- All Class A items are correct through June 2024, establishing an observed lower bound but no upper bound.
- The immutable reference snapshot has no known cutoff dates, so cutoff alignment cannot be scored.
Semantic: correct 16 · wrong 0 · unknown 0. Excluded from cutoff: 0.
Behavioral identity
PLAUSIBLE · 60%Identity signals
Identity is inferred from consistency between the claimed model and the observed knowledge/answer profile. It is evidence, not remote attestation or cryptographic proof of the serving weights.
Positive signals
- Perfect performance across all supplied Class A recall items.
- Correct recall of multiple DeepSeek model releases and specifications.
- No systematic early knowledge failures.
Negative signals
- No documented canonical identity or cutoff is available in the reference snapshot.
- Cutoff consistency cannot be evaluated.
- Self-report and matching API metadata are weak identity evidence.
Judge identity rationale
- The response is fully correct on all 16 strong-recall questions, including the DeepSeek-specific history items.
- The observed knowledge extends through June 2024, but the reference cutoff is unknown and therefore provides no identity-comparison signal.
- The claimed name and API identifier agree, but both are untrusted metadata and do not prove model identity.
Tested-model response
Verbatim extracted model text
Published assessment
The challenge, answer key and normalized judge assessment are available. Exact tested-model text is not available for publication unless it was retained with tester opt-in. Publishing an assessment does not create that consent or recover discarded text.
Complete benchmark listing
Question-by-question evidence
All admitted questions are shown with the expected answer, available source, tested-model basis, semantic verdict and cutoff eligibility. Ungraded questions are not model abstentions. A correct GUESS or INFERENCE remains correct semantically but is excluded from pure-recall cutoff evidence.
✓K01UNKNOWNexcluded from cutoff
Which human Go player was AlphaGo's opponent in the three-game match completed on 2017-05-27?
Expected answerKe Jie
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Matches accepted answer Ke Jie.
✓K02UNKNOWNexcluded from cutoff
The first published image of a black hole, announced on 2019-04-10, depicted the black hole in which galaxy?
Expected answerMessier 87
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: M87 galaxy is semantically equivalent to Messier 87.
✓K03UNKNOWNexcluded from cutoff
Which two scientists were awarded the 2020 Nobel Prize in Chemistry for developing a method for genome editing?
Expected answerEmmanuelle Charpentier and Jennifer A. Doudna
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Both required scientists are correctly named.
✓K04UNKNOWNexcluded from cutoff
Which research organization developed the AlphaFold2 system whose CASP14 performance was announced on 2020-11-30?
Expected answerDeepMind
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Matches accepted answer DeepMind.
✓K05UNKNOWNexcluded from cutoff
Which launch vehicle carried the James Webb Space Telescope into space on 2021-12-25?
Expected answerAriane 5
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Matches accepted answer Ariane 5.
✓K06UNKNOWNexcluded from cutoff
What was the name of the asteroid moonlet struck by NASA's DART spacecraft on 2022-09-26?
Expected answerDimorphos
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Matches accepted answer Dimorphos.
✓K07UNKNOWNexcluded from cutoff
In which ocean did the Artemis I Orion capsule splash down on 2022-12-11?
Expected answerPacific Ocean
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Matches accepted answer Pacific Ocean.
✓K08UNKNOWNexcluded from cutoff
On 2023-03-01, OpenAI made an API available for which speech-recognition model?
Expected answerWhisper
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Matches accepted answer Whisper.
✓K09UNKNOWNexcluded from cutoff
What was the name of the Chandrayaan-3 lander that reached the lunar surface on 2023-08-23?
Expected answerVikram
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Matches accepted answer Vikram.
✓K10UNKNOWNexcluded from cutoff
Samples from which asteroid were returned to Earth by the OSIRIS-REx capsule on 2023-09-24?
Expected answerBennu
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Matches accepted answer Bennu.
✓K11UNKNOWNexcluded from cutoff
What was the name of the code-focused model family publicly introduced by DeepSeek on 2023-11-02?
Expected answerDeepSeek Coder
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: DeepSeek-Coder is an accepted spelling.
✓K12UNKNOWNexcluded from cutoff
What two parameter scales were offered in the DeepSeek LLM family announced on 2023-11-29?
Expected answer7B and 67B
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Both parameter scales match: 7B and 67B.
✓K13UNKNOWNexcluded from cutoff
How many total parameters and how many activated parameters per token did DeepSeek-V2 have when announced on 2024-05-06?
Expected answer236B total parameters and 21B activated parameters per token
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Correctly gives 236B total and 21B activated per token.
✓K14UNKNOWNexcluded from cutoff
What maximum context length was supported by DeepSeek-Coder-V2 when announced on 2024-06-17?
Expected answer128K tokens
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Matches accepted answer 128K tokens.
✓K15UNKNOWNexcluded from cutoff
Which company built the Odysseus lunar lander that touched down on 2024-02-22?
Expected answerIntuitive Machines
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Matches accepted answer Intuitive Machines.
✓K16UNKNOWNexcluded from cutoff
What two parameter sizes were offered for the initially released Llama 3 models announced on 2024-04-18?
Expected answer8B and 70B
Tested-model answer—Exact model response is not available for publication.
Judge verdict: CORRECTReported confidence: 100%
Judge note: Both initially released sizes match: 8B and 70B.
Question coverage and research notes
Factual questions: 16 · Not graded by judge: 0
Reference cutoff and citations are supplied by the judge, not independently confirmed by the platform. Research notes do not penalize the tested model.
Run metadata
Reproducibility details
Run ID
A57ZK57ERM62N3S1XETMXFKK0XBenchmark
model-verification-single-request-v1.1Judge
gpt-5.6-solRequested protocol
openai_chatDetected response schema
Legacy / not recordedProtocol compatibility
MATCH / legacyModel output
Not recordedInput tokens
Not recordedOutput tokens
Not recordedFinish reason
Not recordedHTTP status
200External latency
28,645 msResponse bytes
1,859SHA-256
4c1f5cca4a79a53f28e7f6544bfe08208148d53c85569f50c4132e161da06613Important limitation
The reference cutoff is the configured judge model's internal-knowledge snapshot for this run, not an independently verified provider attestation. Single-request behavioral screening is not cryptographic proof of the underlying model identity.
Run an independent verification
Test the same endpoint yourself or browse other public reports before relying on an advertised model identity.