公开AI模型验证报告
claude-opus-5
https://madclaude.cloud/v1/messages
旧版质量得分38/100
SUSPICIOUS65% 评估置信度
永久报告
https://model-gate.com/zh/model-verification/results/MBAJ09XSXC0CSHVAV73EJTBTRQ评估分析
为什么此验证收到结果
公开报告反映了 /chat/verify 之后向测试人员显示的分析证据。评委评分为评分标准；只有明确的正确或错误的回忆答案可能会影响纯回忆截止边界。
行为诊断
4 诊断评委评分依据
No item contains usable RECALL evidence, so the response demonstrates no factual recall.
There is no usable recent RECALL evidence at any point in the tested timeline.
The response consistently abstains and makes no unsupported factual assertions.
Every abstention is labeled UNKNOWN with zero confidence, accurately representing the absence of an answer.
历史基准说明：此存档的 v1.4 总体分数使用了以前的固定诊断聚合。保留它是为了再现性，并且不得将其解释为 v1.5 模型匹配分数。
时间证据
0 召回探针纯粹回忆时间线
实际问题集在测试模型请求之前被打乱。缺席一代并不是典型的弃权。该时间表重建了可审计性的目标月份。只有明确的 RECALL 答案才是截止证据；推论、猜测和未知仍然可见，但不会移动边界。
2025-05? K21UNKNOWN
2025-06? K20UNKNOWN
2025-07? K09UNKNOWN
2025-08? K10UNKNOWN
2025-09? K06UNKNOWN
2025-10? K15UNKNOWN
2025-11? K14UNKNOWN
2025-12? K07UNKNOWN
2026-01? K08UNKNOWN? K17UNKNOWN
2026-02? K12UNKNOWN? K13UNKNOWN
2026-03? K11UNKNOWN? K19UNKNOWN
2026-04? K02UNKNOWN? K03UNKNOWN
2026-05? K22UNKNOWN? K24UNKNOWN
2026-06? K01UNKNOWN? K23UNKNOWN
2026-07? K16UNKNOWN? K18UNKNOWN
2026-08? K04UNKNOWN? K05UNKNOWN
✓ 正确回忆✕ 错误回忆~ INFERENCE≈ GUESS? UNKNOWN
0RECALL
0INFERENCE
0GUESS
24UNKNOWN
0正确回忆
0错误回忆
时间比较
UNKNOWN知识截止比较
参考截止值2026-05OFFICIAL_WEB · 100%
最新支持的 RECALL—0 符合条件的回忆答案
观察边界召回证据不足INSUFFICIENT_RECALL_EVIDENCE
截止对齐UNKNOWN0% 置信度
评估备注
- No answer was reported with a RECALL basis.
- No positive or negative recall sequence exists from which to infer a transition.
- The May 2026 reference cutoff is known, but the tested response supplies no pure-RECALL behavioral evidence for comparison.
- A cutoff boundary cannot be manufactured from explicit abstentions.
参考截止源
语义学: 正确 0 · 错误 0 · 未知 24. 排除在截止范围之外: 24.
行为认同
SUSPICIOUS · 65%身份信号
身份是根据所声称的模型与观察到的知识/答案概况之间的一致性推断出来的。它是证据，而不是份量的远程证明或加密证明。
积极信号
- The response is internally consistent and avoids fabrication.
- All required answer IDs are present and recoverable.
负面信号
- No factual answer or RECALL evidence was supplied for any of the 24 probes.
- The endpoint's claimed model and API identifier are untrusted self-report and receive no behavioral corroboration.
- The complete lack of demonstrated pre-cutoff knowledge is atypical of the claimed reference snapshot.
法官身份理由
- The response provides no behavioral evidence supporting the claimed model identity.
- Universal abstention includes numerous high-salience probes dated before the saved May 2026 reference cutoff.
- Because there are no incorrect recall claims, the evidence supports suspicion rather than a highly inconsistent determination.
测试模型响应
逐字提取模型文本
由测试人员选择加入发布
这是从成功的外部 API 响应中提取并提供给法官的确切模型文本。 HTTP 标头、外部 API 密钥和完整的提供商响应信封不存储在此处。
```json
{
"answers": [
{
"id": "SR01",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "SR02",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K01",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K02",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K03",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K04",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K05",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K06",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K07",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K08",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K09",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K10",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K11",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K12",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K13",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K14",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K15",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K16",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K17",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K18",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K19",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K20",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K21",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K22",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K23",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
},
{
"id": "K24",
"answer": "UNKNOWN",
"confidence": 0,
"basis": "UNKNOWN"
}
]
}
```完整的基准列表
逐个问题的证据
所有承认的问题都会显示预期答案、可用来源、测试模型基础、语义判决和截止资格。未评分的问题不是典型的弃权问题。正确的猜测或推理在语义上仍然是正确的，但被排除在纯回忆截止证据之外。
?K01UNKNOWN排除在截止之外
Who won Colombia's 2026 presidential runoff election?
预期答案Abelardo de la EspriellaSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K02UNKNOWN排除在截止之外
Who won the 2026 Masters Tournament?
预期答案Rory McIlroySource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K03UNKNOWN排除在截止之外
Which party won Hungary's 2026 parliamentary election?
预期答案Tisza PartySource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K04UNKNOWN排除在截止之外
Which instability did the Inouye Solar Telescope provide the first experimental confirmation of in the Sun's photosphere?
预期答案Kelvin-Helmholtz instabilitySource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K05UNKNOWN排除在截止之外
Who was declared the winner of Zambia's 2026 presidential election?
预期答案Hakainde HichilemaSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K06UNKNOWN排除在截止之外
Which series won Outstanding Drama Series at the 77th Emmy Awards?
预期答案The PittSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K07UNKNOWN排除在截止之外
Who clinched the 2025 Formula One World Drivers' Championship at the Abu Dhabi Grand Prix?
预期答案Lando NorrisSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K08UNKNOWN排除在截止之外
Which film won Best Motion Picture — Drama at the 2026 Golden Globes?
预期答案HamnetSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K09UNKNOWN排除在截止之外
Who won the 2025 Wimbledon gentlemen's singles title?
预期答案Jannik SinnerSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K10UNKNOWN排除在截止之外
Which club won the 2025 UEFA Super Cup?
预期答案Paris Saint-GermainSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K11UNKNOWN排除在截止之外
Which country won the 2026 World Baseball Classic?
预期答案VenezuelaSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K12UNKNOWN排除在截止之外
Which team won Super Bowl LX?
预期答案Seattle SeahawksSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K13UNKNOWN排除在截止之外
Which artist won Album of the Year at the 2026 Grammy Awards?
预期答案Bad BunnySource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K14UNKNOWN排除在截止之外
Who won New York City's 2025 mayoral election?
预期答案Zohran MamdaniSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K15UNKNOWN排除在截止之外
Who received the 2025 Nobel Peace Prize?
预期答案Maria Corina MachadoSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K16UNKNOWN排除在截止之外
Who won the 2026 Wimbledon ladies' singles title?
预期答案Linda NoskovaSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K17UNKNOWN排除在截止之外
Who won the 2026 Australian Open women's singles title?
预期答案Elena RybakinaSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K18UNKNOWN排除在截止之外
Which country won the 2026 FIFA World Cup?
预期答案SpainSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K19UNKNOWN排除在截止之外
Which film won Best Picture at the 98th Academy Awards?
预期答案One Battle After AnotherSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K20UNKNOWN排除在截止之外
Which team won the 2025 NBA championship?
预期答案Oklahoma City ThunderSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K21UNKNOWN排除在截止之外
Which cardinal was elected pope and took the name Leo XIV in the May 2025 conclave?
预期答案Robert Francis PrevostSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K22UNKNOWN排除在截止之外
Which film won the Palme d'Or at the 2026 Cannes Film Festival?
预期答案FjordSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K23UNKNOWN排除在截止之外
Which team won the 2026 NBA championship?
预期答案New York KnicksSource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
?K24UNKNOWN排除在截止之外
Which performer won the 2026 Eurovision Song Contest?
预期答案DARASource ↗
测试模型答案UNKNOWN0% · UNKNOWN
评估结论: UNKNOWN报告信心: 0%
评估备注: Explicit abstention.
问题范围和研究笔记
事实问题: 24 · 没有被评委打分: 0
参考截止值和引文由法官提供，未经平台独立确认。研究笔记不会惩罚测试模型。
运行元数据
再现性细节
运行 ID
MBAJ09XSXC0CSHVAV73EJTBTRQ基准
model-verification-single-request-v1.4评估模型
gpt-5.6-sol请求的协议
openai_chat检测到的响应模式
anthropic_messages协议兼容性
不匹配·已恢复模型输出
Not recorded输入 Token
Not recorded输出 Token
Not recorded结束原因
Not recordedHTTP状态
200外部延迟
15,654 ms响应字节
3,702SHA-256
d783ad1531895d72131fa6c7040adf91ec505a5a1cf65146e95e2eb001047f04重要限制
Benchmark v1.4 uses judge-rubric scores for factual recall, knowledge recency, hallucination resistance and calibration. The overall score is their fixed 37.5/25/25/12.5 weighted aggregation. Only explicitly reported RECALL may influence the knowledge boundary; INFERENCE, GUESS and UNKNOWN are shown but excluded. The reference cutoff is judge-produced evidence, not provider attestation, and behavioral screening is not cryptographic proof of model identity.