Manager

production env · 1 suites · 2 次完成 run

Subject № 6664a466-338b-40ae-bf61-55667c60d862 PRODUCTION

評測狀態 · 待重生

18 scenarios · 73 KB items 1 suite (1 stale)

FLEET READY · ALL KINDS COVERED

kb_accuracy 10

scenario_funnel 10

mixed_qa 10

uncategorized 0

生命徵象

[KIND × DIMENSION] vital signs — this bot's per-dim clearance vs. its baseline

知識庫精準度 [PASS]

檢索 100.0% 100.0% ≥95.0% [±5pp] +5.0 ✓

忠實度 100.0% 100.0% ≥92.0% [±8pp] +8.0 ✓

回答品質 92.3% 92.0% ≥84.3% [±8pp] +7.7 ✓

情境調用與完成 [FAIL]

情境 100.0% 90.0% <95.0% [±5pp] -5.0 ✗

工具使用 0.0% 25.0% — —

回答品質 50.7% 49.3% <70.0% [floor] -20.7 ✗

對話素養（混合問答） [PASS]

檢索 100.0% 100.0% ≥95.0% [±5pp] +5.0 ✓

忠實度 92.5% 92.5% ≥84.5% [±8pp] +8.0 ✓

回答品質 89.7% 89.3% ≥81.7% [±8pp] +7.7 ✓