遠雄星呈 AI 小幫手

production env · 1 suites · 2 次完成 run

Subject № 66f88327-db6e-4744-9db1-ad59a69257f5 PRODUCTION

評測狀態 · 待重生

5 scenarios · 119 KB items 1 suite (1 stale)

FLEET READY · ALL KINDS COVERED

kb_accuracy 10

scenario_funnel 10

mixed_qa 10

uncategorized 0

生命徵象

[KIND × DIMENSION] vital signs — this bot's per-dim clearance vs. its baseline

知識庫精準度 [PASS]

檢索 100.0% 100.0% ≥95.0% [±5pp] +5.0 ✓

忠實度 100.0% 100.0% ≥92.0% [±8pp] +8.0 ✓

回答品質 96.3% 97.3% ≥88.3% [±8pp] +9.0 ✓

情境調用與完成 [FAIL]

情境 70.0% 70.0% ≥70.0% [floor] 0.0 ✓

工具使用 28.6% 28.6% <70.0% [floor] -41.4 ✗

回答品質 78.0% 78.0% ≥70.0% [±8pp] +8.0 ✓

對話素養（混合問答） [FAIL]

檢索 87.5% 75.0% <82.5% [±5pp] -7.5 ✗

忠實度 95.8% 95.8% ≥87.8% [±8pp] +8.0 ✓

回答品質 80.0% 80.7% ≥72.0% [±8pp] +8.7 ✓