執行 #140

Intelligent Customer Service - Rhino (bulk R1) → production-canary (canary)

狀態
已完成
案例
28
開始時間
16 May 11:47
耗時
501.1s
¶ Economics · Bot-side N=28 attempts

Cost & Tokens

$0.1926
Total Bot Cost · USD
86.0%
Prompt Cache Hit
cost per case
$0.0069
cost per 1k tokens
$0.0009
input tokens
211,478
output tokens
5,315
cached tokens — prompt-cache hit
181,888
Total Tokens
216,793
economic efficiency
cost per correct
$0.0012
pass rate
67.9%
19 / 28
judge cost
$0.0238
設定快照(reproducibility) 1 個 bot 已捕捉 · Judge:gpt-4o-mini

Bot 設定快照

  • e875a090-2bd5-4992-9642-7626c7859461 312 筆 KB
    SystemPrompt: sha256:a147cf42 KBContent: sha256:d886d45c Tools: sha256:4a6a05b0 Scenarios: sha256:6aaf3980 AI: gpt-4.1-2025-04-14 (T=0.0, max=2048)

Judge 設定快照

model: gpt-4o-mini T=0.0 max=4096 prompt: v1
已完成
28 / 28
錯誤
0
失敗維度
9
首字延遲 p95
12220 ms
Bot 成本(Neptune)
$0.1926
Bot Tokens(Neptune)
216,793
Judge 成本(Eris)
$0.0238
Judge Tokens(Eris)
183,315
項目 I.

知識庫精準度

kb_accuracy 10 cases

維度總表

各維度品質分 · 覆蓋率
找對資料 召回
retrieval
60.0%
[30.0% – 90.0%] · n=10
F1 20.0% · 相關率 16.0% · 精確 52.0%
10 / 10 適用 · 7 提示
不亂編造 平均
faithfulness
91.7%
[75.0% – 100.0%] · n=6
10 / 10 適用
答得到位 平均
answer_quality
61.7%
[40.7% – 80.3%] · n=10
10 / 10 適用
  • 案例 0F6D9037

    Nature Explorers 手機殼適用於哪些裝置?

    已完成
    第 1 次嘗試 · 已完成 60709ms
    腳本進度 · 知識與產品查詢 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ● 已呼叫:search_knowledges、search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USERNature Explorers 手機殼適用於哪些裝置?
    BOT正在為您搜尋最新資料 ⏳ Nature Explorers 手機殼適用於多種裝置,包含: - Apple:iPhone 16 Plus、iPhone 16 Pro、iPhone 16 Pro Max、iPhone 16、iPhone 16e、iPhone 15 Pro Max、iPhone 13、iPhone 17、iPhone Air、iPhone 17 Pro、iPhone 17 Pro Max、iPhone 17e、iPhone 15 Pro、iPhone 15、iPhone 15 Plus、iPhone 13 Pro Max、iPhone 8 Plus、iPhone 14、iPhone 14 Plus、iPhone 14 Pro、iPhone 14 Pro Max、iPhone 12、iPhone 12 Pro、iPhone 12 Pro Max、iPhone 13 Pro、iPhone 7 Plus、iPhone 13 mini、iPhone SE 第二代/第三代、iPhone 12 mini、iPhone XS Max、iPhone XS、iPhone 11 Pro Max、iPhone 11、iPhone 11 Pro、iPhone XR、iPhone X、iPhone 7、iPhone 8 - AirPods:AirPods (第1/2/3/4代)、AirPods Pro (第1/2/3代) - iPad Air:4/5/6/M3/M4(10.9吋或11吋) - Samsung:Galaxy S24 FE/S25/S25 Ultra/A56/S25 Plus/A55/A15(4G/5G)/S24/S24 Plus/S24 Ultra/S25 FE/S26/A57/S26 Ultra/S26 Plus/S20/S20 Plus/S20 Ultra/S10/S21/S21 Plus/S21 Ultra/S21 FE/S22/S22 Plus/S22 Ultra/A73/A14/S23 FE/A14(5G)/S23 Plus/S23 Ultra/S23/A54/A13 - Google:Pixel 8A/9/9 Pro XL/9 Pro/10a/10/10 Pro/10 Pro XL/6/7 Pro/7/7A/8/8 Pro/6A - Xiaomi:13t/13t Pro/Redmi Note9/Ml11 Ultra/11t/11tPro/Redmi Note11Pro/Redmi Note11Pro+/Redmi Note12/Redmi Note12Pro - ASUS:Zenfone12 Ultra / Zenfone11 Ultra / Zenfone10 完整型號與更多資訊,歡迎參考: https://rhinoshield.io/design-studio/collections/nature-explorers/ 如需查詢特定型號是否支援,請告知您的裝置型號,我可以幫您再次確認!

    產品檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • prod_1014085
    意料之外 (4)
    • ! prod_1014078
    • ! prod_1014103
    • ! prod_1014144
    • ! prod_1014114
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI的回覆中提到的手機殼適用於的裝置型號,均未超出來源資料的範圍,且具體型號也未出現不實陳述,因此所有的事實陳述均可被支持。

    回答品質

    76.7%
    相關性
    90.0%
    完整性
    60.0%
    正確性
    80.0%
    加權拆解 · 三層 coverage
    I 核心
    50.0% · w 60%
    • Nature Explorers 手機殼適用於 GRIPs
    • Nature Explorers 手機殼適用於 Android 裝置
    II 重要
    III 補充
    AI 回覆
    正在為您搜尋最新資料 ⏳ Nature Explorers 手機殼適用於多種裝置,包含: - Apple:iPhone 16 Plus、iPhone 16 Pro、iPhone 16 Pro Max、iPhone 16、iPhone 16e、iPhone 15 Pro Max、iPhone 13、iPhone 17、iPhone Air、iPhone 17 Pro、iPhone 17 Pro Max、iPhone 17e、iPhone 15 Pro、iPhone 15、iPhone 15 Plus、iPhone 13 Pro Max、iPhone 8 Plus、iPhone 14、iPhone 14 Plus、iPhone 14 Pro、iPhone 14 Pro Max、iPhone 12、iPhone 12 Pro、iPhone 12 Pro Max、iPhone 13 Pro、iPhone 7 Plus、iPhone 13 mini、iPhone SE 第二代/第三代、iPhone 12 mini、iPhone XS Max、iPhone XS、iPhone 11 Pro Max、iPhone 11、iPhone 11 Pro、iPhone XR、iPhone X、iPhone 7、iPhone 8 - AirPods:AirPods (第1/2/3/4代)、AirPods Pro (第1/2/3代) - iPad Air:4/5/6/M3/M4(10.9吋或11吋) - Samsung:Galaxy S24 FE/S25/S25 Ultra/A56/S25 Plus/A55/A15(4G/5G)/S24/S24 Plus/S24 Ultra/S25 FE/S26/A57/S26 Ultra/S26 Plus/S20/S20 Plus/S20 Ultra/S10/S21/S21 Plus/S21 Ultra/S21 FE/S22/S22 Plus/S22 Ultra/A73/A14/S23 FE/A14(5G)/S23 Plus/S23 Ultra/S23/A54/A13 - Google:Pixel 8A/9/9 Pro XL/9 Pro/10a/10/10 Pro/10 Pro XL/6/7 Pro/7/7A/8/8 Pro/6A - Xiaomi:13t/13t Pro/Redmi Note9/Ml11 Ultra/11t/11tPro/Redmi Note11Pro/Redmi Note11Pro+/Redmi Note12/Redmi Note12Pro - ASUS:Zenfone12 Ultra / Zenfone11 Ultra / Zenfone10 完整型號與更多資訊,歡迎參考: https://rhinoshield.io/design-studio/collections/nature-explorers/ 如需查詢特定型號是否支援,請告知您的裝置型號,我可以幫您再次確認!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • Nature Explorers 手機殼適用於 iPhone
    • Nature Explorers 手機殼適用於 AirPods
    • Nature Explorers 手機殼適用於 GRIPs
    • Nature Explorers 手機殼適用於 Android 裝置
    Judge 推理
    回覆中提到的裝置型號雖然涵蓋了部分 iPhone 和其他品牌,但未提及 GRIPs 和 Android 裝置,因此在完整性上有所不足。
  • 案例 5257D17C

    可以透過哪裡請求發票?

    已完成
    第 1 次嘗試 · 已完成 18745ms
    腳本進度 · 知識與產品查詢 ◐ 進行中
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ◐ 已呼叫 1 / 2 個工具
    已呼叫:search_knowledges 未呼叫:search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER可以透過哪裡請求發票?
    BOT讓我幫您查詢一下相關資訊 🔍 您可以透過填寫線上客服表單來請求發票,我們會立即提供 PDF 格式的發票給您: https://support.rhinoshield.io/hc/en-us/requests/new 如果您的包裹尚未出貨,暫時無法提供發票。待您收到出貨通知信(內含追蹤編號)後,再透過上述表單聯繫我們即可取得發票。

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_369052
    意料之外 (4)
    • ! know_369054
    • ! know_368956
    • ! know_369256
    • ! know_369150
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI 的回覆完全符合來源資料,所有的事實陳述都有來源支持,因此沒有任何虛構的聲明。

    回答品質

    96.7%
    相關性
    100.0%
    完整性
    90.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    100.0% · w 30%
    III 補充
    AI 回覆
    讓我幫您查詢一下相關資訊 🔍 您可以透過填寫線上客服表單來請求發票,我們會立即提供 PDF 格式的發票給您: https://support.rhinoshield.io/hc/en-us/requests/new 如果您的包裹尚未出貨,暫時無法提供發票。待您收到出貨通知信(內含追蹤編號)後,再透過上述表單聯繫我們即可取得發票。
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 請通過網頁表單聯絡我們
    • 我們會立即提供您 PDF 格式的發票
    II 重要限制 w 30%
    • 請使用此連結: https://support.rhinoshield.io/hc/en-us/requests/new
    Judge 推理
    這個回答完全符合用戶的問題,提供了正確的請求發票的方式和連結。雖然提到的包裹出貨狀況是額外的資訊,但並未影響核心回答的完整性。
  • 案例 1EB42475

    PRIDE 2024: Love in All Forms 是什麼活動呢?

    已完成
    第 1 次嘗試 · 已完成 27534ms
    腳本進度 · 知識與產品查詢 ◐ 進行中
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ◐ 已呼叫 1 / 2 個工具
    已呼叫:search_knowledges 未呼叫:search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USERPRIDE 2024: Love in All Forms 是什麼活動呢?
    BOT馬上為您找找看相關內容 📋 目前沒有找到「PRIDE 2024: Love in All Forms」這個活動的詳細介紹。如果您是想詢問與 RHINOSHIELD 合作或相關活動,歡迎您填寫合作申請表單,我們的行銷團隊會在 7 天內與您聯繫: https://forms.clickup.com/3704209/f/3h1ch-965638/E4FG3MKVUN7AK9LKI5 如果您需要其他協助,也可以告訴我更詳細的需求!

    產品檢索

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • prod_1014112
    TP 0
    FP 0
    FN 1

    回答品質

    26.7%
    相關性
    50.0%
    完整性
    30.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    0.0% · w 60%
    • PRIDE 2024: Love in All Forms 旨在慶祝 LGBTQIA+ 的多樣性
    • 保護你的獨特身份和手機
    II 重要
    III 補充
    AI 回覆
    馬上為您找找看相關內容 📋 目前沒有找到「PRIDE 2024: Love in All Forms」這個活動的詳細介紹。如果您是想詢問與 RHINOSHIELD 合作或相關活動,歡迎您填寫合作申請表單,我們的行銷團隊會在 7 天內與您聯繫: https://forms.clickup.com/3704209/f/3h1ch-965638/E4FG3MKVUN7AK9LKI5 如果您需要其他協助,也可以告訴我更詳細的需求!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • PRIDE 2024: Love in All Forms 旨在慶祝 LGBTQIA+ 的多樣性
    • 保護你的獨特身份和手機
    Judge 推理
    回覆未能提供有關「PRIDE 2024: Love in All Forms」活動的任何具體資訊,且未涵蓋任何核心要點,導致相關性和完整性評分偏低。
  • 案例 55E47203

    LAIMO 的創作是從哪一年開始的?

    已完成
    第 1 次嘗試 · 已完成 24838ms
    腳本進度 · 知識與產品查詢 ◐ 進行中
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ◐ 已呼叫 1 / 2 個工具
    已呼叫:search_knowledges 未呼叫:search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USERLAIMO 的創作是從哪一年開始的?
    BOT讓我幫您查詢一下相關資訊 🔍 很抱歉,目前沒有查到關於 LAIMO 創作起始年份的相關資訊。如果您需要更詳細的資料,建議您聯繫專人客服協助查詢。 請你完整填寫以下客服表單,我們的客服團隊會根據你提供的資訊快速於服務時間內協助你: https://url.rhinoshield.io/io-chatbot 感謝您的配合!

    產品檢索

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • prod_1014049
    TP 0
    FP 0
    FN 1

    回答品質

    16.7%
    相關性
    50.0%
    完整性
    0.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    0.0% · w 60%
    • LAIMO 的創作始於 2012 年
    II 重要
    III 補充
    AI 回覆
    讓我幫您查詢一下相關資訊 🔍 很抱歉,目前沒有查到關於 LAIMO 創作起始年份的相關資訊。如果您需要更詳細的資料,建議您聯繫專人客服協助查詢。 請你完整填寫以下客服表單,我們的客服團隊會根據你提供的資訊快速於服務時間內協助你: https://url.rhinoshield.io/io-chatbot 感謝您的配合!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • LAIMO 的創作始於 2012 年
    Judge 推理
    回覆未能提供 LAIMO 創作的起始年份,且未回答用戶的問題,導致相關性和完整性得分低。
  • 案例 526A3166

    海外交易需要使用什麼卡片嗎?

    已完成
    第 1 次嘗試 · 已完成 27104ms
    腳本進度 · 知識與產品查詢 ◐ 進行中
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ◐ 已呼叫 1 / 2 個工具
    已呼叫:search_knowledges 未呼叫:search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER海外交易需要使用什麼卡片嗎?
    BOT讓我幫您查詢一下相關資訊 🔍 您好,我是智能客服 Rhino,很高興為您服務! 關於海外交易,RHINOSHIELD 支援的付款方式有:PayPal、信用卡/金融卡(VISA、Mastercard、AMEX、JCB)、Apple Pay 及 Google Pay。如果您使用的是金融卡,需確保是支援 Visa 的金融卡才能進行海外交易。 如果您的銀行帳戶或 PayPal 帳戶的幣別與官網不同,系統會自動進行貨幣轉換。 若付款時遇到問題,建議您可以嘗試: - 確認您的卡片是否支援國際交易(特別是需為 Visa 金融卡) - 聯繫發卡銀行確認是否有海外交易限制 - 或改用 PayPal 結帳(即使沒有 PayPal 帳號,也可選擇「以訪客身份用信用卡/金融卡付款」) 如有其他疑問,歡迎隨時告訴我!

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_369170
    意料之外 (4)
    • ! know_368956
    • ! know_369236
    • ! know_368957
    • ! know_369256
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    回覆中的所有事實性陳述均可從來源中找到支持,並且沒有任何虛構的聲明。

    回答品質

    63.3%
    相關性
    90.0%
    完整性
    50.0%
    正確性
    50.0%
    加權拆解 · 三層 coverage
    I 核心
    0.0% · w 60%
    • 海外交易需要使用 Debit Visa 卡
    II 重要
    III 補充
    AI 回覆
    讓我幫您查詢一下相關資訊 🔍 您好,我是智能客服 Rhino,很高興為您服務! 關於海外交易,RHINOSHIELD 支援的付款方式有:PayPal、信用卡/金融卡(VISA、Mastercard、AMEX、JCB)、Apple Pay 及 Google Pay。如果您使用的是金融卡,需確保是支援 Visa 的金融卡才能進行海外交易。 如果您的銀行帳戶或 PayPal 帳戶的幣別與官網不同,系統會自動進行貨幣轉換。 若付款時遇到問題,建議您可以嘗試: - 確認您的卡片是否支援國際交易(特別是需為 Visa 金融卡) - 聯繫發卡銀行確認是否有海外交易限制 - 或改用 PayPal 結帳(即使沒有 PayPal 帳號,也可選擇「以訪客身份用信用卡/金融卡付款」) 如有其他疑問,歡迎隨時告訴我!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 海外交易需要使用 Debit Visa 卡
    Judge 推理
    回覆中提到的付款方式雖然相關,但未直接回答海外交易需要使用 Debit Visa 卡的問題,因此核心內容缺失。
  • 案例 BE5F7362

    Shishiro Botan 支援哪種手機?

    已完成
    第 1 次嘗試 · 已完成 44567ms
    腳本進度 · 知識與產品查詢 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ● 已呼叫:search_knowledges、search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USERShishiro Botan 支援哪種手機?
    BOT稍等一下我來幫您查詢 💡 您好,我是智能客服 Rhino,很高興為您服務! RHINOSHIELD Shishiro Botan 聯名系列支援多種手機型號,包含 iPhone、Samsung、Google Pixel、Xiaomi 及 ASUS Zenfone 等品牌。以下為部分支援的手機型號舉例: Apple(iPhone): - iPhone 17、iPhone 17 Pro、iPhone 17 Pro Max、iPhone 17e - iPhone 16、iPhone 16 Plus、iPhone 16 Pro、iPhone 16 Pro Max、iPhone 16e - iPhone 15 全系列(含 Plus/Pro/Pro Max) - iPhone 14 全系列(含 Plus/Pro/Pro Max) - iPhone 13 全系列(含 mini/Pro/Pro Max) - iPhone SE(第2代、第3代)、iPhone XR、XS、XS Max 等 Samsung: - Galaxy S26 Ultra/S26 Plus/S26 - Galaxy S25 Ultra/S25 Plus/S25/S25 FE - Galaxy S24 Ultra/S24 Plus/S24/S24 FE - Galaxy S23 Ultra/S23 Plus/S23/S23 FE - Galaxy S22 Ultra/S22 Plus/S22 - Galaxy S21 Ultra/S21 Plus/S21/S21 FE - Galaxy S20 Ultra/S20 Plus/S20 - A 系列部分型號(如 A55、A56、A57 等) Google Pixel: - Pixel 10 Pro XL/10 Pro/10a/10 - Pixel 9 Pro XL/9 Pro/9 - Pixel 8 Pro/8A/8 - Pixel 7 Pro/7A/7 - Pixel 6A/6 Xiaomi: - Xiaomi 13t Pro/13t - Redmi Note 系列部分型號(如 Note 12 Pro、Note 11 Pro 等) - MI 11 Ultra ASUS: - Zenfone 12 Ultra、Zenfone 11 Ultra、Zenfone 10 完整支援型號及購買資訊,請參考官方網站: https://rhinoshield.io/design-studio/collections/shishirobotan/ 如需查詢特定型號是否支援,歡迎提供您的手機型號,我可以幫您再次確認!

    產品檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • prod_1014162
    意料之外 (4)
    • ! prod_1014193
    • ! prod_1014188
    • ! prod_1014194
    • ! prod_1014176
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    0.0%
    越高越好
    Judge 推理
    AI的回覆中提到的手機型號和品牌並未在提供的來源中找到支持,因此所有的具體資訊都被視為未經證實的主張。

    回答品質

    86.7%
    相關性
    100.0%
    完整性
    60.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    60.0% · w 60%
    • 支援 Android 手機
    II 重要
    III 補充
    AI 回覆
    稍等一下我來幫您查詢 💡 您好,我是智能客服 Rhino,很高興為您服務! RHINOSHIELD Shishiro Botan 聯名系列支援多種手機型號,包含 iPhone、Samsung、Google Pixel、Xiaomi 及 ASUS Zenfone 等品牌。以下為部分支援的手機型號舉例: Apple(iPhone): - iPhone 17、iPhone 17 Pro、iPhone 17 Pro Max、iPhone 17e - iPhone 16、iPhone 16 Plus、iPhone 16 Pro、iPhone 16 Pro Max、iPhone 16e - iPhone 15 全系列(含 Plus/Pro/Pro Max) - iPhone 14 全系列(含 Plus/Pro/Pro Max) - iPhone 13 全系列(含 mini/Pro/Pro Max) - iPhone SE(第2代、第3代)、iPhone XR、XS、XS Max 等 Samsung: - Galaxy S26 Ultra/S26 Plus/S26 - Galaxy S25 Ultra/S25 Plus/S25/S25 FE - Galaxy S24 Ultra/S24 Plus/S24/S24 FE - Galaxy S23 Ultra/S23 Plus/S23/S23 FE - Galaxy S22 Ultra/S22 Plus/S22 - Galaxy S21 Ultra/S21 Plus/S21/S21 FE - Galaxy S20 Ultra/S20 Plus/S20 - A 系列部分型號(如 A55、A56、A57 等) Google Pixel: - Pixel 10 Pro XL/10 Pro/10a/10 - Pixel 9 Pro XL/9 Pro/9 - Pixel 8 Pro/8A/8 - Pixel 7 Pro/7A/7 - Pixel 6A/6 Xiaomi: - Xiaomi 13t Pro/13t - Redmi Note 系列部分型號(如 Note 12 Pro、Note 11 Pro 等) - MI 11 Ultra ASUS: - Zenfone 12 Ultra、Zenfone 11 Ultra、Zenfone 10 完整支援型號及購買資訊,請參考官方網站: https://rhinoshield.io/design-studio/collections/shishirobotan/ 如需查詢特定型號是否支援,歡迎提供您的手機型號,我可以幫您再次確認!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • Shishiro Botan 支援 iPhone 和 Android 手機
    Judge 推理
    回覆中提到支援多種手機型號,並詳細列出 iPhone 和 Android 手機的型號,但未明確指出支援 Android 手機,導致核心回答不完整。
  • 案例 D2AE394B

    Beauty of Japan 的手機殼是為了什麼設計的?

    已完成
    第 1 次嘗試 · 已完成 37079ms
    腳本進度 · 知識與產品查詢 ◐ 進行中
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ◐ 已呼叫 1 / 2 個工具
    已呼叫:search_knowledges 未呼叫:search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USERBeauty of Japan 的手機殼是為了什麼設計的?
    BOT稍等一下我來幫您查詢 💡 目前查詢結果中沒有找到「Beauty of Japan」手機殼的專屬設計理念說明。如果您需要更詳細的設計理念或故事,建議您可以直接聯繫我們的客服團隊,我們會有專人協助您: https://url.rhinoshield.io/io-chatbot 感謝您的提問!

    產品檢索

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • prod_1014104
    TP 0
    FP 0
    FN 1

    回答品質

    33.3%
    相關性
    70.0%
    完整性
    30.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    0.0% · w 60%
    • Beauty of Japan 的手機殼旨在保護手機同時展現風格
    • 融入日本文化的美感
    II 重要
    III 補充
    AI 回覆
    稍等一下我來幫您查詢 💡 目前查詢結果中沒有找到「Beauty of Japan」手機殼的專屬設計理念說明。如果您需要更詳細的設計理念或故事,建議您可以直接聯繫我們的客服團隊,我們會有專人協助您: https://url.rhinoshield.io/io-chatbot 感謝您的提問!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • Beauty of Japan 的手機殼旨在保護手機同時展現風格
    • 融入日本文化的美感
    Judge 推理
    回覆未能提供「Beauty of Japan」手機殼的設計理念,且未涵蓋任何關鍵點,導致完整性和正確性得分低。
  • 案例 20C320A7

    AquaStand 可以跟 iPhone 11 一起用嗎

    已完成
    第 1 次嘗試 · 已完成 72086ms
    腳本進度 · 知識與產品查詢 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ● 已呼叫:search_knowledges、search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USERAquaStand 可以跟 iPhone 11 一起用嗎
    BOT稍等一下我來幫您查詢 💡 RHINOSHIELD AquaStand 可以與 iPhone 11 一起使用,但因為 iPhone 11 沒有內建 MagSafe 功能,建議您搭配 RHINOSHIELD 磁吸環(Magnetic Ring)一起使用,這樣就能讓 AquaStand 的磁吸功能正常發揮。如果您有 RHINOSHIELD 的 MagSafe 相容手機殼,也可以提升磁力穩定性。 如需購買或了解更多,歡迎參考以下連結: AquaStand 商品頁面: https://rhinoshield.io/products/aquastand/buy AquaStand Carrier(掛繩轉接器)商品頁面: https://rhinoshield.io/products/aquastand-carrier/buy 如果還有其他疑問,歡迎隨時詢問!

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_368989
    意料之外 (4)
    • ! know_369051
    • ! know_368990
    • ! know_369248
    • ! know_369005
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI 的回覆中提到 RHINOSHIELD AquaStand 可以與 iPhone 11 一起使用,並建議搭配磁吸環,這些資訊都能在來源中找到,因此沒有虛構的聲明。

    回答品質

    100.0%
    相關性
    100.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    100.0% · w 30%
    III 補充
    AI 回覆
    稍等一下我來幫您查詢 💡 RHINOSHIELD AquaStand 可以與 iPhone 11 一起使用,但因為 iPhone 11 沒有內建 MagSafe 功能,建議您搭配 RHINOSHIELD 磁吸環(Magnetic Ring)一起使用,這樣就能讓 AquaStand 的磁吸功能正常發揮。如果您有 RHINOSHIELD 的 MagSafe 相容手機殼,也可以提升磁力穩定性。 如需購買或了解更多,歡迎參考以下連結: AquaStand 商品頁面: https://rhinoshield.io/products/aquastand/buy AquaStand Carrier(掛繩轉接器)商品頁面: https://rhinoshield.io/products/aquastand-carrier/buy 如果還有其他疑問,歡迎隨時詢問!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • AquaStand 可以與 iPhone 11 或以下型號相容
    II 重要限制 w 30%
    • 最好搭配 RHINOSHIELD 的磁性環使用,以獲得最佳效果
    Judge 推理
    這個回答完全符合用戶的問題,並且涵蓋了所有關鍵點,包括 AquaStand 與 iPhone 11 的相容性以及使用磁性環的建議,且沒有任何錯誤的陳述。
  • 案例 767EF40A

    Joe Horner是誰?

    已完成
    第 1 次嘗試 · 已完成 49181ms
    腳本進度 · 知識與產品查詢 ◐ 進行中
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ◐ 已呼叫 1 / 2 個工具
    已呼叫:search_knowledges 未呼叫:search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USERJoe Horner是誰?
    BOTSearching for the latest information for you ⏳ Based on the available information, there is no relevant answer regarding "Joe Horner." If you need more details or have a specific context about Joe Horner, please let me know so I can assist you further. If your question is related to RHINOSHIELD products or services, feel free to provide more details!

    產品檢索

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • prod_1014191
    TP 0
    FP 0
    FN 1

    回答品質

    16.7%
    相關性
    50.0%
    完整性
    0.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    0.0% · w 60%
    • Joe Horner是花卉藝術家
    • 創作了這系列手機殼
    II 重要
    III 補充
    AI 回覆
    Searching for the latest information for you ⏳ Based on the available information, there is no relevant answer regarding "Joe Horner." If you need more details or have a specific context about Joe Horner, please let me know so I can assist you further. If your question is related to RHINOSHIELD products or services, feel free to provide more details!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • Joe Horner是花卉藝術家
    • 創作了這系列手機殼
    Judge 推理
    這個回答沒有提供任何關於Joe Horner的正確資訊,完全未回答用戶的問題,因此在相關性、完整性和正確性上都得分很低。
  • 案例 345D6F2D

    GRIP O MFM 需要搭配什麼手機殼使用?

    已完成
    第 1 次嘗試 · 已完成 73926ms
    腳本進度 · 知識與產品查詢 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ● 已呼叫:search_knowledges、search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USERGRIP O MFM 需要搭配什麼手機殼使用?
    BOT讓我幫您查詢一下相關資訊 🔍 RHINOSHIELD GRIP O MFM(MagSafe 兼容版)建議搭配 RHINOSHIELD 的 MagSafe 兼容手機殼使用。根據測試,當 GRIP O MFM 與 RHINOSHIELD MagSafe 兼容殼搭配時,磁吸力會比原廠標準強上兩倍以上,能提供更穩固的吸附效果。 如果您需要選購 RHINOSHIELD 的 MagSafe 兼容手機殼,歡迎告訴我您的手機型號,我可以協助您推薦合適的款式!如需進一步了解 GRIP O 商品資訊,也可參考下方連結: GRIP O 商品頁面: https://rhinoshield.io/products/grip-o/buy 有其他問題也歡迎隨時詢問!

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_369019
    意料之外 (4)
    • ! know_369017
    • ! know_369014
    • ! know_369018
    • ! know_369012
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI 的回覆中提到的 GRIP O MFM 與 RHINOSHIELD MagSafe 兼容手機殼的搭配建議,以及磁吸力的強度,均有來源支持,因此這些聲明被視為有根據的。

    回答品質

    100.0%
    相關性
    100.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    III 補充
    AI 回覆
    讓我幫您查詢一下相關資訊 🔍 RHINOSHIELD GRIP O MFM(MagSafe 兼容版)建議搭配 RHINOSHIELD 的 MagSafe 兼容手機殼使用。根據測試,當 GRIP O MFM 與 RHINOSHIELD MagSafe 兼容殼搭配時,磁吸力會比原廠標準強上兩倍以上,能提供更穩固的吸附效果。 如果您需要選購 RHINOSHIELD 的 MagSafe 兼容手機殼,歡迎告訴我您的手機型號,我可以協助您推薦合適的款式!如需進一步了解 GRIP O 商品資訊,也可參考下方連結: GRIP O 商品頁面: https://rhinoshield.io/products/grip-o/buy 有其他問題也歡迎隨時詢問!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • GRIP O MFM 需要與兼容的 MagSafe 手機殼搭配使用
    Judge 推理
    這個回答完全符合用戶的問題,清楚地指出 GRIP O MFM 需要與兼容的 MagSafe 手機殼搭配使用,並且提供了額外的資訊和協助,讓回答更完整。
項目 II.

情境調用與完成

scenario_funnel 10 cases

維度總表

各維度品質分 · 覆蓋率
走對流程 召回
scenario
90.0%
[70.0% – 100.0%] · n=10
F1 76.7% · 召回 90.0% · 精確 70.0%
10 / 10 適用
用對工具 召回
tool_usage
50.0%
[0.0% – 100.0%] · n=4
F1 66.7% · 召回 62.5% · 精確 100.0%
4 / 10 適用
答得到位 平均
answer_quality
79.7%
[71.0% – 87.7%] · n=10
10 / 10 適用
  • 案例 83A46086

    產品異常怎麼處理?

    已完成
    第 1 次嘗試 · 已完成 30687ms
    腳本進度 · 產品異常 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 產品異常
    腳本規則
    - 當消費者提到「產品+異常原因」,例如「手機殼圖案剝落、產品刮傷、按鈕脫落、產品斷裂、殼變形、保護貼浮邊或是觸控不良」等等
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - Reply:
    
    We apologize for any inconvenience you may have encountered while using our product. We will assist you as soon as possible. 
    
    Please fill out our customer service form, select "After-Sales Inquiry > Product Support," and provide complete order/product information, as well as photos or videos of the product malfunction so that we can provide assistance quickly! Thank you for your cooperation.
    
    Customer Service Form: https://url.rhinoshield.io/io-chatbot
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER產品異常怎麼處理?
    BOT正在為您搜尋最新資料 ⏳ 很抱歉造成您的不便。如果您收到的產品有異常,請您透過我們的客服表單提交申請,並附上訂單資訊及產品問題的照片。我們的團隊會在服務時間內盡快回覆您: https://support.rhinoshield.io/hc/en-us/requests/new 如有其他疑問,也歡迎隨時告訴我!

    情境路由

    66.7%
    Precision
    50.0%
    Recall
    100.0%
    F1
    66.7%
    預期 (1)
    • 3829 · 產品異常
    意料之外 (1)
    • ! 知識與產品查詢
    TP 1
    FP 1
    FN 0

    回答品質

    83.3%
    相關性
    100.0%
    完整性
    70.0%
    正確性
    80.0%
    加權拆解 · 三層 coverage
    I 核心
    50.0% · w 60%
    • 請填寫客服表單,選擇「售後查詢 > 產品支援」
    • 提供完整的訂單/產品資訊,以及產品異常的照片或影片
    II 重要
    III 補充
    50.0% · w 10%
    • 謝謝你的合作
    • 客服表單連結: https://url.rhinoshield.io/io-chatbot
    AI 回覆
    正在為您搜尋最新資料 ⏳ 很抱歉造成您的不便。如果您收到的產品有異常,請您透過我們的客服表單提交申請,並附上訂單資訊及產品問題的照片。我們的團隊會在服務時間內盡快回覆您: https://support.rhinoshield.io/hc/en-us/requests/new 如有其他疑問,也歡迎隨時告訴我!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 請填寫客服表單,選擇「售後查詢 > 產品支援」
    • 提供完整的訂單/產品資訊,以及產品異常的照片或影片
    III 補充說明 w 10%
    • 謝謝你的合作
    • 客服表單連結: https://url.rhinoshield.io/io-chatbot
    Judge 推理
    回覆中提到的客服表單連結不符合正確的格式,且未完整提供所需的步驟和資訊,導致回答不夠完整。
  • 案例 742291DF

    請問不同型號的重量是多少?

    已完成
    第 1 次嘗試 · 已完成 21617ms
    腳本進度 · 詢問各型號重量尺寸 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 詢問各型號重量尺寸
    腳本規則
    - 當客人問到產品的以下資訊「
    1. 尺寸與體積相關
    -尺寸、大小、size、體積
    -長度、寬度、高度、深度、厚度
    -多大、多小、多長、多寬、多高
    -規格、dimensions、measurements
    
    2. 重量相關
    -重量、重、多重、幾公斤、幾克
    -淨重、毛重、weight
    -輕重、份量
    
    3. 容量與數量相關
    -容量、capacity、容積、幾公升、幾毫升
    -數量、份量、內容量
    -可容納、可裝、可放
    
    」
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - 當客人問到產品的尺寸、重量、容量相關,請回覆以下訊息:
    「感謝您的詢問。請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot 」
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 04
    USER請問不同型號的重量是多少?
    BOT感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot

    情境路由

    100.0%
    Precision
    100.0%
    Recall
    100.0%
    F1
    100.0%
    預期 (1)
    • 7285 · 詢問各型號重量尺寸
    TP 1
    FP 0
    FN 0

    回答品質

    96.7%
    相關性
    90.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    III 補充
    100.0% · w 10%
    AI 回覆
    感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊
    • 我們將於服務時間內盡快回覆
    III 補充說明 w 10%
    • 感謝您的詢問
    Judge 推理
    回覆內容完全符合規範,且涵蓋了所有必要的要點,並且沒有錯誤的陳述。
  • 案例 3F8556A5

    我想知道商品的購買流程是怎麼樣的?

    已完成
    第 1 次嘗試 · 已完成 28052ms
    腳本進度 · 知識與產品查詢 ✗ 卡關
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    ✗ 已收集 0 / 2 項
    未收集:query、keywords_or_codes
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    預期 / 已收集 (0/2)
    欄位 預期值(generate) 已收集(run)
    query 我想了解最新的智能手機型號和功能 — (對話未走到)
    keywords_or_codes [] — (對話未走到)
    STEP
    03

    API 工具

    ○ 等待資訊收集完成
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    完整測試 4 個步驟
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER我想知道商品的購買流程是怎麼樣的?
    BOT讓我幫您查詢一下相關資訊 🔍 您好,我是智能客服 Rhino,很高興為您說明 RHINOSHIELD 商品的購買流程: - 當您在官網下單成功後,系統會發送一封訂單確認信到您註冊的電子郵件信箱,標題為「[System-sent] Your RHINOSHIELD Order #IOXXXXXXX (7 digits) is confirmed」。這代表您的訂單已經成立。 如果您有收到訂單確認信但沒有收到其他通知,建議您直接透過客服表單聯繫我們:https://support.rhinoshield.io/hc/en-us/requests/new 如需進一步協助,歡迎隨時告訴我!

    情境路由

    100.0%
    Precision
    100.0%
    Recall
    100.0%
    F1
    100.0%
    預期 (1)
    • 1963 · 知識與產品查詢
    TP 1
    FP 0
    FN 0

    工具使用

    66.7%
    Precision
    100.0%
    Recall
    50.0%
    F1
    66.7%
    預期 (2)
    • search_knowledges
    • search_products
    TP 1
    FP 0
    FN 1

    回答品質

    73.3%
    相關性
    90.0%
    完整性
    50.0%
    正確性
    80.0%
    加權拆解 · 三層 coverage
    I 核心
    50.0% · w 60%
    • 購買成功後,商品將會在約定的時間內送達
    II 重要
    0.0% · w 30%
    • 只有在官網購買的商品可以在到達後30天內進行退換貨
    • 其他途徑購買的商品需聯繫相關賣家處理
    III 補充
    0.0% · w 10%
    • 若您有其他問題或需要推薦的產品,請隨時詢問
    AI 回覆
    讓我幫您查詢一下相關資訊 🔍 您好,我是智能客服 Rhino,很高興為您說明 RHINOSHIELD 商品的購買流程: - 當您在官網下單成功後,系統會發送一封訂單確認信到您註冊的電子郵件信箱,標題為「[System-sent] Your RHINOSHIELD Order #IOXXXXXXX (7 digits) is confirmed」。這代表您的訂單已經成立。 如果您有收到訂單確認信但沒有收到其他通知,建議您直接透過客服表單聯繫我們:https://support.rhinoshield.io/hc/en-us/requests/new 如需進一步協助,歡迎隨時告訴我!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 您可以在我們的官方網站上選擇您想購買的商品
    • 購買成功後,商品將會在約定的時間內送達
    II 重要限制 w 30%
    • 只有在官網購買的商品可以在到達後30天內進行退換貨
    • 其他途徑購買的商品需聯繫相關賣家處理
    III 補充說明 w 10%
    • 若您有其他問題或需要推薦的產品,請隨時詢問
    Judge 推理
    回覆中提到的購買流程部分與用戶的問題相關,但缺少了關於商品送達時間和退換貨政策的關鍵資訊,導致完整性不足。此外,回覆未包含任何補充的 CTA,這也影響了完整性評分。
  • 案例 9C322535

    商品的規格和尺寸是多少?

    已完成
    第 1 次嘗試 · 已完成 31250ms
    腳本進度 · 知識與產品查詢 ✗ 卡關
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    ✗ 已收集 0 / 2 項
    未收集:query、keywords_or_codes
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    預期 / 已收集 (0/2)
    欄位 預期值(generate) 已收集(run)
    query 我想了解最新的智能手機型號和功能 — (對話未走到)
    keywords_or_codes [] — (對話未走到)
    STEP
    03

    API 工具

    ○ 等待資訊收集完成
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    完整測試 4 個步驟
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USER商品的規格和尺寸是多少?
    BOT正在為您搜尋最新資料 ⏳ 您好,我是智能客服 Rhino,很高興為您服務! 關於商品的規格和尺寸,請您提供想查詢的「產品系列」或「型號」,這樣我才能協助您查詢最正確的資訊。若您有特定產品(例如手機殼型號、配件名稱等),請直接告訴我。 如果您需要查詢某個型號的重量或尺寸,請透過以下客服表單提供您的產品線、型號與規格需求,我們會有專人於服務時間內回覆您: https://support.rhinoshield.io/hc/en-us/requests/new 如需參考不同手機殼系列的主要差異與規格,也可以瀏覽這個比較表: https://rhinoshield.io/products/phone-case-comparison?type=solidsuit 請告訴我您的具體需求,我會再進一步協助您!

    情境路由

    66.7%
    Precision
    50.0%
    Recall
    100.0%
    F1
    66.7%
    預期 (1)
    • 1963 · 知識與產品查詢
    意料之外 (1)
    • ! 詢問各型號重量尺寸
    TP 1
    FP 1
    FN 0

    工具使用

    100.0%
    Precision
    100.0%
    Recall
    100.0%
    F1
    100.0%
    預期 (2)
    • search_knowledges
    • search_products
    TP 2
    FP 0
    FN 0

    回答品質

    83.3%
    相關性
    90.0%
    完整性
    70.0%
    正確性
    90.0%
    加權拆解 · 三層 coverage
    I 核心
    60.0% · w 60%
    • 您可以在我們的網站上查詢相關產品的詳細規格和尺寸資訊
    • 我們提供多種產品,不同類型的產品會有不同的規格
    II 重要
    III 補充
    10.0% · w 10%
    AI 回覆
    正在為您搜尋最新資料 ⏳ 您好,我是智能客服 Rhino,很高興為您服務! 關於商品的規格和尺寸,請您提供想查詢的「產品系列」或「型號」,這樣我才能協助您查詢最正確的資訊。若您有特定產品(例如手機殼型號、配件名稱等),請直接告訴我。 如果您需要查詢某個型號的重量或尺寸,請透過以下客服表單提供您的產品線、型號與規格需求,我們會有專人於服務時間內回覆您: https://support.rhinoshield.io/hc/en-us/requests/new 如需參考不同手機殼系列的主要差異與規格,也可以瀏覽這個比較表: https://rhinoshield.io/products/phone-case-comparison?type=solidsuit 請告訴我您的具體需求,我會再進一步協助您!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 您可以在我們的網站上查詢相關產品的詳細規格和尺寸資訊
    • 我們提供多種產品,不同類型的產品會有不同的規格
    III 補充說明 w 10%
    • 請告訴我您正在尋找的特定商品,這樣我可以為您提供更準確的資訊
    Judge 推理
    這個回覆雖然有針對用戶的問題進行回應,但未能提供具體的產品規格和尺寸資訊,缺少了核心必答的要點。回覆中提到的查詢方式雖然有幫助,但未能直接回答用戶的問題,因此完整性得分較低。
  • 案例 A1E135A3

    產品異常的話,我需要提供什麼資訊才能獲得協助呢?

    已完成
    第 1 次嘗試 · 已完成 25636ms
    腳本進度 · 產品異常 ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 產品異常
    腳本規則
    - 當消費者提到「產品+異常原因」,例如「手機殼圖案剝落、產品刮傷、按鈕脫落、產品斷裂、殼變形、保護貼浮邊或是觸控不良」等等
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - Reply:
    
    We apologize for any inconvenience you may have encountered while using our product. We will assist you as soon as possible. 
    
    Please fill out our customer service form, select "After-Sales Inquiry > Product Support," and provide complete order/product information, as well as photos or videos of the product malfunction so that we can provide assistance quickly! Thank you for your cooperation.
    
    Customer Service Form: https://url.rhinoshield.io/io-chatbot
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER產品異常的話,我需要提供什麼資訊才能獲得協助呢?
    BOT正在為您搜尋最新資料 ⏳ 若您收到的產品有異常,請您透過我們的客服表單提交申請,並提供您的訂單資訊以及產品問題的照片。我們的團隊會在服務時間內盡快協助您。 客服表單連結: https://support.rhinoshield.io/hc/en-us/requests/new 如有其他疑問,也歡迎隨時詢問!

    情境路由

    0.0%
    Precision
    0.0%
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • 3829 · 產品異常
    意料之外 (1)
    • ! 知識與產品查詢
    TP 0
    FP 1
    FN 1

    回答品質

    86.7%
    相關性
    100.0%
    完整性
    70.0%
    正確性
    90.0%
    加權拆解 · 三層 coverage
    I 核心
    50.0% · w 60%
    • 選擇「售後詢問 > 產品支援」
    • 提供完整的訂單或產品資訊
    • 提供產品故障的照片或視頻
    II 重要
    III 補充
    20.0% · w 10%
    • 我們將盡快協助您
    • 謝謝您的配合
    AI 回覆
    正在為您搜尋最新資料 ⏳ 若您收到的產品有異常,請您透過我們的客服表單提交申請,並提供您的訂單資訊以及產品問題的照片。我們的團隊會在服務時間內盡快協助您。 客服表單連結: https://support.rhinoshield.io/hc/en-us/requests/new 如有其他疑問,也歡迎隨時詢問!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 請您填寫客戶服務表單
    • 選擇「售後詢問 > 產品支援」
    • 提供完整的訂單或產品資訊
    • 提供產品故障的照片或視頻
    III 補充說明 w 10%
    • 我們將盡快協助您
    • 謝謝您的配合
    Judge 推理
    回覆中提到的資訊不夠完整,缺少了選擇「售後詢問 > 產品支援」的步驟,以及提供完整的訂單或產品資訊和產品故障的照片或視頻的要求。雖然有提供客服表單的連結,但未完全遵循規則要求的內容。
  • 案例 39C56C00

    有沒有針對設計自己產品的建議或功能介紹?

    已完成
    第 1 次嘗試 · 已完成 41622ms
    腳本進度 · 知識與產品查詢 ✗ 卡關
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    ✗ 已收集 0 / 2 項
    未收集:query、keywords_or_codes
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    預期 / 已收集 (0/2)
    欄位 預期值(generate) 已收集(run)
    query 我想了解最新的智能手錶功能 — (對話未走到)
    keywords_or_codes [] — (對話未走到)
    STEP
    03

    API 工具

    ○ 等待資訊收集完成
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    完整測試 4 個步驟
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USER有沒有針對設計自己產品的建議或功能介紹?
    BOT讓我幫您查詢一下相關資訊 🔍 您好,我是智能客服 Rhino,很高興為您介紹 RHINOSHIELD 客製化產品的設計建議與功能: 1. 客製化流程與功能介紹 - 請先前往我們的客製化設計頁面:https://my.rhinoshield.io/design?artwork_type=Collage&device - 選擇您的裝置型號、產品線與規格後,即可開始設計專屬於您的商品。 - 設計時,請參考我們的設計指南,確保最佳印刷效果:https://support.rhinoshield.io/hc/en-us/articles/1500000090721-Design-Your-Own-DYO-User-Guide-on-the-Resolution-and-Format-of-Design - 上傳圖片及設計元素時,請務必遵守我們的服務條款與免責聲明:https://support.rhinoshield.io/hc/en-us/articles/43710184760729-Design-Your-Own-DYO-Terms-of-Service-and-Disclaimer - 完成設計後加入購物車並結帳即可。 2. 設計建議重點 - 僅支援 Jpg/Jpeg/Png 檔案,檔案大小不超過 10MB,解析度建議在 DPI 72~150。 - 圖片中線條需大於 2pt(約 0.7mm),避免細線或高透明度設計因印刷而消失。 - 建議使用原始圖片檔案,不要使用壓縮或濾鏡過的圖片。 - 若有條碼(如 QR code),無法保證可順利掃描。 - 背景色與殼體顏色會有些微色差,此屬正常現象。 3. 注意事項 - 客製化商品無法退換貨,下單前請再次確認裝置型號及設計內容。 詳細步驟與注意事項可參考: https://my.rhinoshield.io/design?artwork_type=Collage&device https://support.rhinoshield.io/hc/en-us/articles/1500000090721-Design-Your-Own-DYO-User-Guide-on-the-Resolution-and-Format-of-Design https://support.rhinoshield.io/hc/en-us/articles/43710184760729-Design-Your-Own-DYO-Terms-of-Service-and-Disclaimer 如果您想搜尋特定風格或靈感,也可以到設計館頁面輸入關鍵字查詢: https://rhinoshield.io/search/designs 如需更多協助,歡迎隨時告訴我!

    情境路由

    100.0%
    Precision
    100.0%
    Recall
    100.0%
    F1
    100.0%
    預期 (1)
    • 1963 · 知識與產品查詢
    TP 1
    FP 0
    FN 0

    工具使用

    100.0%
    Precision
    100.0%
    Recall
    100.0%
    F1
    100.0%
    預期 (2)
    • search_knowledges
    • search_products
    TP 2
    FP 0
    FN 0

    回答品質

    83.3%
    相關性
    100.0%
    完整性
    70.0%
    正確性
    80.0%
    加權拆解 · 三層 coverage
    I 核心
    87.5% · w 60%
    • 具備8百萬像素或更高的照片(適用於全尺寸規格)
    II 重要
    0.0% · w 30%
    • 印刷出來的顏色可能會有所偏差,這不會被視為缺陷
    III 補充
    AI 回覆
    讓我幫您查詢一下相關資訊 🔍 您好,我是智能客服 Rhino,很高興為您介紹 RHINOSHIELD 客製化產品的設計建議與功能: 1. 客製化流程與功能介紹 - 請先前往我們的客製化設計頁面:https://my.rhinoshield.io/design?artwork_type=Collage&device - 選擇您的裝置型號、產品線與規格後,即可開始設計專屬於您的商品。 - 設計時,請參考我們的設計指南,確保最佳印刷效果:https://support.rhinoshield.io/hc/en-us/articles/1500000090721-Design-Your-Own-DYO-User-Guide-on-the-Resolution-and-Format-of-Design - 上傳圖片及設計元素時,請務必遵守我們的服務條款與免責聲明:https://support.rhinoshield.io/hc/en-us/articles/43710184760729-Design-Your-Own-DYO-Terms-of-Service-and-Disclaimer - 完成設計後加入購物車並結帳即可。 2. 設計建議重點 - 僅支援 Jpg/Jpeg/Png 檔案,檔案大小不超過 10MB,解析度建議在 DPI 72~150。 - 圖片中線條需大於 2pt(約 0.7mm),避免細線或高透明度設計因印刷而消失。 - 建議使用原始圖片檔案,不要使用壓縮或濾鏡過的圖片。 - 若有條碼(如 QR code),無法保證可順利掃描。 - 背景色與殼體顏色會有些微色差,此屬正常現象。 3. 注意事項 - 客製化商品無法退換貨,下單前請再次確認裝置型號及設計內容。 詳細步驟與注意事項可參考: https://my.rhinoshield.io/design?artwork_type=Collage&device https://support.rhinoshield.io/hc/en-us/articles/1500000090721-Design-Your-Own-DYO-User-Guide-on-the-Resolution-and-Format-of-Design https://support.rhinoshield.io/hc/en-us/articles/43710184760729-Design-Your-Own-DYO-Terms-of-Service-and-Disclaimer 如果您想搜尋特定風格或靈感,也可以到設計館頁面輸入關鍵字查詢: https://rhinoshield.io/search/designs 如需更多協助,歡迎隨時告訴我!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 我們提供設計自訂產品的自由
    • 不會對您上傳的圖片進行潤飾或調整
    • 只支援Jpg/Jpeg/Png檔案
    • 檔案大小不得超過10MB
    • 解析度在72至150 DPI之間
    • 如果圖片內含有線條,確保其寬度大於2pt(約0.7mm)
    • 具備8百萬像素或更高的照片(適用於全尺寸規格)
    • 避免使用過多的濾鏡或壓縮,建議使用原始圖片檔
    II 重要限制 w 30%
    • 印刷出來的顏色可能會有所偏差,這不會被視為缺陷
    Judge 推理
    回覆內容針對設計自訂產品的建議與功能進行了詳細介紹,符合用戶的查詢需求。然而,缺少了關於圖片解析度和印刷顏色偏差的關鍵資訊,導致完整性得分降低。
  • 案例 605027D4

    這個產品重多少?

    已完成
    第 1 次嘗試 · 已完成 24589ms
    腳本進度 · 詢問各型號重量尺寸 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 詢問各型號重量尺寸
    腳本規則
    - 當客人問到產品的以下資訊「
    1. 尺寸與體積相關
    -尺寸、大小、size、體積
    -長度、寬度、高度、深度、厚度
    -多大、多小、多長、多寬、多高
    -規格、dimensions、measurements
    
    2. 重量相關
    -重量、重、多重、幾公斤、幾克
    -淨重、毛重、weight
    -輕重、份量
    
    3. 容量與數量相關
    -容量、capacity、容積、幾公升、幾毫升
    -數量、份量、內容量
    -可容納、可裝、可放
    
    」
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - 當客人問到產品的尺寸、重量、容量相關,請回覆以下訊息:
    「感謝您的詢問。請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot 」
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 04
    USER這個產品重多少?
    BOT感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot

    情境路由

    100.0%
    Precision
    100.0%
    Recall
    100.0%
    F1
    100.0%
    預期 (1)
    • 7285 · 詢問各型號重量尺寸
    TP 1
    FP 0
    FN 0

    回答品質

    60.0%
    相關性
    50.0%
    完整性
    30.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    60.0% · w 60%
    • 請提供產品線/型號/規格等資訊
    II 重要
    III 補充
    100.0% · w 10%
    AI 回覆
    感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊
    • 我們將於服務時間內盡快回覆
    III 補充說明 w 10%
    • 感謝您的詢問
    Judge 推理
    回覆未直接回答產品的重量問題,雖然符合規則,但未能提供所需的具體資訊,導致相關性和完整性得分較低。
  • 案例 CCE6B651

    這款產品的容量是多少?

    已完成
    第 1 次嘗試 · 已完成 11051ms
    腳本進度 · 詢問各型號重量尺寸 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 詢問各型號重量尺寸
    腳本規則
    - 當客人問到產品的以下資訊「
    1. 尺寸與體積相關
    -尺寸、大小、size、體積
    -長度、寬度、高度、深度、厚度
    -多大、多小、多長、多寬、多高
    -規格、dimensions、measurements
    
    2. 重量相關
    -重量、重、多重、幾公斤、幾克
    -淨重、毛重、weight
    -輕重、份量
    
    3. 容量與數量相關
    -容量、capacity、容積、幾公升、幾毫升
    -數量、份量、內容量
    -可容納、可裝、可放
    
    」
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - 當客人問到產品的尺寸、重量、容量相關,請回覆以下訊息:
    「感謝您的詢問。請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot 」
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 04
    USER這款產品的容量是多少?
    BOT感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot

    情境路由

    100.0%
    Precision
    100.0%
    Recall
    100.0%
    F1
    100.0%
    預期 (1)
    • 7285 · 詢問各型號重量尺寸
    TP 1
    FP 0
    FN 0

    回答品質

    60.0%
    相關性
    50.0%
    完整性
    30.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    60.0% · w 60%
    • 容量
    II 重要
    III 補充
    100.0% · w 10%
    AI 回覆
    感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊
    • 我們將於服務時間內盡快回覆
    III 補充說明 w 10%
    • 感謝您的詢問
    Judge 推理
    回覆未直接回答產品容量的問題,雖然內容符合規範,但未能滿足用戶的具體詢問,因此相關性和完整性得分較低。
  • 案例 EBF99DCA

    你們的產品尺寸和規格是什麼?

    已完成
    第 1 次嘗試 · 已完成 23603ms
    腳本進度 · 知識與產品查詢 ✗ 卡關
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    ✗ 已收集 0 / 2 項
    未收集:query、keywords_or_codes
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    預期 / 已收集 (0/2)
    欄位 預期值(generate) 已收集(run)
    query 我想了解最新的智能手機型號和功能 — (對話未走到)
    keywords_or_codes [] — (對話未走到)
    STEP
    03

    API 工具

    ○ 等待資訊收集完成
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    完整測試 4 個步驟
    對話流程 · 1 turn
    Turn 1 STEP 04
    USER你們的產品尺寸和規格是什麼?
    BOT感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot

    情境路由

    66.7%
    Precision
    50.0%
    Recall
    100.0%
    F1
    66.7%
    預期 (1)
    • 1963 · 知識與產品查詢
    意料之外 (1)
    • ! 詢問各型號重量尺寸
    TP 1
    FP 1
    FN 0

    工具使用

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (2)
    • search_knowledges
    • search_products
    TP 0
    FP 0
    FN 2

    回答品質

    70.0%
    相關性
    70.0%
    完整性
    50.0%
    正確性
    90.0%
    加權拆解 · 三層 coverage
    I 核心
    50.0% · w 60%
    • 產品規格和尺寸會因產品類型而異
    II 重要
    III 補充
    • 您可以告訴我您想查詢的具體產品
    AI 回覆
    感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 產品規格和尺寸會因產品類型而異
    III 補充說明 w 10%
    • 您可以告訴我您想查詢的具體產品
    Judge 推理
    回覆中未能直接回答產品的規格和尺寸,且未詢問用戶具體想查詢的產品,導致回答不完整。
  • 案例 D7745912

    各型號的重量和尺寸要怎麼查啊?

    已完成
    第 1 次嘗試 · 已完成 15155ms
    腳本進度 · 詢問各型號重量尺寸 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 詢問各型號重量尺寸
    腳本規則
    - 當客人問到產品的以下資訊「
    1. 尺寸與體積相關
    -尺寸、大小、size、體積
    -長度、寬度、高度、深度、厚度
    -多大、多小、多長、多寬、多高
    -規格、dimensions、measurements
    
    2. 重量相關
    -重量、重、多重、幾公斤、幾克
    -淨重、毛重、weight
    -輕重、份量
    
    3. 容量與數量相關
    -容量、capacity、容積、幾公升、幾毫升
    -數量、份量、內容量
    -可容納、可裝、可放
    
    」
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - 當客人問到產品的尺寸、重量、容量相關,請回覆以下訊息:
    「感謝您的詢問。請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot 」
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 04
    USER各型號的重量和尺寸要怎麼查啊?
    BOT感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot

    情境路由

    66.7%
    Precision
    50.0%
    Recall
    100.0%
    F1
    66.7%
    預期 (1)
    • 7285 · 詢問各型號重量尺寸
    意料之外 (1)
    • ! 知識與產品查詢
    TP 1
    FP 1
    FN 0

    回答品質

    100.0%
    相關性
    100.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    III 補充
    100.0% · w 10%
    AI 回覆
    感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊
    • 我們將於服務時間內盡快回覆
    III 補充說明 w 10%
    • 感謝您的詢問
    Judge 推理
    這個回覆完全符合用戶的詢問,並且包含了所有必要的資訊,沒有遺漏任何要點。回覆的內容也符合規範,正確性高。
項目 III.

對話素養(混合問答)

mixed_qa 8 cases

維度總表

各維度品質分 · 覆蓋率
找對資料 召回
retrieval
66.7%
[33.3% – 100.0%] · n=6
F1 22.2% · 相關率 30.0% · 精確 46.7%
6 / 8 適用 · 1 提示
不亂編造 平均
faithfulness
100.0%
[100.0% – 100.0%] · n=6
8 / 8 適用
答得到位 平均
answer_quality
76.7%
[55.4% – 95.8%] · n=8
8 / 8 適用
  • 案例 1756F1A2

    Taku Bannai 主要創作是什麼類型的作品?

    已完成
    第 1 次嘗試 · 已完成 28301ms
    腳本進度 · early_return ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 early_return
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USERTaku Bannai 主要創作是什麼類型的作品?
    BOT馬上為您找找看相關內容 📋 根據目前提供的資訊,沒有找到關於 Taku Bannai 主要創作類型的相關說明。建議您可以前往 RHINOSHIELD 官網設計師合作專區瀏覽完整的聯名設計作品集: https://rhinoshield.io/design-studio 如果您在網站上沒有找到想要的設計師合作資訊,也可以在頁面下方使用「Collab Wish Box」功能提交您的建議,幫助我們評估未來合作夥伴。 如需更詳細的創作介紹,歡迎再次詢問或聯繫客服!

    產品檢索

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • prod_1014194
    TP 0
    FP 0
    FN 1

    回答品質

    26.7%
    相關性
    50.0%
    完整性
    30.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    0.0% · w 60%
    • Taku Bannai 的作品涵蓋廣告、書籍、雜誌和唱片封面藝術
    II 重要
    III 補充
    AI 回覆
    馬上為您找找看相關內容 📋 根據目前提供的資訊,沒有找到關於 Taku Bannai 主要創作類型的相關說明。建議您可以前往 RHINOSHIELD 官網設計師合作專區瀏覽完整的聯名設計作品集: https://rhinoshield.io/design-studio 如果您在網站上沒有找到想要的設計師合作資訊,也可以在頁面下方使用「Collab Wish Box」功能提交您的建議,幫助我們評估未來合作夥伴。 如需更詳細的創作介紹,歡迎再次詢問或聯繫客服!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • Taku Bannai 的作品涵蓋廣告、書籍、雜誌和唱片封面藝術
    Judge 推理
    回覆未能提供 Taku Bannai 主要創作類型的相關資訊,且未回答用戶的問題,導致相關性和完整性得分偏低。
  • 案例 F9776711

    這個 get_file_resource 是什麼工具?

    已完成
    第 1 次嘗試 · 已完成 32049ms
    腳本進度 · early_return ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 early_return
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    STEP
    03

    API 工具

    ✗ 已呼叫 0 / 1 個工具
    未呼叫:get_file_resource
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER這個 get_file_resource 是什麼工具?
    BOT馬上為您找找看相關內容 📋 目前沒有找到與「get_file_resource」工具相關的具體說明。如果您需要更詳細的資訊或有其他問題,建議您聯繫專人客服協助。 請您完整填寫以下客服表單,我們的客服團隊會根據您提供的資訊快速於服務時間內協助您: https://url.rhinoshield.io/io-chatbot 感謝您的配合!

    回答品質

    26.7%
    相關性
    50.0%
    完整性
    30.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    0.0% · w 60%
    • get_file_resource 是一個用於檢索公司特定檔案資源的工具
    • 可以檢索分支列表、尺寸表、價格表和政策等
    II 重要
    III 補充
    AI 回覆
    馬上為您找找看相關內容 📋 目前沒有找到與「get_file_resource」工具相關的具體說明。如果您需要更詳細的資訊或有其他問題,建議您聯繫專人客服協助。 請您完整填寫以下客服表單,我們的客服團隊會根據您提供的資訊快速於服務時間內協助您: https://url.rhinoshield.io/io-chatbot 感謝您的配合!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • get_file_resource 是一個用於檢索公司特定檔案資源的工具
    • 可以檢索分支列表、尺寸表、價格表和政策等
    Judge 推理
    回覆未能提供有關 get_file_resource 的具體資訊,且未回答用戶的問題,導致相關性和完整性得分低。
  • 案例 1B98D452

    請問客服表單的網址是什麼呢?

    已完成
    第 1 次嘗試 · 已完成 21368ms
    腳本進度 · 產品異常 ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 產品異常
    腳本規則
    - 當消費者提到「產品+異常原因」,例如「手機殼圖案剝落、產品刮傷、按鈕脫落、產品斷裂、殼變形、保護貼浮邊或是觸控不良」等等
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - Reply:
    
    We apologize for any inconvenience you may have encountered while using our product. We will assist you as soon as possible. 
    
    Please fill out our customer service form, select "After-Sales Inquiry > Product Support," and provide complete order/product information, as well as photos or videos of the product malfunction so that we can provide assistance quickly! Thank you for your cooperation.
    
    Customer Service Form: https://url.rhinoshield.io/io-chatbot
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER請問客服表單的網址是什麼呢?
    BOT讓我幫您查詢一下相關資訊 🔍 您好,這裡是智能客服 Rhino,很高興為您服務! 您可以透過以下網址填寫客服表單,我們的客服團隊會根據您提供的資訊協助處理您的問題: https://url.rhinoshield.io/io-chatbot 如有其他疑問,也歡迎隨時詢問!

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI的回覆中提供的客服表單網址與來源中的資訊一致,因此所有的事實陳述都得到了支持。此外,回覆也遵循了所有的回應規則。

    回答品質

    90.0%
    相關性
    100.0%
    完整性
    70.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    III 補充
    • We apologize for any inconvenience you may have encountered while using our product. We will assist you as soon as possible.
    • Please fill out our customer service form, select "After-Sales Inquiry > Product Support," and provide complete order/product information, as well as photos or videos of the product malfunction so that we can provide assistance quickly! Thank you for your cooperation.
    AI 回覆
    讓我幫您查詢一下相關資訊 🔍 您好,這裡是智能客服 Rhino,很高興為您服務! 您可以透過以下網址填寫客服表單,我們的客服團隊會根據您提供的資訊協助處理您的問題: https://url.rhinoshield.io/io-chatbot 如有其他疑問,也歡迎隨時詢問!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 客服表單的網址是 https://url.rhinoshield.io/io-chatbot
    Judge 推理
    這個回覆提供了客服表單的網址,符合用戶的查詢,並且內容正確。然而,回覆中缺少了規範中要求的道歉和協助的說明,因此在完整性上得分較低。
  • 案例 8A5A43E0

    這款 iPad 保護殼支持 Apple Pencil (第二代) 的磁性附著嗎?

    已完成
    第 1 次嘗試 · 已完成 45221ms
    腳本進度 · early_return ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 early_return
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USER這款 iPad 保護殼支持 Apple Pencil (第二代) 的磁性附著嗎?
    BOT馬上為您找找看相關內容 📋 根據目前資訊,RHINOSHIELD 的 iPad 保護殼確實支援 Apple Pencil(第二代)的無線配對與磁性附著,因此可以正常進行磁吸與充電功能。若您需要更詳細的型號資訊或想確認您的 iPad 型號是否適用,歡迎提供您的 iPad 型號,我可以幫您查詢對應的保護殼選項。 如需購買或了解更多,請參考: iPad 保護殼 https://rhinoshield.io/products/ipad-case/buy 有其他問題也歡迎隨時詢問!

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_369099
    意料之外 (4)
    • ! know_369104
    • ! know_369103
    • ! know_369098
    • ! know_369095
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI 的回覆中提到 RHINOSHIELD 的 iPad 保護殼支援 Apple Pencil(第二代)的磁性附著,這一點在來源中有明確的支持,因此該回覆的所有事實陳述均為有根據的。

    回答品質

    100.0%
    相關性
    100.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    III 補充
    AI 回覆
    馬上為您找找看相關內容 📋 根據目前資訊,RHINOSHIELD 的 iPad 保護殼確實支援 Apple Pencil(第二代)的無線配對與磁性附著,因此可以正常進行磁吸與充電功能。若您需要更詳細的型號資訊或想確認您的 iPad 型號是否適用,歡迎提供您的 iPad 型號,我可以幫您查詢對應的保護殼選項。 如需購買或了解更多,請參考: iPad 保護殼 https://rhinoshield.io/products/ipad-case/buy 有其他問題也歡迎隨時詢問!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 這款 iPad 保護殼支持 Apple Pencil (第二代) 的磁性附著
    • 能進行無線配對和充電
    Judge 推理
    這個回答完全針對用戶的問題,並且提供了所有必要的資訊,確認了保護殼支持 Apple Pencil (第二代) 的磁性附著、無線配對和充電功能。
  • 案例 811016A2

    RHINOSHIELD Lens Base Protector 可以跟其他品牌的手機殼一起用嗎?

    已完成
    第 1 次嘗試 · 已完成 44415ms
    腳本進度 · early_return ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 early_return
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USERRHINOSHIELD Lens Base Protector 可以跟其他品牌的手機殼一起用嗎?
    BOT讓我幫您查詢一下相關資訊 🔍 RHINOSHIELD Lens Base Protector 只覆蓋鏡頭底座,與 RHINOSHIELD 自家手機殼相容。由於市面上其他品牌手機殼在尺寸、設計和結構上各有不同,是否能與其他品牌手機殼同時使用,需依實際安裝結果為準,無法保證一定相容。 建議您安裝前可先確認手機殼鏡頭區域的空間設計,或直接實際測試安裝效果。如有更多疑問,也歡迎隨時詢問!

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_369189
    意料之外 (4)
    • ! know_369188
    • ! know_369008
    • ! know_369190
    • ! know_369009
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI 的回覆完全基於來源資料,並且正確地表達了 RHINOSHIELD Lens Base Protector 與其他品牌手機殼的相容性問題,因此沒有任何虛構的聲明。所有的事實陳述都可以從來源中找到支持。

    回答品質

    96.7%
    相關性
    100.0%
    完整性
    90.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    67.0% · w 30%
    • 需根據實際安裝結果來確定
    III 補充
    AI 回覆
    讓我幫您查詢一下相關資訊 🔍 RHINOSHIELD Lens Base Protector 只覆蓋鏡頭底座,與 RHINOSHIELD 自家手機殼相容。由於市面上其他品牌手機殼在尺寸、設計和結構上各有不同,是否能與其他品牌手機殼同時使用,需依實際安裝結果為準,無法保證一定相容。 建議您安裝前可先確認手機殼鏡頭區域的空間設計,或直接實際測試安裝效果。如有更多疑問,也歡迎隨時詢問!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • RHINOSHIELD Lens Base Protector 只適用於 RHINOSHIELD 的手機殼
    II 重要限制 w 30%
    • 與其他品牌的手機殼相容性可能會因大小、設計和結構而異
    • 需根據實際安裝結果來確定
    Judge 推理
    這個回答針對用戶的問題提供了相關資訊,並且涵蓋了大部分的關鍵點。雖然提到的相容性需要根據實際安裝結果來確定,但未明確指出這一點,因此在完整性上略有不足。
  • 案例 4617C36C

    GRIP O 是不是用回收材料做的?

    已完成
    第 1 次嘗試 · 已完成 40771ms
    腳本進度 · early_return ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 early_return
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USERGRIP O 是不是用回收材料做的?
    BOT正在為您搜尋最新資料 ⏳ RHINOSHIELD GRIP O 是由回收的 PET 以及 RHINOSHIELD 透明殼的回收材料製成,致力於減少對環境的影響,支持永續發展。 您可以參考商品頁面了解更多細節: GRIP O: https://rhinoshield.io/products/grip-o/buy 如需其他資訊歡迎隨時詢問!

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_369021
    意料之外 (4)
    • ! know_369020
    • ! know_369016
    • ! know_369017
    • ! know_369045
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI 的回覆完全符合來源資料,並且所有的事實陳述都有來源支持,因此沒有任何虛構的聲明。

    回答品質

    100.0%
    相關性
    100.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    III 補充
    AI 回覆
    正在為您搜尋最新資料 ⏳ RHINOSHIELD GRIP O 是由回收的 PET 以及 RHINOSHIELD 透明殼的回收材料製成,致力於減少對環境的影響,支持永續發展。 您可以參考商品頁面了解更多細節: GRIP O: https://rhinoshield.io/products/grip-o/buy 如需其他資訊歡迎隨時詢問!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • GRIP O 是用回收的 PET 以及來自 RHINOSHIELD Clear 產品的回收材料製作的
    • 目的是減少對環境的影響
    Judge 推理
    回覆正確地回答了用戶的問題,並且涵蓋了所有關鍵點,沒有遺漏任何重要資訊。
  • 案例 17BCF877

    官方網站有 Apple Pay 嗎

    已完成
    第 1 次嘗試 · 已完成 15880ms
    腳本進度 · early_return ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 early_return
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER官方網站有 Apple Pay 嗎
    BOT讓我幫您查詢一下相關資訊 🔍 RHINOSHIELD 官方網站有支援 Apple Pay 付款。請使用 Safari 瀏覽器進入官方網站,即可看到 Apple Pay 的選項。如果您沒有看到 Apple Pay 結帳選項,建議您截圖並聯繫客服,我們會協助您確認: https://support.rhinoshield.io/hc/en-us/requests/new 如有其他支付方式相關問題,也歡迎隨時詢問!

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_369214
    意料之外 (4)
    • ! know_368956
    • ! know_369104
    • ! know_369170
    • ! know_369108
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI 的回覆完全符合來源資料,所有的事實陳述都有來源支持,因此沒有任何虛構的聲明。

    回答品質

    100.0%
    相關性
    100.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    III 補充
    AI 回覆
    讓我幫您查詢一下相關資訊 🔍 RHINOSHIELD 官方網站有支援 Apple Pay 付款。請使用 Safari 瀏覽器進入官方網站,即可看到 Apple Pay 的選項。如果您沒有看到 Apple Pay 結帳選項,建議您截圖並聯繫客服,我們會協助您確認: https://support.rhinoshield.io/hc/en-us/requests/new 如有其他支付方式相關問題,也歡迎隨時詢問!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 如果想使用 Apple Pay,請使用 Safari 瀏覽器訪問官方網站
    • 您將會看到 Apple Pay 選項
    Judge 推理
    這個回答完全符合用戶的查詢,提供了正確的資訊,並且涵蓋了所有關鍵點。回覆中也包含了額外的客服聯繫資訊,顯示出良好的服務態度。
  • 案例 6D500632

    請問各型號尺寸和重量可以查詢嗎?

    已完成
    第 1 次嘗試 · 已完成 39953ms
    腳本進度 · 詢問各型號重量尺寸 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 詢問各型號重量尺寸
    腳本規則
    - 當客人問到產品的以下資訊「
    1. 尺寸與體積相關
    -尺寸、大小、size、體積
    -長度、寬度、高度、深度、厚度
    -多大、多小、多長、多寬、多高
    -規格、dimensions、measurements
    
    2. 重量相關
    -重量、重、多重、幾公斤、幾克
    -淨重、毛重、weight
    -輕重、份量
    
    3. 容量與數量相關
    -容量、capacity、容積、幾公升、幾毫升
    -數量、份量、內容量
    -可容納、可裝、可放
    
    」
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - 當客人問到產品的尺寸、重量、容量相關,請回覆以下訊息:
    「感謝您的詢問。請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot 」
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 04
    USER請問各型號尺寸和重量可以查詢嗎?
    BOT感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot

    知識檢索

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • know_369116
    TP 0
    FP 0
    FN 1

    產品檢索

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • prod_1014121
    TP 0
    FP 0
    FN 1
    PARTIAL
    忠實度——metric 尚未齊全 (缺:hallucination_rate, citation_grounding)

    回答品質

    73.3%
    相關性
    50.0%
    完整性
    70.0%
    正確性
    100.0%
    AI 回覆
    感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot
    預期答案
    感謝您的詢問。請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot?
    Judge 推理
    回覆未能詢問客戶具體的產品型號或規格,未符合要求的問詢方式,導致相關性和完整性得分降低。