執行 #139

Intelligent Customer Service - Rhino (bulk R1) → production-baseline

狀態
已完成
案例
28
開始時間
16 May 11:45
耗時
692.8s
¶ Economics · Bot-side N=28 attempts

Cost & Tokens

$0.2681
Total Bot Cost · USD
62.3%
Prompt Cache Hit
cost per case
$0.0096
cost per 1k tokens
$0.0012
input tokens
212,187
output tokens
5,237
cached tokens — prompt-cache hit
132,096
Total Tokens
217,424
economic efficiency
cost per correct
$0.0016
pass rate
53.6%
15 / 28
judge cost
$0.0243
設定快照(reproducibility) 1 個 bot 已捕捉 · Judge:gpt-4o-mini

Bot 設定快照

  • e875a090-2bd5-4992-9642-7626c7859461 312 筆 KB
    SystemPrompt: sha256:a147cf42 KBContent: sha256:d886d45c Tools: sha256:4a6a05b0 Scenarios: sha256:6aaf3980 AI: gpt-4.1-2025-04-14 (T=0.0, max=2048)

Judge 設定快照

model: gpt-4o-mini T=0.0 max=4096 prompt: v1
已完成
28 / 28
錯誤
0
失敗維度
10
首字延遲 p95
3737 ms
Bot 成本(Neptune)
$0.2681
Bot Tokens(Neptune)
217,424
Judge 成本(Eris)
$0.0243
Judge Tokens(Eris)
184,934
項目 I.

知識庫精準度

kb_accuracy 10 cases

維度總表

各維度品質分 · 覆蓋率
找對資料 召回
retrieval
60.0%
[30.0% – 90.0%] · n=10
F1 20.0% · 相關率 12.0% · 精確 52.0%
10 / 10 適用 · 7 提示
不亂編造 平均
faithfulness
83.3%
[50.0% – 100.0%] · n=6
10 / 10 適用
答得到位 平均
answer_quality
53.0%
[31.0% – 73.7%] · n=10
10 / 10 適用
  • 案例 0F6D9037

    Nature Explorers 手機殼適用於哪些裝置?

    已完成
    第 1 次嘗試 · 已完成 29370ms
    腳本進度 · 知識與產品查詢 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ● 已呼叫:search_knowledges、search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USERNature Explorers 手機殼適用於哪些裝置?
    BOT稍等一下我來幫您查詢 💡 Nature Explorers 手機殼適用於多種裝置,包含以下品牌與型號: Apple(iPhone、AirPods、iPad Air): - iPhone 16 Plus、iPhone 16 Pro、iPhone 16 Pro Max、iPhone 16、iPhone 16e - iPhone 15 Pro Max、iPhone 13、iPhone 17、iPhone Air、iPhone 17 Pro - iPhone 17 Pro Max、iPhone 17e、iPhone 15 Pro、iPhone 15、iPhone 15 Plus - iPhone 13 Pro Max、iPhone 8 Plus、iPhone 14、iPhone 14 Plus - iPhone 14 Pro、iPhone 14 Pro Max、iPhone 12、iPhone 12 Pro - iPhone 12 Pro Max、iPhone 13 Pro、iPhone 7 Plus、iPhone 13 mini - iPhone SE 第二代/第三代、iPhone 12 mini、iPhone XS Max - iPhone XS、iPhone 11 Pro Max、iPhone 11、iPhone XR - iPhone X、iPhone 7、iPhone 8 - AirPods(1/2/3/Pro/Pro2/Pro3/4) - iPad Air(4/5/6/M3/M4) Samsung(三星): - Galaxy S24 FE/S25/S25 Ultra/S25 Plus/S25 FE/S26/S26 Ultra/S26 Plus - Galaxy A56/A55/A57/A15(4G/5G)/A54/A14(4G/5G)/A13/A73 - Galaxy S24/S24 Plus/S24 Ultra/S23 FE/S23 Plus/S23 Ultra/S23 - Galaxy S22/S22 Plus/S22 Ultra/S21 FE/S21 Plus/S21 Ultra/S21 - Galaxy S20/S20 Plus/S20 Ultra/S10 Google Pixel: - Pixel 8A/9/9 Pro XL/9 Pro/10a/10/10 Pro/10 Pro XL - Pixel 6/6A/7A/7/7 Pro/8/8 Pro Xiaomi(小米): - Xiaomi 13t /13t Pro /MI11 Ultra /11t /11t Pro - Redmi Note 系列:Note9 /Note11 Pro /Note11 Pro+ /Note12 /Note12 Pro ASUS: - Zenfone 系列:Zenfone10 /Zenfone11 Ultra /Zenfone12 Ultra 如需查看完整型號清單或購買,歡迎參考下方連結: https://rhinoshield.io/design-studio/collections/nature-explorers/ 如果您有特定型號想確認,請提供詳細型號,我可以幫您再次查詢!

    產品檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • prod_1014085
    意料之外 (4)
    • ! prod_1014078
    • ! prod_1014103
    • ! prod_1014144
    • ! prod_1014114
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI的回覆中提到的手機型號和品牌都未在來源中找到具體支持,但提到的連結是正確的,因此所有的具體型號都被視為支持的內容。

    回答品質

    50.0%
    相關性
    100.0%
    完整性
    50.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    25.0% · w 60%
    • Nature Explorers 手機殼適用於 GRIPs
    • Nature Explorers 手機殼適用於 Android 裝置
    II 重要
    III 補充
    AI 回覆
    稍等一下我來幫您查詢 💡 Nature Explorers 手機殼適用於多種裝置,包含以下品牌與型號: Apple(iPhone、AirPods、iPad Air): - iPhone 16 Plus、iPhone 16 Pro、iPhone 16 Pro Max、iPhone 16、iPhone 16e - iPhone 15 Pro Max、iPhone 13、iPhone 17、iPhone Air、iPhone 17 Pro - iPhone 17 Pro Max、iPhone 17e、iPhone 15 Pro、iPhone 15、iPhone 15 Plus - iPhone 13 Pro Max、iPhone 8 Plus、iPhone 14、iPhone 14 Plus - iPhone 14 Pro、iPhone 14 Pro Max、iPhone 12、iPhone 12 Pro - iPhone 12 Pro Max、iPhone 13 Pro、iPhone 7 Plus、iPhone 13 mini - iPhone SE 第二代/第三代、iPhone 12 mini、iPhone XS Max - iPhone XS、iPhone 11 Pro Max、iPhone 11、iPhone XR - iPhone X、iPhone 7、iPhone 8 - AirPods(1/2/3/Pro/Pro2/Pro3/4) - iPad Air(4/5/6/M3/M4) Samsung(三星): - Galaxy S24 FE/S25/S25 Ultra/S25 Plus/S25 FE/S26/S26 Ultra/S26 Plus - Galaxy A56/A55/A57/A15(4G/5G)/A54/A14(4G/5G)/A13/A73 - Galaxy S24/S24 Plus/S24 Ultra/S23 FE/S23 Plus/S23 Ultra/S23 - Galaxy S22/S22 Plus/S22 Ultra/S21 FE/S21 Plus/S21 Ultra/S21 - Galaxy S20/S20 Plus/S20 Ultra/S10 Google Pixel: - Pixel 8A/9/9 Pro XL/9 Pro/10a/10/10 Pro/10 Pro XL - Pixel 6/6A/7A/7/7 Pro/8/8 Pro Xiaomi(小米): - Xiaomi 13t /13t Pro /MI11 Ultra /11t /11t Pro - Redmi Note 系列:Note9 /Note11 Pro /Note11 Pro+ /Note12 /Note12 Pro ASUS: - Zenfone 系列:Zenfone10 /Zenfone11 Ultra /Zenfone12 Ultra 如需查看完整型號清單或購買,歡迎參考下方連結: https://rhinoshield.io/design-studio/collections/nature-explorers/ 如果您有特定型號想確認,請提供詳細型號,我可以幫您再次查詢!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • Nature Explorers 手機殼適用於 iPhone
    • Nature Explorers 手機殼適用於 AirPods
    • Nature Explorers 手機殼適用於 GRIPs
    • Nature Explorers 手機殼適用於 Android 裝置
    Judge 推理
    回覆中提到的裝置型號雖然詳細,但未涵蓋所有必要的核心要點,特別是缺少了對 GRIPs 和 Android 裝置的適用性說明,因此完整性得分較低。
  • 案例 5257D17C

    可以透過哪裡請求發票?

    已完成
    第 1 次嘗試 · 已完成 9195ms
    腳本進度 · 知識與產品查詢 ◐ 進行中
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ◐ 已呼叫 1 / 2 個工具
    已呼叫:search_knowledges 未呼叫:search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER可以透過哪裡請求發票?
    BOT正在為您搜尋最新資料 ⏳ 您可以透過以下客服表單請求發票,我們會立即提供 PDF 格式的發票給您: https://support.rhinoshield.io/hc/en-us/requests/new 如果您的包裹尚未出貨,暫時無法提供發票。等收到出貨通知信(內含追蹤編號)後,再透過上述表單聯繫我們即可。

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_369052
    意料之外 (4)
    • ! know_369054
    • ! know_369233
    • ! know_369150
    • ! know_369232
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI 的回覆完全符合來源資料,所有的事實陳述都有來源支持,因此沒有虛構的聲明。

    回答品質

    100.0%
    相關性
    100.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    100.0% · w 30%
    III 補充
    AI 回覆
    正在為您搜尋最新資料 ⏳ 您可以透過以下客服表單請求發票,我們會立即提供 PDF 格式的發票給您: https://support.rhinoshield.io/hc/en-us/requests/new 如果您的包裹尚未出貨,暫時無法提供發票。等收到出貨通知信(內含追蹤編號)後,再透過上述表單聯繫我們即可。
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 請通過網頁表單聯絡我們
    • 我們會立即提供您 PDF 格式的發票
    II 重要限制 w 30%
    • 請使用此連結: https://support.rhinoshield.io/hc/en-us/requests/new
    Judge 推理
    回覆完整地回答了用戶的問題,並提供了正確的連結和發票請求的方式,符合預期的回覆風格。
  • 案例 1EB42475

    PRIDE 2024: Love in All Forms 是什麼活動呢?

    已完成
    第 1 次嘗試 · 已完成 13452ms
    腳本進度 · 知識與產品查詢 ◐ 進行中
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ◐ 已呼叫 1 / 2 個工具
    已呼叫:search_knowledges 未呼叫:search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USERPRIDE 2024: Love in All Forms 是什麼活動呢?
    BOT稍等一下我來幫您查詢 💡 目前沒有找到「PRIDE 2024: Love in All Forms」活動的詳細介紹。如果您是想詢問與 RHINOSHIELD 合作或相關活動,歡迎您填寫合作申請表,我們的行銷團隊會在 7 天內與您聯繫: https://forms.clickup.com/3704209/f/3h1ch-965638/E4FG3MKVUN7AK9LKI5 如需其他協助,也歡迎隨時告訴我!

    產品檢索

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • prod_1014112
    TP 0
    FP 0
    FN 1

    回答品質

    26.7%
    相關性
    50.0%
    完整性
    30.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    0.0% · w 60%
    • PRIDE 2024: Love in All Forms 旨在慶祝 LGBTQIA+ 的多樣性
    • 保護你的獨特身份和手機
    II 重要
    III 補充
    AI 回覆
    稍等一下我來幫您查詢 💡 目前沒有找到「PRIDE 2024: Love in All Forms」活動的詳細介紹。如果您是想詢問與 RHINOSHIELD 合作或相關活動,歡迎您填寫合作申請表,我們的行銷團隊會在 7 天內與您聯繫: https://forms.clickup.com/3704209/f/3h1ch-965638/E4FG3MKVUN7AK9LKI5 如需其他協助,也歡迎隨時告訴我!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • PRIDE 2024: Love in All Forms 旨在慶祝 LGBTQIA+ 的多樣性
    • 保護你的獨特身份和手機
    Judge 推理
    AI 的回覆未能正確回答用戶的問題,且缺乏關於活動的關鍵資訊,導致完整性和正確性都很低。
    錯誤陳述 (1)
    • 目前沒有找到「PRIDE 2024: Love in All Forms」活動的詳細介紹
  • 案例 55E47203

    LAIMO 的創作是從哪一年開始的?

    已完成
    第 1 次嘗試 · 已完成 10171ms
    腳本進度 · 知識與產品查詢 ◐ 進行中
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ◐ 已呼叫 1 / 2 個工具
    已呼叫:search_knowledges 未呼叫:search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USERLAIMO 的創作是從哪一年開始的?
    BOT稍等一下我來幫您查詢 💡 很抱歉,目前沒有查到關於 LAIMO 創作起始年份的相關資訊。如果您需要更詳細的資料,建議您聯繫專人客服協助查詢。 請你完整填寫以下客服表單,我們的客服團隊會根據你提供的資訊快速於服務時間內協助你:https://url.rhinoshield.io/io-chatbot 感謝您的配合!

    產品檢索

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • prod_1014049
    TP 0
    FP 0
    FN 1

    回答品質

    0.0%
    相關性
    0.0%
    完整性
    0.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    0.0% · w 60%
    • LAIMO 的創作始於 2012 年
    II 重要
    III 補充
    AI 回覆
    稍等一下我來幫您查詢 💡 很抱歉,目前沒有查到關於 LAIMO 創作起始年份的相關資訊。如果您需要更詳細的資料,建議您聯繫專人客服協助查詢。 請你完整填寫以下客服表單,我們的客服團隊會根據你提供的資訊快速於服務時間內協助你:https://url.rhinoshield.io/io-chatbot 感謝您的配合!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • LAIMO 的創作始於 2012 年
    Judge 推理
    這個回答完全沒有提供 LAIMO 創作的起始年份,且未能回答用戶的問題,導致相關性、完整性和正確性均為零。
  • 案例 526A3166

    海外交易需要使用什麼卡片嗎?

    已完成
    第 1 次嘗試 · 已完成 11082ms
    腳本進度 · 知識與產品查詢 ◐ 進行中
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ◐ 已呼叫 1 / 2 個工具
    已呼叫:search_knowledges 未呼叫:search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER海外交易需要使用什麼卡片嗎?
    BOT正在為您搜尋最新資料 ⏳ 您好,我是智能客服 Rhino,很高興為您服務! 關於海外交易,RHINOSHIELD 支援的付款方式有:PayPal、信用卡/金融卡(VISA、Mastercard、AMEX、JCB)、Apple Pay 及 Google Pay。如果您使用的是金融卡,需確保是支援 Visa 的金融卡才能進行海外交易。 如果您的銀行帳戶或 PayPal 帳戶的幣別與官網不同,系統會自動進行匯率轉換。 如有其他付款相關問題,也歡迎隨時詢問!

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_369170
    意料之外 (4)
    • ! know_368956
    • ! know_369236
    • ! know_368957
    • ! know_369256
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI 的回覆中提到的付款方式和條件均有來源支持,且沒有任何虛構的聲明,因此評分為 0.0 的幻覺率和 1.0 的引用基礎。

    回答品質

    63.3%
    相關性
    90.0%
    完整性
    50.0%
    正確性
    50.0%
    加權拆解 · 三層 coverage
    I 核心
    0.0% · w 60%
    • 海外交易需要使用 Debit Visa 卡
    II 重要
    III 補充
    AI 回覆
    正在為您搜尋最新資料 ⏳ 您好,我是智能客服 Rhino,很高興為您服務! 關於海外交易,RHINOSHIELD 支援的付款方式有:PayPal、信用卡/金融卡(VISA、Mastercard、AMEX、JCB)、Apple Pay 及 Google Pay。如果您使用的是金融卡,需確保是支援 Visa 的金融卡才能進行海外交易。 如果您的銀行帳戶或 PayPal 帳戶的幣別與官網不同,系統會自動進行匯率轉換。 如有其他付款相關問題,也歡迎隨時詢問!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 海外交易需要使用 Debit Visa 卡
    Judge 推理
    回覆中提到的付款方式雖然與海外交易相關,但並未直接回答使用 Debit Visa 卡的必要性,因此在完整性上得分較低。回覆的正確性也因未符合核心必答而受到影響。
  • 案例 BE5F7362

    Shishiro Botan 支援哪種手機?

    已完成
    第 1 次嘗試 · 已完成 25715ms
    腳本進度 · 知識與產品查詢 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ● 已呼叫:search_knowledges、search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USERShishiro Botan 支援哪種手機?
    BOT馬上為您找找看相關內容 📋 您好,我是 Intelligent Customer Service - Rhino,很高興為您服務! RHINOSHIELD Shishiro Botan 聯名系列支援的手機型號非常多,包含以下品牌與型號: Apple(iPhone): - iPhone 7、7 Plus、8、8 Plus、X、XR、XS、XS Max - iPhone 11、11 Pro、11 Pro Max - iPhone 12、12 mini、12 Pro、12 Pro Max - iPhone 13、13 mini、13 Pro、13 Pro Max - iPhone 14、14 Plus、14 Pro、14 Pro Max - iPhone 15、15 Plus、15 Pro、15 Pro Max - iPhone 16 系列(16、16 Plus、16 Pro、16 Pro Max、16e) - iPhone 17 系列(17、17e、17 Pro、17 Pro Max) - iPhone Air - iPhone SE(第2代、第3代) Samsung(三星): - Galaxy S10 系列 - Galaxy S20 系列(S20, S20+, S20 Ultra) - Galaxy S21 系列(S21, S21+, S21 Ultra, S21 FE) - Galaxy S22 系列(S22, S22+, S22 Ultra) - Galaxy S23 系列(S23, S23+, S23 Ultra, S23 FE) - Galaxy S24 系列(S24, S24+, S24 Ultra, S24 FE) - Galaxy S25 系列(S25, S25+, S25 Ultra, S25 FE) - Galaxy S26 系列(S26, S26+, S26 Ultra) - A系列部分型號:A13, A14, A14 5G, A15 4G/5G, A54, A55, A56, A57, A73 Google Pixel: - Pixel 6/6A/7/7A/8/8A/8 Pro/9/9 Pro/9 Pro XL/10/10a/10 Pro/10 Pro XL 小米 Xiaomi: - Xiaomi 11t/11t Pro/Mi 11 Ultra - Redmi Note 9/11 Pro/11 Pro Plus/12/12 Pro - Xiaomi 13t/13t Pro ASUS: - Zenfone 10 - Zenfone 11 Ultra - Zenfone 12 Ultra 如需完整型號清單或直接選購,歡迎參考官方網站: https://rhinoshield.io/design-studio/collections/shishirobotan/ 如果您有特定手機型號想確認是否支援,也可以直接告訴我,我會再幫您查詢!

    產品檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • prod_1014162
    意料之外 (4)
    • ! prod_1014193
    • ! prod_1014188
    • ! prod_1014194
    • ! prod_1014176
    TP 1
    FP 4
    FN 0

    忠實度

    幻覺
    幻覺比率
    100.0%
    越低越好
    引用依據
    0.0%
    越高越好
    Judge 推理
    AI的回覆中提到的手機型號和品牌並未在提供的來源中找到支持,因此所有的具體型號都被視為虛構。
    幻覺陳述 (1)
    • RHINOSHIELD Shishiro Botan 聯名系列支援的手機型號非常多,包含以下品牌與型號:Apple(iPhone)、Samsung(三星)、Google Pixel、小米 Xiaomi、ASUS等多個品牌的具體型號

    回答品質

    50.0%
    相關性
    100.0%
    完整性
    50.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    50.0% · w 60%
    • Shishiro Botan 支援 Android 手機
    II 重要
    III 補充
    AI 回覆
    馬上為您找找看相關內容 📋 您好,我是 Intelligent Customer Service - Rhino,很高興為您服務! RHINOSHIELD Shishiro Botan 聯名系列支援的手機型號非常多,包含以下品牌與型號: Apple(iPhone): - iPhone 7、7 Plus、8、8 Plus、X、XR、XS、XS Max - iPhone 11、11 Pro、11 Pro Max - iPhone 12、12 mini、12 Pro、12 Pro Max - iPhone 13、13 mini、13 Pro、13 Pro Max - iPhone 14、14 Plus、14 Pro、14 Pro Max - iPhone 15、15 Plus、15 Pro、15 Pro Max - iPhone 16 系列(16、16 Plus、16 Pro、16 Pro Max、16e) - iPhone 17 系列(17、17e、17 Pro、17 Pro Max) - iPhone Air - iPhone SE(第2代、第3代) Samsung(三星): - Galaxy S10 系列 - Galaxy S20 系列(S20, S20+, S20 Ultra) - Galaxy S21 系列(S21, S21+, S21 Ultra, S21 FE) - Galaxy S22 系列(S22, S22+, S22 Ultra) - Galaxy S23 系列(S23, S23+, S23 Ultra, S23 FE) - Galaxy S24 系列(S24, S24+, S24 Ultra, S24 FE) - Galaxy S25 系列(S25, S25+, S25 Ultra, S25 FE) - Galaxy S26 系列(S26, S26+, S26 Ultra) - A系列部分型號:A13, A14, A14 5G, A15 4G/5G, A54, A55, A56, A57, A73 Google Pixel: - Pixel 6/6A/7/7A/8/8A/8 Pro/9/9 Pro/9 Pro XL/10/10a/10 Pro/10 Pro XL 小米 Xiaomi: - Xiaomi 11t/11t Pro/Mi 11 Ultra - Redmi Note 9/11 Pro/11 Pro Plus/12/12 Pro - Xiaomi 13t/13t Pro ASUS: - Zenfone 10 - Zenfone 11 Ultra - Zenfone 12 Ultra 如需完整型號清單或直接選購,歡迎參考官方網站: https://rhinoshield.io/design-studio/collections/shishirobotan/ 如果您有特定手機型號想確認是否支援,也可以直接告訴我,我會再幫您查詢!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • Shishiro Botan 支援 iPhone 和 Android 手機
    Judge 推理
    回覆中提供了大量的手機型號,但未能正確回答 Shishiro Botan 支援的手機類型,特別是 Android 手機的部分。
    錯誤陳述 (1)
    • 提供的手機型號清單過於詳細,未能正確回答問題
  • 案例 D2AE394B

    Beauty of Japan 的手機殼是為了什麼設計的?

    已完成
    第 1 次嘗試 · 已完成 9442ms
    腳本進度 · 知識與產品查詢 ◐ 進行中
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ◐ 已呼叫 1 / 2 個工具
    已呼叫:search_knowledges 未呼叫:search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USERBeauty of Japan 的手機殼是為了什麼設計的?
    BOT正在為您搜尋最新資料 ⏳ 目前查詢結果中沒有直接說明「Beauty of Japan」手機殼的設計理念或相關介紹。若您需要這個系列的具體設計理念或靈感來源,建議您可以聯繫我們的客服團隊,讓專人協助您查詢最正確的資訊: https://url.rhinoshield.io/io-chatbot 感謝您的提問!

    產品檢索

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • prod_1014104
    TP 0
    FP 0
    FN 1

    回答品質

    26.7%
    相關性
    50.0%
    完整性
    30.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    0.0% · w 60%
    • Beauty of Japan 的手機殼旨在保護手機同時展現風格
    • 融入日本文化的美感
    II 重要
    III 補充
    AI 回覆
    正在為您搜尋最新資料 ⏳ 目前查詢結果中沒有直接說明「Beauty of Japan」手機殼的設計理念或相關介紹。若您需要這個系列的具體設計理念或靈感來源,建議您可以聯繫我們的客服團隊,讓專人協助您查詢最正確的資訊: https://url.rhinoshield.io/io-chatbot 感謝您的提問!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • Beauty of Japan 的手機殼旨在保護手機同時展現風格
    • 融入日本文化的美感
    Judge 推理
    這個回覆未能回答用戶的問題,缺乏對於「Beauty of Japan」手機殼設計理念的具體說明,且未提供任何相關資訊,導致回答不完整且不正確。
  • 案例 20C320A7

    AquaStand 可以跟 iPhone 11 一起用嗎

    已完成
    第 1 次嘗試 · 已完成 19977ms
    腳本進度 · 知識與產品查詢 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ● 已呼叫:search_knowledges、search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USERAquaStand 可以跟 iPhone 11 一起用嗎
    BOT稍等一下我來幫您查詢 💡 RHINOSHIELD AquaStand 可以與 iPhone 11 一起使用,但需要注意以下事項: - iPhone 12 以上機型有內建 MagSafe,可以直接磁吸使用 AquaStand。 - iPhone 11 屬於無 MagSafe 的機型,若要搭配 AquaStand 使用,建議加購 RHINOSHIELD 磁吸環(Magnetic Ring),這樣就能讓 iPhone 11 也能穩定吸附在 AquaStand 上。 如果您有其他關於配件或使用方式的問題,也歡迎隨時詢問! AquaStand 購買頁面: https://rhinoshield.io/products/aquastand/buy

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_368989
    意料之外 (4)
    • ! know_369051
    • ! know_368990
    • ! know_369248
    • ! know_369005
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI 的回覆完全符合來源材料的內容,所有的事實陳述都有來源支持,因此沒有任何虛構的聲明。

    回答品質

    96.7%
    相關性
    100.0%
    完整性
    90.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    50.0% · w 30%
    • 最好搭配 RHINOSHIELD 的磁性環使用,以獲得最佳效果
    III 補充
    AI 回覆
    稍等一下我來幫您查詢 💡 RHINOSHIELD AquaStand 可以與 iPhone 11 一起使用,但需要注意以下事項: - iPhone 12 以上機型有內建 MagSafe,可以直接磁吸使用 AquaStand。 - iPhone 11 屬於無 MagSafe 的機型,若要搭配 AquaStand 使用,建議加購 RHINOSHIELD 磁吸環(Magnetic Ring),這樣就能讓 iPhone 11 也能穩定吸附在 AquaStand 上。 如果您有其他關於配件或使用方式的問題,也歡迎隨時詢問! AquaStand 購買頁面: https://rhinoshield.io/products/aquastand/buy
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • AquaStand 可以與 iPhone 11 或以下型號相容
    II 重要限制 w 30%
    • 最好搭配 RHINOSHIELD 的磁性環使用,以獲得最佳效果
    Judge 推理
    回覆中提到 AquaStand 可以與 iPhone 11 一起使用,並且提供了額外的建議,但未完整涵蓋「最好搭配 RHINOSHIELD 的磁性環使用,以獲得最佳效果」這一關鍵點,因此在完整性上有所扣分。
  • 案例 767EF40A

    Joe Horner是誰?

    已完成
    第 1 次嘗試 · 已完成 10763ms
    腳本進度 · 知識與產品查詢 ◐ 進行中
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ◐ 已呼叫 1 / 2 個工具
    已呼叫:search_knowledges 未呼叫:search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USERJoe Horner是誰?
    BOTPlease wait a moment, I'll help you check 💡 Based on the available information, there is no relevant answer regarding "Joe Horner." If you need more details or have a specific context about Joe Horner, please let me know so I can assist you further. If your question is related to RHINOSHIELD products or services, feel free to provide more details!

    產品檢索

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • prod_1014191
    TP 0
    FP 0
    FN 1

    回答品質

    16.7%
    相關性
    50.0%
    完整性
    0.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    0.0% · w 60%
    • Joe Horner是花卉藝術家
    • 創作了這系列手機殼
    II 重要
    III 補充
    AI 回覆
    Please wait a moment, I'll help you check 💡 Based on the available information, there is no relevant answer regarding "Joe Horner." If you need more details or have a specific context about Joe Horner, please let me know so I can assist you further. If your question is related to RHINOSHIELD products or services, feel free to provide more details!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • Joe Horner是花卉藝術家
    • 創作了這系列手機殼
    Judge 推理
    AI的回答未能提供任何有關Joe Horner的正確資訊,且錯誤地聲稱沒有相關答案,完全未涵蓋正確的核心內容。
    錯誤陳述 (1)
    • 沒有相關答案
  • 案例 345D6F2D

    GRIP O MFM 需要搭配什麼手機殼使用?

    已完成
    第 1 次嘗試 · 已完成 25375ms
    腳本進度 · 知識與產品查詢 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    STEP
    03

    API 工具

    ● 已呼叫:search_knowledges、search_products
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USERGRIP O MFM 需要搭配什麼手機殼使用?
    BOT讓我幫您查詢一下相關資訊 🔍 RHINOSHIELD GRIP O MFM(MagSafe相容款)建議搭配 RHINOSHIELD 的MagSafe相容手機殼使用。根據測試,當GRIP O與RHINOSHIELD MagSafe相容殼搭配時,磁吸力會比原廠標準強上兩倍以上,能確保穩固吸附與使用體驗。 如果您需要選購MagSafe相容的RHINOSHIELD手機殼,可以參考下方連結挑選適合您手機型號的款式: Oracle Red Bull Racing系列(支援多款iPhone、Samsung、Google、Xiaomi、ASUS等型號) https://rhinoshield.io/design-studio/collections/oracle-redbull-racing/ MITSUME聯名系列(支援多款iPhone、Samsung、Google、Xiaomi、ASUS等型號) https://rhinoshield.io/design-studio/collections/mitsume/ 如需其他設計或型號,歡迎告訴我您的手機型號,我可以幫您查詢更多適用的RHINOSHIELD MagSafe相容手機殼!

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_369019
    意料之外 (4)
    • ! know_369017
    • ! know_369014
    • ! know_369018
    • ! know_369012
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI的回覆完全基於來源資料,所有的事實陳述都有相應的支持,並且沒有任何虛構的內容。

    回答品質

    100.0%
    相關性
    100.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    III 補充
    AI 回覆
    讓我幫您查詢一下相關資訊 🔍 RHINOSHIELD GRIP O MFM(MagSafe相容款)建議搭配 RHINOSHIELD 的MagSafe相容手機殼使用。根據測試,當GRIP O與RHINOSHIELD MagSafe相容殼搭配時,磁吸力會比原廠標準強上兩倍以上,能確保穩固吸附與使用體驗。 如果您需要選購MagSafe相容的RHINOSHIELD手機殼,可以參考下方連結挑選適合您手機型號的款式: Oracle Red Bull Racing系列(支援多款iPhone、Samsung、Google、Xiaomi、ASUS等型號) https://rhinoshield.io/design-studio/collections/oracle-redbull-racing/ MITSUME聯名系列(支援多款iPhone、Samsung、Google、Xiaomi、ASUS等型號) https://rhinoshield.io/design-studio/collections/mitsume/ 如需其他設計或型號,歡迎告訴我您的手機型號,我可以幫您查詢更多適用的RHINOSHIELD MagSafe相容手機殼!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • GRIP O MFM 需要與兼容的 MagSafe 手機殼搭配使用
    Judge 推理
    這個回答完全符合用戶的問題,清楚地指出GRIP O MFM需要與兼容的MagSafe手機殼搭配使用,並提供了額外的資訊和連結,讓用戶能夠選擇合適的手機殼。
項目 II.

情境調用與完成

scenario_funnel 10 cases

維度總表

各維度品質分 · 覆蓋率
走對流程 召回
scenario
90.0%
[70.0% – 100.0%] · n=10
F1 76.7% · 召回 90.0% · 精確 70.0%
10 / 10 適用
用對工具 召回
tool_usage
50.0%
[0.0% – 100.0%] · n=4
F1 66.7% · 召回 62.5% · 精確 100.0%
4 / 10 適用
答得到位 平均
answer_quality
78.0%
[65.3% – 89.0%] · n=10
10 / 10 適用
  • 案例 83A46086

    產品異常怎麼處理?

    已完成
    第 1 次嘗試 · 已完成 13950ms
    腳本進度 · 產品異常 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 產品異常
    腳本規則
    - 當消費者提到「產品+異常原因」,例如「手機殼圖案剝落、產品刮傷、按鈕脫落、產品斷裂、殼變形、保護貼浮邊或是觸控不良」等等
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - Reply:
    
    We apologize for any inconvenience you may have encountered while using our product. We will assist you as soon as possible. 
    
    Please fill out our customer service form, select "After-Sales Inquiry > Product Support," and provide complete order/product information, as well as photos or videos of the product malfunction so that we can provide assistance quickly! Thank you for your cooperation.
    
    Customer Service Form: https://url.rhinoshield.io/io-chatbot
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER產品異常怎麼處理?
    BOT正在為您搜尋最新資料 ⏳ 很抱歉造成您的不便。如果您收到的產品有異常,請您透過我們的客服表單提交申請,並附上訂單資訊及產品問題的照片。我們的團隊會在服務時間內盡快回覆您: https://support.rhinoshield.io/hc/en-us/requests/new 如有其他疑問,也歡迎隨時告訴我!

    情境路由

    66.7%
    Precision
    50.0%
    Recall
    100.0%
    F1
    66.7%
    預期 (1)
    • 3829 · 產品異常
    意料之外 (1)
    • ! 知識與產品查詢
    TP 1
    FP 1
    FN 0

    回答品質

    83.3%
    相關性
    100.0%
    完整性
    70.0%
    正確性
    80.0%
    加權拆解 · 三層 coverage
    I 核心
    50.0% · w 60%
    • 選擇「售後查詢 > 產品支援」
    II 重要
    III 補充
    50.0% · w 10%
    • 謝謝你的合作
    • 客服表單連結: https://url.rhinoshield.io/io-chatbot
    AI 回覆
    正在為您搜尋最新資料 ⏳ 很抱歉造成您的不便。如果您收到的產品有異常,請您透過我們的客服表單提交申請,並附上訂單資訊及產品問題的照片。我們的團隊會在服務時間內盡快回覆您: https://support.rhinoshield.io/hc/en-us/requests/new 如有其他疑問,也歡迎隨時告訴我!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 請填寫客服表單,選擇「售後查詢 > 產品支援」
    • 提供完整的訂單/產品資訊,以及產品異常的照片或影片
    III 補充說明 w 10%
    • 謝謝你的合作
    • 客服表單連結: https://url.rhinoshield.io/io-chatbot
    Judge 推理
    回覆中提到的客服表單和提供資訊的要求符合用戶的問題,但缺少了具體的選擇步驟和完整的客服表單連結,導致完整性不足。
  • 案例 742291DF

    請問不同型號的重量是多少?

    已完成
    第 1 次嘗試 · 已完成 10622ms
    腳本進度 · 詢問各型號重量尺寸 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 詢問各型號重量尺寸
    腳本規則
    - 當客人問到產品的以下資訊「
    1. 尺寸與體積相關
    -尺寸、大小、size、體積
    -長度、寬度、高度、深度、厚度
    -多大、多小、多長、多寬、多高
    -規格、dimensions、measurements
    
    2. 重量相關
    -重量、重、多重、幾公斤、幾克
    -淨重、毛重、weight
    -輕重、份量
    
    3. 容量與數量相關
    -容量、capacity、容積、幾公升、幾毫升
    -數量、份量、內容量
    -可容納、可裝、可放
    
    」
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - 當客人問到產品的尺寸、重量、容量相關,請回覆以下訊息:
    「感謝您的詢問。請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot 」
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 04
    USER請問不同型號的重量是多少?
    BOT感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot

    情境路由

    100.0%
    Precision
    100.0%
    Recall
    100.0%
    F1
    100.0%
    預期 (1)
    • 7285 · 詢問各型號重量尺寸
    TP 1
    FP 0
    FN 0

    回答品質

    96.7%
    相關性
    90.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    III 補充
    100.0% · w 10%
    AI 回覆
    感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊
    • 我們將於服務時間內盡快回覆
    III 補充說明 w 10%
    • 感謝您的詢問
    Judge 推理
    回覆內容完全符合規範,並且涵蓋了所有必要的要點,沒有遺漏或錯誤的資訊。
  • 案例 3F8556A5

    我想知道商品的購買流程是怎麼樣的?

    已完成
    第 1 次嘗試 · 已完成 16030ms
    腳本進度 · 知識與產品查詢 ✗ 卡關
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    ✗ 已收集 0 / 2 項
    未收集:query、keywords_or_codes
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    預期 / 已收集 (0/2)
    欄位 預期值(generate) 已收集(run)
    query 我想了解最新的智能手機型號和功能 — (對話未走到)
    keywords_or_codes [] — (對話未走到)
    STEP
    03

    API 工具

    ○ 等待資訊收集完成
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    完整測試 4 個步驟
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER我想知道商品的購買流程是怎麼樣的?
    BOT馬上為您找找看相關內容 📋 您好,我是智能客服 Rhino,很高興為您說明 RHINOSHIELD 商品的購買流程: 1. 當您在官網下單成功後,系統會自動發送一封訂單確認信到您註冊的電子郵件信箱,標題為「[系統發送] Your RHINOSHIELD Order #IOXXXXXXX (7 digits) is confirmed」。這代表您的訂單已經成立。 2. 若您收到訂單確認信但沒有收到其他通知,建議您直接透過客服表單聯繫我們:https://support.rhinoshield.io/hc/en-us/requests/new 如果您還有其他關於購買流程的細節想了解,歡迎隨時告訴我!

    情境路由

    100.0%
    Precision
    100.0%
    Recall
    100.0%
    F1
    100.0%
    預期 (1)
    • 1963 · 知識與產品查詢
    TP 1
    FP 0
    FN 0

    工具使用

    66.7%
    Precision
    100.0%
    Recall
    50.0%
    F1
    66.7%
    預期 (2)
    • search_knowledges
    • search_products
    TP 1
    FP 0
    FN 1

    回答品質

    80.0%
    相關性
    100.0%
    完整性
    60.0%
    正確性
    80.0%
    加權拆解 · 三層 coverage
    I 核心
    50.0% · w 60%
    • 購買成功後,商品將會在約定的時間內送達
    II 重要
    0.0% · w 30%
    • 只有在官網購買的商品可以在到達後30天內進行退換貨
    • 其他途徑購買的商品需聯繫相關賣家處理
    III 補充
    0.0% · w 10%
    • 若您有其他問題或需要推薦的產品,請隨時詢問
    AI 回覆
    馬上為您找找看相關內容 📋 您好,我是智能客服 Rhino,很高興為您說明 RHINOSHIELD 商品的購買流程: 1. 當您在官網下單成功後,系統會自動發送一封訂單確認信到您註冊的電子郵件信箱,標題為「[系統發送] Your RHINOSHIELD Order #IOXXXXXXX (7 digits) is confirmed」。這代表您的訂單已經成立。 2. 若您收到訂單確認信但沒有收到其他通知,建議您直接透過客服表單聯繫我們:https://support.rhinoshield.io/hc/en-us/requests/new 如果您還有其他關於購買流程的細節想了解,歡迎隨時告訴我!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 您可以在我們的官方網站上選擇您想購買的商品
    • 購買成功後,商品將會在約定的時間內送達
    II 重要限制 w 30%
    • 只有在官網購買的商品可以在到達後30天內進行退換貨
    • 其他途徑購買的商品需聯繫相關賣家處理
    III 補充說明 w 10%
    • 若您有其他問題或需要推薦的產品,請隨時詢問
    Judge 推理
    回覆中提到的購買流程部分正確,但缺少了關於商品送達時間及退換貨政策的關鍵資訊,導致完整性不足。此外,回覆中未包含任何補充的 CTA,這也影響了完整性評分。
  • 案例 9C322535

    商品的規格和尺寸是多少?

    已完成
    第 1 次嘗試 · 已完成 17320ms
    腳本進度 · 知識與產品查詢 ✗ 卡關
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    ✗ 已收集 0 / 2 項
    未收集:query、keywords_or_codes
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    預期 / 已收集 (0/2)
    欄位 預期值(generate) 已收集(run)
    query 我想了解最新的智能手機型號和功能 — (對話未走到)
    keywords_or_codes [] — (對話未走到)
    STEP
    03

    API 工具

    ○ 等待資訊收集完成
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    完整測試 4 個步驟
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USER商品的規格和尺寸是多少?
    BOT讓我幫您查詢一下相關資訊 🔍 您好,我是智能客服 Rhino,很高興為您服務! 目前您詢問的「商品的規格和尺寸」需要提供更明確的產品名稱或型號,才能查詢到正確的資訊。請問您想了解哪一款 RHINOSHIELD 商品的規格和尺寸呢?例如:手機殼型號、配件名稱等。 如果您已經有特定產品,請提供完整名稱或型號;若還不確定,也可以參考以下幾款熱門商品,告訴我您想查詢哪一項: 1. Mod NX Backplate 2. 方坊 Square Studio 3. Graffiti 4. Mod NX 5. Antique Housing Art 請回覆您想查詢的商品名稱,我會立即為您提供詳細規格與尺寸資訊!如果有其他需求,也歡迎隨時告訴我。

    情境路由

    66.7%
    Precision
    50.0%
    Recall
    100.0%
    F1
    66.7%
    預期 (1)
    • 1963 · 知識與產品查詢
    意料之外 (1)
    • ! 詢問各型號重量尺寸
    TP 1
    FP 1
    FN 0

    工具使用

    100.0%
    Precision
    100.0%
    Recall
    100.0%
    F1
    100.0%
    預期 (2)
    • search_knowledges
    • search_products
    TP 2
    FP 0
    FN 0

    回答品質

    50.0%
    相關性
    90.0%
    完整性
    60.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    50.0% · w 60%
    • 您可以在我們的網站上查詢相關產品的詳細規格和尺寸資訊
    • 我們提供多種產品,不同類型的產品會有不同的規格
    II 重要
    III 補充
    0.0% · w 10%
    • 請告訴我您正在尋找的特定商品,這樣我可以為您提供更準確的資訊
    AI 回覆
    讓我幫您查詢一下相關資訊 🔍 您好,我是智能客服 Rhino,很高興為您服務! 目前您詢問的「商品的規格和尺寸」需要提供更明確的產品名稱或型號,才能查詢到正確的資訊。請問您想了解哪一款 RHINOSHIELD 商品的規格和尺寸呢?例如:手機殼型號、配件名稱等。 如果您已經有特定產品,請提供完整名稱或型號;若還不確定,也可以參考以下幾款熱門商品,告訴我您想查詢哪一項: 1. Mod NX Backplate 2. 方坊 Square Studio 3. Graffiti 4. Mod NX 5. Antique Housing Art 請回覆您想查詢的商品名稱,我會立即為您提供詳細規格與尺寸資訊!如果有其他需求,也歡迎隨時告訴我。
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 您可以在我們的網站上查詢相關產品的詳細規格和尺寸資訊
    • 我們提供多種產品,不同類型的產品會有不同的規格
    III 補充說明 w 10%
    • 請告訴我您正在尋找的特定商品,這樣我可以為您提供更準確的資訊
    Judge 推理
    這個回覆雖然有詢問用戶的意圖,但未能提供網站上查詢產品規格的具體資訊,且未能完全遵循規則,導致正確性得分為零。
    錯誤陳述 (2)
    • 讓我幫您查詢一下相關資訊
    • 目前您詢問的「商品的規格和尺寸」需要提供更明確的產品名稱或型號,才能查詢到正確的資訊
  • 案例 A1E135A3

    產品異常的話,我需要提供什麼資訊才能獲得協助呢?

    已完成
    第 1 次嘗試 · 已完成 12079ms
    腳本進度 · 產品異常 ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 產品異常
    腳本規則
    - 當消費者提到「產品+異常原因」,例如「手機殼圖案剝落、產品刮傷、按鈕脫落、產品斷裂、殼變形、保護貼浮邊或是觸控不良」等等
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - Reply:
    
    We apologize for any inconvenience you may have encountered while using our product. We will assist you as soon as possible. 
    
    Please fill out our customer service form, select "After-Sales Inquiry > Product Support," and provide complete order/product information, as well as photos or videos of the product malfunction so that we can provide assistance quickly! Thank you for your cooperation.
    
    Customer Service Form: https://url.rhinoshield.io/io-chatbot
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER產品異常的話,我需要提供什麼資訊才能獲得協助呢?
    BOT馬上為您找找看相關內容 📋 若您收到的產品有異常,請您透過我們的客服表單提交申請,並提供您的訂單資訊以及產品問題的照片。我們的團隊會在服務時間內盡快協助您。 客服表單連結: https://support.rhinoshield.io/hc/en-us/requests/new 如有其他疑問,也歡迎隨時詢問!

    情境路由

    0.0%
    Precision
    0.0%
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • 3829 · 產品異常
    意料之外 (1)
    • ! 知識與產品查詢
    TP 0
    FP 1
    FN 1

    回答品質

    86.7%
    相關性
    100.0%
    完整性
    70.0%
    正確性
    90.0%
    加權拆解 · 三層 coverage
    I 核心
    50.0% · w 60%
    • 選擇「售後詢問 > 產品支援」
    • 提供完整的訂單或產品資訊
    • 提供產品故障的照片或視頻
    II 重要
    III 補充
    20.0% · w 10%
    • 我們將盡快協助您
    • 謝謝您的配合
    AI 回覆
    馬上為您找找看相關內容 📋 若您收到的產品有異常,請您透過我們的客服表單提交申請,並提供您的訂單資訊以及產品問題的照片。我們的團隊會在服務時間內盡快協助您。 客服表單連結: https://support.rhinoshield.io/hc/en-us/requests/new 如有其他疑問,也歡迎隨時詢問!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 請您填寫客戶服務表單
    • 選擇「售後詢問 > 產品支援」
    • 提供完整的訂單或產品資訊
    • 提供產品故障的照片或視頻
    III 補充說明 w 10%
    • 我們將盡快協助您
    • 謝謝您的配合
    Judge 推理
    回覆中提到填寫客服表單,但未提及選擇「售後詢問 > 產品支援」的步驟,且缺少提供完整訂單或產品資訊及產品故障照片或視頻的要求。雖然有提供客服表單連結,但未完全符合規範。
  • 案例 39C56C00

    有沒有針對設計自己產品的建議或功能介紹?

    已完成
    第 1 次嘗試 · 已完成 22846ms
    腳本進度 · 知識與產品查詢 ✗ 卡關
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    ✗ 已收集 0 / 2 項
    未收集:query、keywords_or_codes
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    預期 / 已收集 (0/2)
    欄位 預期值(generate) 已收集(run)
    query 我想了解最新的智能手錶功能 — (對話未走到)
    keywords_or_codes [] — (對話未走到)
    STEP
    03

    API 工具

    ○ 等待資訊收集完成
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    完整測試 4 個步驟
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USER有沒有針對設計自己產品的建議或功能介紹?
    BOT稍等一下我來幫您查詢 💡 您好,我是智能客服 Rhino,很高興為您介紹 RHINOSHIELD 的「設計自己產品」相關建議與功能: 1. 客製化流程與建議 - 請先前往我們的客製化設計頁面:https://my.rhinoshield.io/design?artwork_type=Collage&device - 選擇您的裝置型號、產品線與規格後,即可開始設計。 - 設計時,請參考我們的設計指南,確保最佳印刷效果:https://support.rhinoshield.io/hc/en-us/articles/1500000090721-Design-Your-Own-DYO-User-Guide-on-the-Resolution-and-Format-of-Design - 上傳圖片時,請注意僅支援 JPG/JPEG/PNG 格式,檔案大小不超過 10MB,解析度建議在 DPI 72~150 之間。 - 圖片中如有線條,建議寬度大於 2pt(約 0.7mm),避免細節遺失。 - 請盡量使用原始圖片檔案,不建議使用社群平台壓縮過的圖片,以免影響印刷品質。 - 若設計包含 MagSafe 環,建議圖像比環大 2mm,以避免印刷時位移。 2. 注意事項 - 所有自訂商品皆無法退換貨,下單前請再次確認裝置型號及設計內容。 - 印刷顏色可能因材質及工藝略有色差,此屬正常現象。 3. 條款與聲明 請務必詳閱我們的服務條款與免責聲明:https://support.rhinoshield.io/hc/en-us/articles/43710184760729-Design-Your-Own-DYO-Terms-of-Service-and-Disclaimer 4. 設計靈感參考 您也可以在 RHINOSHIELD 設計館瀏覽其他創作者的作品,尋找靈感:https://rhinoshield.io/search/designs 如需更詳細的操作說明或有其他客製化需求,也歡迎隨時告訴我!

    情境路由

    100.0%
    Precision
    100.0%
    Recall
    100.0%
    F1
    100.0%
    預期 (1)
    • 1963 · 知識與產品查詢
    TP 1
    FP 0
    FN 0

    工具使用

    100.0%
    Precision
    100.0%
    Recall
    100.0%
    F1
    100.0%
    預期 (2)
    • search_knowledges
    • search_products
    TP 2
    FP 0
    FN 0

    回答品質

    83.3%
    相關性
    100.0%
    完整性
    70.0%
    正確性
    80.0%
    加權拆解 · 三層 coverage
    I 核心
    87.5% · w 60%
    • 具備8百萬像素或更高的照片(適用於全尺寸規格)
    • 避免使用過多的濾鏡或壓縮,建議使用原始圖片檔
    II 重要
    100.0% · w 30%
    III 補充
    AI 回覆
    稍等一下我來幫您查詢 💡 您好,我是智能客服 Rhino,很高興為您介紹 RHINOSHIELD 的「設計自己產品」相關建議與功能: 1. 客製化流程與建議 - 請先前往我們的客製化設計頁面:https://my.rhinoshield.io/design?artwork_type=Collage&device - 選擇您的裝置型號、產品線與規格後,即可開始設計。 - 設計時,請參考我們的設計指南,確保最佳印刷效果:https://support.rhinoshield.io/hc/en-us/articles/1500000090721-Design-Your-Own-DYO-User-Guide-on-the-Resolution-and-Format-of-Design - 上傳圖片時,請注意僅支援 JPG/JPEG/PNG 格式,檔案大小不超過 10MB,解析度建議在 DPI 72~150 之間。 - 圖片中如有線條,建議寬度大於 2pt(約 0.7mm),避免細節遺失。 - 請盡量使用原始圖片檔案,不建議使用社群平台壓縮過的圖片,以免影響印刷品質。 - 若設計包含 MagSafe 環,建議圖像比環大 2mm,以避免印刷時位移。 2. 注意事項 - 所有自訂商品皆無法退換貨,下單前請再次確認裝置型號及設計內容。 - 印刷顏色可能因材質及工藝略有色差,此屬正常現象。 3. 條款與聲明 請務必詳閱我們的服務條款與免責聲明:https://support.rhinoshield.io/hc/en-us/articles/43710184760729-Design-Your-Own-DYO-Terms-of-Service-and-Disclaimer 4. 設計靈感參考 您也可以在 RHINOSHIELD 設計館瀏覽其他創作者的作品,尋找靈感:https://rhinoshield.io/search/designs 如需更詳細的操作說明或有其他客製化需求,也歡迎隨時告訴我!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 我們提供設計自訂產品的自由
    • 不會對您上傳的圖片進行潤飾或調整
    • 只支援Jpg/Jpeg/Png檔案
    • 檔案大小不得超過10MB
    • 解析度在72至150 DPI之間
    • 如果圖片內含有線條,確保其寬度大於2pt(約0.7mm)
    • 具備8百萬像素或更高的照片(適用於全尺寸規格)
    • 避免使用過多的濾鏡或壓縮,建議使用原始圖片檔
    II 重要限制 w 30%
    • 印刷出來的顏色可能會有所偏差,這不會被視為缺陷
    Judge 推理
    這個回答針對用戶的問題提供了相關的建議和功能介紹,並且涵蓋了大部分的關鍵點。然而,缺少了兩個重要的核心要點,導致完整性得分不高。
  • 案例 605027D4

    這個產品重多少?

    已完成
    第 1 次嘗試 · 已完成 6472ms
    腳本進度 · 詢問各型號重量尺寸 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 詢問各型號重量尺寸
    腳本規則
    - 當客人問到產品的以下資訊「
    1. 尺寸與體積相關
    -尺寸、大小、size、體積
    -長度、寬度、高度、深度、厚度
    -多大、多小、多長、多寬、多高
    -規格、dimensions、measurements
    
    2. 重量相關
    -重量、重、多重、幾公斤、幾克
    -淨重、毛重、weight
    -輕重、份量
    
    3. 容量與數量相關
    -容量、capacity、容積、幾公升、幾毫升
    -數量、份量、內容量
    -可容納、可裝、可放
    
    」
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - 當客人問到產品的尺寸、重量、容量相關,請回覆以下訊息:
    「感謝您的詢問。請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot 」
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 04
    USER這個產品重多少?
    BOT感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot

    情境路由

    100.0%
    Precision
    100.0%
    Recall
    100.0%
    F1
    100.0%
    預期 (1)
    • 7285 · 詢問各型號重量尺寸
    TP 1
    FP 0
    FN 0

    回答品質

    60.0%
    相關性
    50.0%
    完整性
    30.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    50.0% · w 60%
    • 產品的重量
    II 重要
    III 補充
    100.0% · w 10%
    AI 回覆
    感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊
    • 我們將於服務時間內盡快回覆
    III 補充說明 w 10%
    • 感謝您的詢問
    Judge 推理
    回覆未直接回答產品的重量,僅提供了填寫客服表單的指示,未符合客戶詢問的需求,因此在相關性和完整性上得分較低。
  • 案例 CCE6B651

    這款產品的容量是多少?

    已完成
    第 1 次嘗試 · 已完成 10070ms
    腳本進度 · 詢問各型號重量尺寸 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 詢問各型號重量尺寸
    腳本規則
    - 當客人問到產品的以下資訊「
    1. 尺寸與體積相關
    -尺寸、大小、size、體積
    -長度、寬度、高度、深度、厚度
    -多大、多小、多長、多寬、多高
    -規格、dimensions、measurements
    
    2. 重量相關
    -重量、重、多重、幾公斤、幾克
    -淨重、毛重、weight
    -輕重、份量
    
    3. 容量與數量相關
    -容量、capacity、容積、幾公升、幾毫升
    -數量、份量、內容量
    -可容納、可裝、可放
    
    」
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - 當客人問到產品的尺寸、重量、容量相關,請回覆以下訊息:
    「感謝您的詢問。請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot 」
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 04
    USER這款產品的容量是多少?
    BOT感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot

    情境路由

    100.0%
    Precision
    100.0%
    Recall
    100.0%
    F1
    100.0%
    預期 (1)
    • 7285 · 詢問各型號重量尺寸
    TP 1
    FP 0
    FN 0

    回答品質

    100.0%
    相關性
    100.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    III 補充
    100.0% · w 10%
    AI 回覆
    感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊
    • 我們將於服務時間內盡快回覆
    III 補充說明 w 10%
    • 感謝您的詢問
    Judge 推理
    這個回覆完全符合規範,並且正確地回應了用戶的詢問,包含了所有必要的資訊。
  • 案例 EBF99DCA

    你們的產品尺寸和規格是什麼?

    已完成
    第 1 次嘗試 · 已完成 10110ms
    腳本進度 · 知識與產品查詢 ✗ 卡關
    STEP
    01

    觸發條件

    ● 已觸發 知識與產品查詢
    腳本規則
    - #核心觸發原則
    -通用疑問詞與符號 (ABSOLUTE PRIORITY):「?、嗎、呢、嗎?、如何、怎麼、什麼、哪裡、哪個、多少、為什麼」
    -只要出現上述任何關鍵字,或輸入內容少於 10 字,強制觸發知識庫與產品搜尋。
    
    #觸發關鍵字(任何語系有符合以下意圖)
    1.購買意圖與需求:商品、產品、物品、購買、買、訂購、我想要、我需要、我在找
    
    2.推薦與建議:推薦、介紹、建議、功能、特色、優點、特性、詳細說明、詳細介紹、補充說明
    
    3.規格與比較:規格、尺寸、容量、技術規格、比較、對比、差異、區別、哪個好、哪個適合、優缺點、好壞、性價比、CP值、划算
    
    4.組合與優惠:搭配、組合、配對、一起用、同時使用、套餐、套組、加購、加買、相關商品、升級、活動、報名、參加、優惠、折扣、促銷、抽獎、贈品、獎品
    
    5.適用場景:用途、目的、需求、場合、情境、環境、適用範圍、適用對象、預算、限制條件、
    
    6.操作與教學:怎麼用、如何使用、使用方法、使用方式、操作方式、使用步驟、安裝、設定、配置、第一次使用、新手使用、初次使用、使用技巧、使用訣竅、使用須知、注意事項
    
    7.維護與保養:保養、維護、清潔、保存、存放、收藏、壽命、使用期限、保固期、更換、替換、更新
    
    8.配送與金流:配送、運費、到貨時間、地址、付款方式、分期、發票、收據、證明
    
    9.售後服務:退換貨、退款、退費、保固、維修、售後、聯絡方式、電話、信箱、登入、註冊、密碼、無法、不能、不行、錯誤、異常、問題、當機、卡住
    
    10.會員權益:會員、積分、紅利、政策、規定、條款、隱私、個資、資料、安全、保障、保護、責任、義務、權利
    
    11.公司與社群資訊:粉絲團、粉專、FB、Facebook、臉書、Instagram、IG、社群、官網、網站、LINE、Youtube、YT、影片、頻道、公司、品牌、關於我們、服務時間、營業時間、上班時間
    
    12.Product Spec and brand:iphone/SolidX/cases/SolidSuit/AirX/phonecase/recommend/design/disney/cartoon/naruto/Dragon Ball/Superman/marvel/dc
    
    統一處理知識庫查詢與產品資訊查詢,使用並發搜尋提供完整資訊
    STEP
    02

    資訊收集

    ✗ 已收集 0 / 2 項
    未收集:query、keywords_or_codes
    腳本規則
    ### knowledge_and_product_search_parameters — 知識庫與產品並發搜尋參數
    - query [text] (必填): User's current main question or topic to inquire about, or product they want to query or get recommendations for (3-20 word phrase, focusing on latest intent, excluding resolved or irrelevant content)
    - keywords_or_codes [text] (必填): All codes, labels, product keywords, model numbers appearing in user's message (e.g., C90012, T1234), empty array if none
    預期 / 已收集 (0/2)
    欄位 預期值(generate) 已收集(run)
    query 我想了解最新的智能手機型號和功能 — (對話未走到)
    keywords_or_codes [] — (對話未走到)
    STEP
    03

    API 工具

    ○ 等待資訊收集完成
    腳本規則
    1. search_knowledges — 從知識庫中搜尋與使用者查詢相關的知識
    2. search_products — 根據使用者需求從產品庫中搜尋並推薦相關產品
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - ##Priciples
    -All answers MUST be based on content output from api tool, NEVER fabricate
    -NEVER fabricate ANY information about: Product/service details • Policies • Promotional offers • Pre-sales/after-sales services • Real-time data (availability, pricing, inventory)•website Interface Location
    -Strictly prohibit referencing, rewriting, or mixing content outside of <tool: search_knowledge_and_products> outputs
    -Each URL should be on a separate line and should not be combined with Chinese characters.
    
    ## User Intent Analysis (CRITICAL - MUST FOLLOW):
    
    STEP 1 — Classify the user's intent from the latest message before deciding whether to mention products:
    
    • INFORMATIONAL (how / why / what / when / where about concepts, processes,
      shipment, or product issues)
      → Focus ONLY on knowledge answers. DO NOT proactively recommend products.
      → Skip STEP 2.
    
    • SPECIFIC SERIES / MODEL MENTIONED (user names a series or model, e.g.
      "iPhone Air", "S23")
      → BEFORE recommending, carefully review tool outputs for that specific
        series' availability/support.
      → If the series or its models are NOT clearly mentioned or supported in
        the tool outputs, DO NOT recommend any products of that series.
      → If supported, proceed to STEP 2.
    
    • EXPLICIT RECOMMENDATION / COMPARISON REQUEST (user asks for suggestions,
      recommendations, or comparisons)
      → Proceed to STEP 2.
    
    • PURCHASE INTENT (want buy)
      → Proceed to STEP 2.
    
    STEP 2 — Only when STEP 1 routes here: identify ALL explicit user
    requirements from the latest message and treat them as HARD CONSTRAINTS.
    Every recommended product must satisfy every constraint; drop candidates
    that violate any of them.
    
    • Device model / series: e.g. iPhone Air, iPhone 17, S23
    • Product type or form factor: e.g. bumper, clear case, lens protector,
      screen protector, MagSafe case
    • Product feature / attribute: e.g. MagSafe, waterproof, thin, transparent,
      black, recyclable
    • Color / size / material, if mentioned
    
    ## CRITICAL PRODUCT VERIFICATION STEPS - MUST FOLLOW:
    ⚠️ MANDATORY: When user asks about a specific device series (e.g., S23, iPhone 15), you MUST:
    1. FIRST identify the exact series mentioned by user
    2. THEN check each product's compatibility list in tool outputs
    3. CRITICAL: model names are SPECIFIC - 'S20+' ≠ 'S23', 'S24' ≠ 'S23'
    4. ONLY recommend products that EXPLICITLY list the user's exact series
    5. If a product's compatibility list does NOT include the user's series,  (e.g., 'S20, S20+, S21' but NOT 'S23') → DO NOT recommend it
    6. If compatibility list is empty or missing → DO NOT recommend
    7. Example verification:
       - User asks: 'S23 手機殼'
       - Product shows: 'S25, S24 FE' → ❌ DO NOT recommend (no S23)
       - Product shows: 'S23 Ultra, S23+, S23' → ✅ CAN recommend (has S23)
    
    ## Conversation History Check (避免重複推薦) - CRITICAL:
    ⚠️  MANDATORY: BEFORE recommending any products, review conversation history for already mentioned products
    • If products were previously recommended but user showed NO strong interest (沒有詢問細節、比較、或表達購買意願), DO NOT repeat those products
    • If user actively asked follow-up questions about previously mentioned products, it indicates strong interest - you MAY mention them again
    • ONLY repeat previous products if user explicitly asks about them again or shows clear purchase intent for specific items
    • When user asks for general recommendations and tool outputs include previously mentioned products:
      - If the previously mentioned product is highly relevant to current query, you MAY mention it again with NEW information or different perspective
      - Use phrases like '剛才提到的商品A,根據您現在的需求...' to acknowledge previous mention
      - Always try to include additional products from tool outputs if available
      - Focus on providing new value (different use cases, updated info, comparisons) rather than repeating identical information
    • CRITICAL: All product recommendations must still come ONLY from <tool: search_knowledge_and_products> outputs - NEVER create or assume products not in tool results
    • 🚫 CRITICAL: If no new products available in tool outputs (when user asks for 'other options', 'alternatives', '別的型號', '其他選擇'), explain the limitation clearly using phrases like '目前BenQ只有這三款螢幕支架可選擇' rather than repeating previous recommendations
    • Exception: If user explicitly requests comparison with previously mentioned products, include them in comparison
    ## Knowledge Response Rules:
    If knowledge results found in tool messages: Provide accurate answers strictly based on knowledge outputs
    📌 MANDATORY URL FORMAT: Always use plain text format '[Topic]: [URL]' - NEVER use markdown links like [text](url), NEVER use brackets or parentheses for links
    Include ALL images with exact format: \n\n![](image_url)\n\n (Use ONLY image links from tool messages)
    ## Product Response Rules (ONLY when user shows product interest):
    IMPORTANT: Only mention products if user explicitly asks for products OR shows clear purchase intent
    DO NOT say '不過我可以為您推薦一些產品' or similar phrases when user is just asking informational questions
    If user wants product recommendations: Provide details: name, price, specifications, reason of recommendation
    When comparing products (only if user asks), focus on valuable aspects for consumers:
    • Specifications
    • Suitable use scenarios
    • Price
    ## Response Integration Rules:
    If both knowledge and products found, prioritize based on user's actual question:
    • Information-seeking questions → Answer with knowledge ONLY
    • Product-seeking questions → Include both knowledge context and product recommendations
    • Mixed intent → Start with knowledge answer, then ASK if user wants product recommendations (don't assume)
    NEVER force product recommendations into informational answers
    ## No Results Handling:
    If NOT found in tool messages, use this EXACT format: Begin with 'Based on general understanding,' → provide general answer → End with 'For accuracy, please confirm with a human customer service agent.'
    If unable to answer at all, clearly explain and suggest transferring to human customer service
    ## Language Style Rules:
    MUST NOT mention or imply: 'knowledge base', 'database', 'system records', 'internal data', 'documentation', or similar sources
    NEVER use robotic phrases: 「根據我們的資料」,「依照知識庫」,「知識庫中沒有找到資訊」,「系統記錄沒有相關資料」,'database shows', 'knowledge base entry'
    Always rephrase naturally, making responses sound like a helpful human assistant
    完整測試 4 個步驟
    對話流程 · 1 turn
    Turn 1 STEP 04
    USER你們的產品尺寸和規格是什麼?
    BOT感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot

    情境路由

    66.7%
    Precision
    50.0%
    Recall
    100.0%
    F1
    66.7%
    預期 (1)
    • 1963 · 知識與產品查詢
    意料之外 (1)
    • ! 詢問各型號重量尺寸
    TP 1
    FP 1
    FN 0

    工具使用

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (2)
    • search_knowledges
    • search_products
    TP 0
    FP 0
    FN 2

    回答品質

    40.0%
    相關性
    70.0%
    完整性
    50.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    50.0% · w 60%
    • 產品規格和尺寸會因產品類型而異
    II 重要
    III 補充
    • 您可以告訴我您想查詢的具體產品
    AI 回覆
    感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 產品規格和尺寸會因產品類型而異
    III 補充說明 w 10%
    • 您可以告訴我您想查詢的具體產品
    Judge 推理
    回覆未能直接回答用戶的問題,且未提供正確的產品規格和尺寸資訊,導致完整性和正確性得分低。
    錯誤陳述 (1)
    • 未依據知識庫內容提供正確的產品規格和尺寸資訊
  • 案例 D7745912

    各型號的重量和尺寸要怎麼查啊?

    已完成
    第 1 次嘗試 · 已完成 11733ms
    腳本進度 · 詢問各型號重量尺寸 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 詢問各型號重量尺寸
    腳本規則
    - 當客人問到產品的以下資訊「
    1. 尺寸與體積相關
    -尺寸、大小、size、體積
    -長度、寬度、高度、深度、厚度
    -多大、多小、多長、多寬、多高
    -規格、dimensions、measurements
    
    2. 重量相關
    -重量、重、多重、幾公斤、幾克
    -淨重、毛重、weight
    -輕重、份量
    
    3. 容量與數量相關
    -容量、capacity、容積、幾公升、幾毫升
    -數量、份量、內容量
    -可容納、可裝、可放
    
    」
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - 當客人問到產品的尺寸、重量、容量相關,請回覆以下訊息:
    「感謝您的詢問。請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot 」
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 04
    USER各型號的重量和尺寸要怎麼查啊?
    BOT感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot

    情境路由

    66.7%
    Precision
    50.0%
    Recall
    100.0%
    F1
    66.7%
    預期 (1)
    • 7285 · 詢問各型號重量尺寸
    意料之外 (1)
    • ! 知識與產品查詢
    TP 1
    FP 1
    FN 0

    回答品質

    100.0%
    相關性
    100.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    III 補充
    100.0% · w 10%
    AI 回覆
    感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊
    • 我們將於服務時間內盡快回覆
    III 補充說明 w 10%
    • 感謝您的詢問
    Judge 推理
    這個回覆完全符合用戶的詢問,並且包含了所有必要的資訊,沒有遺漏任何要點。回覆的內容也符合規範,正確性高。
項目 III.

對話素養(混合問答)

mixed_qa 8 cases

維度總表

各維度品質分 · 覆蓋率
找對資料 召回
retrieval
66.7%
[33.3% – 100.0%] · n=6
F1 22.2% · 相關率 30.0% · 精確 46.7%
6 / 8 適用 · 1 提示
不亂編造 平均
faithfulness
94.4%
[83.3% – 100.0%] · n=6
8 / 8 適用
答得到位 平均
answer_quality
76.3%
[54.2% – 97.1%] · n=8
8 / 8 適用
  • 案例 1756F1A2

    Taku Bannai 主要創作是什麼類型的作品?

    已完成
    第 1 次嘗試 · 已完成 16078ms
    腳本進度 · early_return ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 early_return
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USERTaku Bannai 主要創作是什麼類型的作品?
    BOT正在為您搜尋最新資料 ⏳ 根據目前提供的資訊,沒有找到關於 Taku Bannai 主要創作類型的相關說明。如果您想了解更多關於設計師合作系列,可以參考以下連結: Collaborating Designers Page: https://my.rhinoshield.io/artists All Customized Designs Gallery: https://my.rhinoshield.io/gallery 如果您有特定想查詢的設計師或合作內容,也歡迎告訴我,我可以協助您進一步查詢!

    產品檢索

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • prod_1014194
    TP 0
    FP 0
    FN 1

    回答品質

    26.7%
    相關性
    50.0%
    完整性
    30.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    0.0% · w 60%
    • Taku Bannai 的作品涵蓋廣告、書籍、雜誌和唱片封面藝術
    II 重要
    III 補充
    AI 回覆
    正在為您搜尋最新資料 ⏳ 根據目前提供的資訊,沒有找到關於 Taku Bannai 主要創作類型的相關說明。如果您想了解更多關於設計師合作系列,可以參考以下連結: Collaborating Designers Page: https://my.rhinoshield.io/artists All Customized Designs Gallery: https://my.rhinoshield.io/gallery 如果您有特定想查詢的設計師或合作內容,也歡迎告訴我,我可以協助您進一步查詢!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • Taku Bannai 的作品涵蓋廣告、書籍、雜誌和唱片封面藝術
    Judge 推理
    AI的回覆未能直接回答使用者的問題,且缺乏關於Taku Bannai作品類型的具體資訊,導致相關性和完整性得分偏低。
  • 案例 F9776711

    這個 get_file_resource 是什麼工具?

    已完成
    第 1 次嘗試 · 已完成 13481ms
    腳本進度 · early_return ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 early_return
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    STEP
    03

    API 工具

    ✗ 已呼叫 0 / 1 個工具
    未呼叫:get_file_resource
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    測試 3 步 · 此案例不測 1 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER這個 get_file_resource 是什麼工具?
    BOT正在為您搜尋最新資料 ⏳ 目前沒有找到與「get_file_resource」工具相關的具體說明。如果您需要更詳細的資訊或有其他問題,建議您聯繫專人客服協助。 請您完整填寫以下客服表單,我們的客服團隊會根據您提供的資訊快速於服務時間內協助您: https://url.rhinoshield.io/io-chatbot 感謝您的配合!

    回答品質

    26.7%
    相關性
    50.0%
    完整性
    30.0%
    正確性
    0.0%
    加權拆解 · 三層 coverage
    I 核心
    0.0% · w 60%
    • get_file_resource 是一個用於檢索公司特定檔案資源的工具
    • 可以檢索分支列表、尺寸表、價格表和政策等
    II 重要
    III 補充
    AI 回覆
    正在為您搜尋最新資料 ⏳ 目前沒有找到與「get_file_resource」工具相關的具體說明。如果您需要更詳細的資訊或有其他問題,建議您聯繫專人客服協助。 請您完整填寫以下客服表單,我們的客服團隊會根據您提供的資訊快速於服務時間內協助您: https://url.rhinoshield.io/io-chatbot 感謝您的配合!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • get_file_resource 是一個用於檢索公司特定檔案資源的工具
    • 可以檢索分支列表、尺寸表、價格表和政策等
    Judge 推理
    回覆未能提供有關 get_file_resource 的具體資訊,且錯誤地表示沒有找到相關說明,導致回答不正確。
    錯誤陳述 (1)
    • 目前沒有找到與「get_file_resource」工具相關的具體說明
  • 案例 1B98D452

    請問客服表單的網址是什麼呢?

    已完成
    第 1 次嘗試 · 已完成 9396ms
    腳本進度 · 產品異常 ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 產品異常
    腳本規則
    - 當消費者提到「產品+異常原因」,例如「手機殼圖案剝落、產品刮傷、按鈕脫落、產品斷裂、殼變形、保護貼浮邊或是觸控不良」等等
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - Reply:
    
    We apologize for any inconvenience you may have encountered while using our product. We will assist you as soon as possible. 
    
    Please fill out our customer service form, select "After-Sales Inquiry > Product Support," and provide complete order/product information, as well as photos or videos of the product malfunction so that we can provide assistance quickly! Thank you for your cooperation.
    
    Customer Service Form: https://url.rhinoshield.io/io-chatbot
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER請問客服表單的網址是什麼呢?
    BOT讓我幫您查詢一下相關資訊 🔍 您好,這裡是智能客服 Rhino,很高興為您服務! 您可以透過以下網址填寫客服表單,我們的團隊會根據您提供的資訊於服務時間內協助您: https://url.rhinoshield.io/io-chatbot 如有其他問題也歡迎隨時詢問!

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI的回覆中提供的客服表單網址是正確的,並且有引用來源,因此沒有虛構的內容。然而,回覆未遵循規則中要求的道歉和協助內容,因此違反了規則。

    回答品質

    93.3%
    相關性
    100.0%
    完整性
    80.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    III 補充
    AI 回覆
    讓我幫您查詢一下相關資訊 🔍 您好,這裡是智能客服 Rhino,很高興為您服務! 您可以透過以下網址填寫客服表單,我們的團隊會根據您提供的資訊於服務時間內協助您: https://url.rhinoshield.io/io-chatbot 如有其他問題也歡迎隨時詢問!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 客服表單的網址是 https://url.rhinoshield.io/io-chatbot
    Judge 推理
    回覆中提供了客服表單的網址,符合用戶的查詢需求,但未包含規範中要求的道歉及協助說明,因此在完整性上有所缺失。
  • 案例 8A5A43E0

    這款 iPad 保護殼支持 Apple Pencil (第二代) 的磁性附著嗎?

    已完成
    第 1 次嘗試 · 已完成 22769ms
    腳本進度 · early_return ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 early_return
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USER這款 iPad 保護殼支持 Apple Pencil (第二代) 的磁性附著嗎?
    BOT讓我幫您查詢一下相關資訊 🔍 根據目前資訊,RHINOSHIELD 的 iPad 保護殼確實支援 Apple Pencil(第二代)的磁性附著與無線充電功能。您可以安心將 Apple Pencil(第二代)吸附在 iPad 側邊進行充電與配對。 如果您需要查看適用型號或購買相關產品,歡迎參考下方連結: iPad 保護殼 https://rhinoshield.io/products/ipad-case/buy 如需其他型號或有更多需求,也歡迎告訴我!

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_369099
    意料之外 (4)
    • ! know_369104
    • ! know_369103
    • ! know_369098
    • ! know_369095
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI 的回覆中提到的 RHINOSHIELD iPad 保護殼支援 Apple Pencil(第二代)的磁性附著與無線充電功能,這些資訊都能在來源中找到,因此沒有虛構的聲明。

    回答品質

    100.0%
    相關性
    100.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    III 補充
    AI 回覆
    讓我幫您查詢一下相關資訊 🔍 根據目前資訊,RHINOSHIELD 的 iPad 保護殼確實支援 Apple Pencil(第二代)的磁性附著與無線充電功能。您可以安心將 Apple Pencil(第二代)吸附在 iPad 側邊進行充電與配對。 如果您需要查看適用型號或購買相關產品,歡迎參考下方連結: iPad 保護殼 https://rhinoshield.io/products/ipad-case/buy 如需其他型號或有更多需求,也歡迎告訴我!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 這款 iPad 保護殼支持 Apple Pencil (第二代) 的磁性附著
    • 能進行無線配對和充電
    Judge 推理
    這個回答完全符合用戶的問題,並且涵蓋了所有關鍵點,包括支持 Apple Pencil(第二代)的磁性附著及無線充電功能,且沒有任何錯誤的陳述。
  • 案例 811016A2

    RHINOSHIELD Lens Base Protector 可以跟其他品牌的手機殼一起用嗎?

    已完成
    第 1 次嘗試 · 已完成 10768ms
    腳本進度 · early_return ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 early_return
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USERRHINOSHIELD Lens Base Protector 可以跟其他品牌的手機殼一起用嗎?
    BOT馬上為您找找看相關內容 📋 RHINOSHIELD Lens Base Protector 只覆蓋鏡頭底座,與 RHINOSHIELD 自家手機殼相容。由於市面上其他品牌手機殼在尺寸、設計和結構上各有不同,是否能與 RHINOSHIELD Lens Base Protector 搭配使用,需依實際安裝結果為準,無法保證一定相容。 建議您安裝前可先確認手機殼鏡頭區域的開孔設計,或實際測試安裝效果。如有更多疑問,也歡迎隨時詢問!

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_369189
    意料之外 (4)
    • ! know_369188
    • ! know_369008
    • ! know_369190
    • ! know_369009
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI 的回覆完全基於來源材料,並且所有的事實陳述都有相應的支持,因此沒有任何虛構的聲明。回覆中的每個事實句子都可以引用來源,符合來源的內容。

    回答品質

    100.0%
    相關性
    100.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    100.0% · w 30%
    III 補充
    AI 回覆
    馬上為您找找看相關內容 📋 RHINOSHIELD Lens Base Protector 只覆蓋鏡頭底座,與 RHINOSHIELD 自家手機殼相容。由於市面上其他品牌手機殼在尺寸、設計和結構上各有不同,是否能與 RHINOSHIELD Lens Base Protector 搭配使用,需依實際安裝結果為準,無法保證一定相容。 建議您安裝前可先確認手機殼鏡頭區域的開孔設計,或實際測試安裝效果。如有更多疑問,也歡迎隨時詢問!
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • RHINOSHIELD Lens Base Protector 只適用於 RHINOSHIELD 的手機殼
    II 重要限制 w 30%
    • 與其他品牌的手機殼相容性可能會因大小、設計和結構而異
    • 需根據實際安裝結果來確定
    Judge 推理
    這個回答完全針對用戶的問題,並且涵蓋了所有關鍵點,與事實一致。回覆中提到的相容性問題和安裝建議也符合預期,沒有遺漏任何重要資訊。
  • 案例 4617C36C

    GRIP O 是不是用回收材料做的?

    已完成
    第 1 次嘗試 · 已完成 22716ms
    腳本進度 · early_return ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 early_return
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges → search_products
    USERGRIP O 是不是用回收材料做的?
    BOT馬上為您找找看相關內容 📋 RHINOSHIELD GRIP O 是由回收的 PET 以及 RHINOSHIELD 透明殼的回收材料製成,致力於減少對環境的影響,支持永續發展。 您可以參考更多資訊: GRIP O 商品頁面 https://rhinoshield.io/products/grip-o/buy

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_369021
    意料之外 (4)
    • ! know_369020
    • ! know_369016
    • ! know_369017
    • ! know_369045
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI 的回覆中提到 RHINOSHIELD GRIP O 是由回收材料製成,這一點在來源中有明確支持,因此沒有虛構的聲明。所有的事實陳述都可以引用來源,符合來源的內容。

    回答品質

    100.0%
    相關性
    100.0%
    完整性
    100.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    100.0% · w 60%
    II 重要
    III 補充
    AI 回覆
    馬上為您找找看相關內容 📋 RHINOSHIELD GRIP O 是由回收的 PET 以及 RHINOSHIELD 透明殼的回收材料製成,致力於減少對環境的影響,支持永續發展。 您可以參考更多資訊: GRIP O 商品頁面 https://rhinoshield.io/products/grip-o/buy
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • GRIP O 是用回收的 PET 以及來自 RHINOSHIELD Clear 產品的回收材料製作的
    • 目的是減少對環境的影響
    Judge 推理
    這個回答完全符合用戶的問題,提供了GRIP O的材料來源及其環保目的,且沒有錯誤的陳述。
  • 案例 17BCF877

    官方網站有 Apple Pay 嗎

    已完成
    第 1 次嘗試 · 已完成 11927ms
    腳本進度 · early_return ✗ 卡關
    STEP
    01

    觸發條件

    ✗ 未進入 early_return
    STEP
    02

    資訊收集

    — 此案例不測
    此案例 info_held 為空 — bot 不需問取資訊
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 03 · STEP 04 → search_knowledges
    USER官方網站有 Apple Pay 嗎
    BOT讓我幫您查詢一下相關資訊 🔍 RHINOSHIELD 官方網站支援 Apple Pay 付款。請使用 Safari 瀏覽器進入官網,即可看到 Apple Pay 的選項。如果您在結帳時沒有看到 Apple Pay,建議您截圖並聯絡客服,我們會協助您確認。 更多協助請參考: https://support.rhinoshield.io/hc/en-us/requests/new

    知識檢索

    100.0%
    Precision
    20.0%
    Recall
    100.0%
    F1
    33.3%
    預期 (1)
    • know_369214
    意料之外 (4)
    • ! know_368956
    • ! know_369104
    • ! know_369170
    • ! know_369108
    TP 1
    FP 4
    FN 0

    忠實度

    有依據
    幻覺比率
    0.0%
    越低越好
    引用依據
    100.0%
    越高越好
    Judge 推理
    AI 的回覆完全符合來源資料,所有的事實陳述都有來源支持,因此沒有任何虛構的聲明。

    回答品質

    96.7%
    相關性
    100.0%
    完整性
    90.0%
    正確性
    100.0%
    加權拆解 · 三層 coverage
    I 核心
    90.0% · w 60%
    • 您將會看到 Apple Pay 選項
    II 重要
    III 補充
    AI 回覆
    讓我幫您查詢一下相關資訊 🔍 RHINOSHIELD 官方網站支援 Apple Pay 付款。請使用 Safari 瀏覽器進入官網,即可看到 Apple Pay 的選項。如果您在結帳時沒有看到 Apple Pay,建議您截圖並聯絡客服,我們會協助您確認。 更多協助請參考: https://support.rhinoshield.io/hc/en-us/requests/new
    預期答案 · 加權拆解
    I 核心必答 w 60%
    • 如果想使用 Apple Pay,請使用 Safari 瀏覽器訪問官方網站
    • 您將會看到 Apple Pay 選項
    Judge 推理
    回覆內容針對使用 Apple Pay 的問題提供了正確的資訊,並且詳細說明了使用 Safari 瀏覽器的必要性。雖然回覆中提到的內容大部分正確,但在核心必答部分未完全覆蓋所有要點,因此完整性得分略低。
  • 案例 6D500632

    請問各型號尺寸和重量可以查詢嗎?

    已完成
    第 1 次嘗試 · 已完成 10632ms
    腳本進度 · 詢問各型號重量尺寸 ✓ 已走完
    STEP
    01

    觸發條件

    ● 已觸發 詢問各型號重量尺寸
    腳本規則
    - 當客人問到產品的以下資訊「
    1. 尺寸與體積相關
    -尺寸、大小、size、體積
    -長度、寬度、高度、深度、厚度
    -多大、多小、多長、多寬、多高
    -規格、dimensions、measurements
    
    2. 重量相關
    -重量、重、多重、幾公斤、幾克
    -淨重、毛重、weight
    -輕重、份量
    
    3. 容量與數量相關
    -容量、capacity、容積、幾公升、幾毫升
    -數量、份量、內容量
    -可容納、可裝、可放
    
    」
    STEP
    02

    資訊收集

    — 依規則行為(由「回答品質」評分)
    此情境無結構化欄位需收集,但 spec rules 約束 bot 行為(驗證關卡、禁止外洩等)— 評分由 answer_quality + spec_rules 維度承擔
    STEP
    03

    API 工具

    — 此案例不測
    此案例 expected_tools 為空 — bot 不需呼叫工具
    STEP
    04

    回覆規則

    ● bot 已回覆(單問單答案例,未啟用多輪迴圈)
    腳本規則
    - 當客人問到產品的尺寸、重量、容量相關,請回覆以下訊息:
    「感謝您的詢問。請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot 」
    測試 2 步 · 此案例不測 2 步
    對話流程 · 1 turn
    Turn 1 STEP 04
    USER請問各型號尺寸和重量可以查詢嗎?
    BOT感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot

    知識檢索

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • know_369116
    TP 0
    FP 0
    FN 1

    產品檢索

    0.0%
    Precision
    Recall
    0.0%
    F1
    0.0%
    預期 (1)
    • prod_1014121
    TP 0
    FP 0
    FN 1
    PARTIAL
    忠實度——metric 尚未齊全 (缺:hallucination_rate, citation_grounding)

    回答品質

    66.7%
    相關性
    50.0%
    完整性
    50.0%
    正確性
    100.0%
    AI 回覆
    感謝您的詢問。 請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot
    預期答案
    感謝您的詢問。請填寫客服表單並提供您想詢問的產品線/型號/規格等資訊,我們將於服務時間內盡快回覆: https://url.rhinoshield.io/io-chatbot?
    Judge 推理
    回覆未能詢問客戶具體的產品型號或規格,未符合要求的問詢風格,導致相關性和完整性得分較低。