1 / 7
LLM evaluation

Assert output contains required facts

Medium70 pts~25 min
  • Fact checking
  • Output assertions
Practice app · Acme Support Assistant

A deterministic LLM-style support assistant with retrieval (RAG), JSON mode, safety policies and tool calls, exposed via UI and API.

BASE_URL
/api/practice
Console app
/lab/ai-testing-assert-output-contains-required-facts

Your starter code already declares BASE_URL — call the API relative to it.

Objective

Assert that each knowledge-base answer contains its required fact.

Your task

  1. 1Ask "How long does standard shipping take?" → expect “3–5 business days”.
  2. 2Ask "What warranty do your products have?" → expect “12-month”.
  3. 3Ask "Do you offer price matching?" → expect “14 days”.

Acceptance criteria

  • POST /ai/chat returns 200
  • At least 3 assertions pass

LLM evaluation · AI Testing · Output validation