Skip to main content
Answer tests pin the questions that matter with what the answer must say. They’re asked again whenever the knowledge or the set-up changes, so fixing one answer can’t quietly break another.
Answer tests: add a test (1), the last run (2), a test that fails now (3) and the answer it got (4)

Answer tests: add a test (1), the last run (2), a test that fails now (3) and the answer it got (4)

​
Add a test

1

Write the customer's question

The way a customer would ask it, for example “How much is a haircut?”.
2

Choose how it's checked

  • Same meaning: write the facts the answer must contain. The assistant’s own AI checks the reply says the same thing, in any wording or language. A different price, or “no” instead of “yes”, fails.
  • Exact phrases: one phrase per line that must appear in the reply word for word (capitals don’t matter). Free and exact: good for prices, links and phone numbers.
3

Pick the language (optional)

Leave it on automatic to get the reply in the question’s language, or choose one.
You can also pin a reply straight from the Playground: under the assistant’s answer, click Pin as a test.

​
When they run

  • By themselves, within about 10 minutes after the knowledge or any setting, rule or question flow changes.
  • When you click Run now (2).
Each test asks the assistant as a brand-new customer in the playground: nothing is sent to anyone. A Same meaning test uses one small AI request each time it runs; Exact phrases tests cost nothing. If a test that passed before fails now, the people who can change the assistant get an alert (An answer test that passed starts failing). Failing tests also show on the home page’s Needs you list. Open the test to see the answer the assistant gave (4) and why it didn’t match.

​
With draft and publish

With draft and publish on, tests check the draft. The Draft & publish page shows how they did on it. Publishing a draft that fails a test, or that the tests haven’t checked yet, asks you to confirm first.
Pin a test every time you fix an answer. Start with the questions customers ask most: prices, opening hours and how to book. Up to 50 tests per assistant.