Tool
AI Chatbot Quality Audit
Send us the page your current assistant lives on and the questions you care about. A person runs them against your live site and sends back a scorecard with the raw answers and the sources each one cited.
- Run by a personNot an automated score
- Public pages onlyNo credentials, no customer data
- No account neededNothing to sign up for
Inputs
What you send
Your website URL
The public site the assistant answers from.
The page where your chatbot appears
So we test the same surface a visitor sees, with the same widget placement and the same content around it.
Your current provider
Chatbase, SiteGPT, Botpress, Intercom or other. This changes what we look for, not what we claim about them.
Three to ten questions
The ones your team already knows get asked. Optional: we will draw candidates from your own content if you would rather not.
An email to send the scorecard to
That is the whole form. There is no account and nothing to install.
The scorecard
Eight rows, and what each one means
Each row is scored from real answers on your live site, not from a feature list. You get the answers themselves, so you can disagree with the score.
| Row | What it measures |
|---|---|
| Answer quality | Does the answer match what your page actually says, or is it plausible and wrong. |
| Source grounding | Which page the answer came from, and whether that page exists and contains the claim. |
| Citation or source match | Whether a cited page supports the sentence it is cited for. This is where most assistants fail quietly. |
| Hallucination risk | What happens on a question your content does not cover. Refusal is the correct behaviour and most tools do not do it. |
| Handoff | What a person receives when the assistant steps aside, and whether the visitor has to start over. |
| Lead capture | Whether a buying question is recognised as one, and what is asked for at that moment. |
| Content gaps | Questions neither your assistant nor your pages answer, ranked by how often they come up. |
| Conversion usefulness | Whether the assistant moves someone toward a decision or just answers and stops. |
Process
How it actually works
THIS IS A REQUEST, NOT A SCANNER
Nothing on this page runs automatically. You send the details, a person runs your questions against your live assistant, captures the answers with screenshots, and sends the scorecard back. Usually a few days. Building a fake progress bar would have been easier and would have told you nothing.
You send the form
Website, chatbot page, provider, questions, email. Five fields.
We run your questions on your live site
The same questions against your assistant, captured as they came back.
We run them against Creobot on your approved sources
Only if you want the comparison. The audit is useful without it.
You get the scorecard and the raw answers
Including the cases where your current assistant did fine, because a scorecard that only finds problems is a sales document.
Audit questions
Launch
Get my bot teardown
Send the page your assistant lives on and the questions you care about. We will run them and send back the answers.