Learning

The useful output is not a dashboard. It is a ranked list of what your site fails to answer.

Most chat analytics measure the widget. The numbers worth having measure your content, and they are a by product of the assistant refusing honestly.

Refusals clustered into a ranked listIndividual refusals cluster by topic into a ranked content roadmap.refusedrefusedrefusedTopic, 14 timesTopic, 9 timesTopic, 5 timesRanked by frequency
  • Private launchOnboarding selected teams now
  • Answers from your pages onlyIt refuses when your content does not cover it

What it does

Every conversation is logged with the question, the answer, the passages retrieved and whether the assistant refused. Aggregated by topic, that becomes a picture of where your content works and where it does not.

Why it matters

Analytics platforms tell you a page has a high exit rate. They cannot tell you the visitor was looking for the returns policy and could not find it. A chat log can, because the visitor typed the question.

This is stronger evidence than keyword research, because the person was already on your site with intent to act. A keyword tool tells you what strangers search. A refusal log tells you what your own visitors could not find.

It is also the argument that gets content work approved. A ranked list of unanswered questions from your own site is far easier to sign off than a redesign proposal.

How it works

Log the whole conversation

Question, answer, passages retrieved, whether it refused, whether it escalated. The retrieval trail is what makes the log diagnostic rather than merely descriptive.

Cluster by topic

Individual questions are noise. The same question asked forty ways is a signal, and clustering is what turns one into the other.

Rank refusals by frequency

A refusal is not a failure. It is a measurement of a gap, and frequency tells you which gap to close first.

Watch follow up rate

A high follow up rate on one topic usually means the answer was technically correct and practically useless, which no accuracy metric catches.

Separate deflection from bounce

Only count a deflection where the question is one your support queue demonstrably receives and no ticket followed.

Refusals clustered into a ranked listIndividual refusals cluster by topic into a ranked content roadmap.refusedrefusedrefusedTopic, 14 timesTopic, 9 timesTopic, 5 timesRanked by frequency

Reading fifty transcripts beats any dashboard

The highest value thing you can do with a chat log is not to chart it. It is to sit down and read fifty conversations end to end, in order, without filtering.

Aggregates hide the thing you most need. A topic cluster tells you forty people asked about returns. Reading them tells you thirty six were asking about return postage cost specifically, which is one sentence missing from one page, not a returns policy problem.

You also see the shape of failure. Visitors rarely rephrase once and leave. They rephrase two or three times, getting shorter and more irritated, and that sequence is legible in a transcript and invisible in a metric.

And you see your own writing quoted back. An assistant grounded in your content is a continuous readability test for that content. When it produces a technically correct answer that clearly did not help, the page it cited is usually the problem.

Do this monthly rather than daily. Enough volume to see patterns, recent enough to act on.

What is built and what is planned

Basic analytics is planned from the Starter plan, advanced analytics with content gap clustering from Pro. Transcript export is planned from Pro.

Where the data goes

Conversation logs are stored so you can read them. Retention periods will be published before paid rollout, and there is no third party enrichment of visitor data because Creobot has no such integration. Security and data boundaries.

Questions

It assumes every answered question would otherwise have become a ticket, which is not true. Most visitors would have left. Counting them as deflections turns a bounce into a saving on a slide.

Refusal rate by topic, follow up rate, and escalations a content fix would have prevented. All three point at something you can change.

Approximately, using proxies: refusal rate, follow up rate, escalation rate and abandonment after an answer. None is exact, and together they are a good deal better than a satisfaction thumbs up nobody clicks.

Yes. Reading fifty real transcripts is worth more than any aggregate, and it is the part most teams skip because it is not a chart.

No. Creobot opens to teams in order. Basic analytics is planned from Starter and content gap clustering from Pro.

Zapier, Slack and webhooks are planned from Pro, which covers most routing needs. There is no native integration with a specific analytics product and we are not going to imply otherwise.

Signal

Is this the capability you need?

Access is by waitlist, demo request or public-content pilot. Tell us what your site has to answer and we will say honestly whether this covers it.