Syntra Systems
Cases Services Products About Blog IT Caravan
+998 99 162 22 12 +7 999 900 22 12
RusEngUzb
A starlit sky over a night desert with rock silhouettes, a metaphor for measuring what AI answers say about a company
Analytics

AI visibility report: which metrics to count every month

By Natali Shumilovskaya · · 8 min read · updated

An AI visibility report is built not around a single number but around a fixed set of control queries and seven metrics: mention rate, share of voice, recommendation rate, citation rate, average position in a list, factual accuracy and traffic from AI services. They have to be counted every month against the same query set, otherwise the months cannot be compared.

Key takeaways

  • The report rests on a fixed set of control queries: as long as the set does not change, months can be compared with each other.
  • There are seven metrics: mention rate, share of voice, recommendations, citation rate, average position in a list, factual accuracy and traffic from AI services.
  • Some data comes from the platforms themselves — Search Console, Bing Webmaster Tools and Yandex Webmaster; for ChatGPT, Perplexity and Claude the measurement stays manual.
  • Google Analytics 4 collects visits from AI assistants into a dedicated channel, but impressions in AI Overviews and AI Mode are not part of it.
  • Model answers are non-deterministic, so a single check proves nothing: you need repeats and a trend rather than one answer.

AI visibility is not a single number

A single number answers none of the working questions. “AI visibility 64” says nothing about whether you are recommended, whether the site is linked, or whether your services are described correctly.

A useful report answers a chain of questions in order: does the model know the company, does it name it in an answer, does it recommend it, where does it stand among competitors, does it link to the site, which sources it uses instead of you, how it describes the company, how accurate that description is, and whether any of it brings people and enquiries.

Every question in the chain is a separate metric. Rolling them into one score is fine for a title slide, but decisions cannot be made on that score: it hides a rise in mentions alongside a fall in links just as easily as the reverse.

Control queries: where the measurement starts

Measurement starts with the list of questions a prospective client asks, not with a tool. The list is written down and does not change without reason — it is what makes the numbers comparable.

For an IT company in Tashkent the set looks like this: CRM development in Tashkent, business automation companies in Uzbekistan, who builds ERP for distributors, Telegram bot development, AI for a sales team, how much CRM development costs, alternatives to a specific vendor, best IT companies in Uzbekistan.

The size of the set matters more than its cleverness. Twenty queries checked every month are worth more than two hundred checked once.

The second rule is to write the query down word for word, along with its language and region. A question rephrased on the fly returns a different answer, and a month later you will be comparing two separate checks rather than a trend.

Which metrics to count

There are seven metrics, and each answers its own question in the chain. The formulas are simple: every one is a share of a clearly named denominator.

MetricQuestion it answersHow it is calculatedExample
Mention rateDoes the model know the companyAnswers mentioning the brand divided by the number of queries checked42 mentions across 100 queries
Share of voiceHow much of the category you holdYour mentions divided by the mentions of all brands in the same answers42 out of 300 mentions of all companies
Recommendation rateAre you named or actually recommendedAnswers with a recommendation divided by answers with a mention32 recommendations across 50 mentions
Citation rateDoes the answer lead to your siteAnswers linking to your domain divided by answers with a mention25 links across 40 answers with the brand
Average position in a listWhere you stand in a list of companiesThe brand's average place in enumerationsthird on average across 20 answers
Factual accuracyAre you described correctlyCorrect statements about services, prices and geography divided by all statements checked18 correct statements out of 20
Traffic and enquiriesDoes any of it bring peopleSessions, enquiries and sales from AI service sourcessessions from ChatGPT over a month

The cadence differs. Weekly you look at mentions for the main commercial queries and at traffic. Monthly you count all seven metrics. Quarterly you work through which sources the models use instead of you and what to do about it.

Average position in a list is the one metric that must not be read as a search position. The list inside an answer is built around the exact wording of the question and shifts with it, so it is read only as a trend and only against the same competitors.

Where the data comes from

Some of the numbers come from the platforms themselves, and that is where to start: it is free and needs no manual work. The rest is collected by hand against the control queries.

SourceWhat it showsWhat it does not show
Google Search Console, generative AI performance reportImpressions of your pages in AI Overviews and AI Mode, by page, country and device (Search Console help)No clicks or positions in the report; not available to every site
Bing Webmaster Tools, AI performance reportHow often the site is cited in Copilot answers and Bing summaries, which pages and for which queries (Bing blog)It counts citations, not visits
Bing Webmaster Tools, citation shareYour share of citations among all citations shown for the same query (Bing blog)Microsoft surfaces only
Yandex Webmaster, visibility in Alisa answersThe share of queries that mention the site, plus sample queries, pages and competitors (Yandex Webmaster help)Only Alisa answers in Yandex search
Manual checks against the control queriesChatGPT, Perplexity, Claude and anything else that gives site owners no reportsLabour-intensive, and repeats are needed because answers are unstable

Traffic is counted in web analytics. Google Analytics 4 now has a dedicated channel for it: visits from ChatGPT, Gemini, Copilot, Grok and DeepSeek land there automatically, with the source marked ai-assistant (Google Analytics help). One caveat matters: visits from AI Overviews and AI Mode do not go into that channel — they arrive as ordinary search and are only visible in Search Console.

Why the same query returns different answers

Because model outputs are non-deterministic. OpenAI puts it plainly: by default the model may return a different result for the same request, and the parameter meant to make output repeatable produces “mostly” the same answer without guaranteeing it (OpenAI documentation).

Hence the rule of measurement: a single check proves nothing. The same query is run several times, the result is averaged, and what goes into the report is the trend rather than one answer.

Note Record the conditions of the measurement alongside the figures: date, service and model version, query language, region, number of repeats, and whether the search mode was on. Without those fields, comparing months turns into an argument about method.

The structure of a monthly report

The report reads top to bottom and ends with tasks rather than charts. The order of sections stays the same month after month, which is why people get through it.

  1. Summary. The seven metrics for the month, the change against the last one and the three conclusions that matter.
  2. Competitive picture. Share of voice, recommendations and citation share against the same competitors as a month ago.
  3. Queries. Where you win, where you lose, what is new in the set.
  4. Citations. Which of your pages are cited and which outside sources stand in your place.
  5. Brand perception. How the models describe the company and where they get it wrong.
  6. Traffic and money. Visits, enquiries and deals from AI service channels.
  7. Action plan. Five tasks for the coming month with owners and deadlines.

If the report does not fit on five pages, the problem is not the volume of data but the absence of conclusions.

Turning the report into an action plan

Every conclusion is carried through to six fields, otherwise it is an observation rather than a task. The format is the one we use in our article on turning analytics results into an action plan: one format across the company saves reading time.

FieldWhat goes in itExample from a report
FactWhat the measurement showed and for which periodZero mentions for “ERP for distributors” across three months
CauseWhy it is happeningThe site has no page that answers this question in full
ActionWhat exactly changesWrite an article covering the task and the order of implementation
Expected effectWhich metric should move and whereMentions appearing for this query in at least some answers
OwnerOne person, not a departmentThe blog editor
DeadlineThe date the change has to be workingBy the next monthly measurement

Factual errors deserve a line of their own. When models credit the company with services it does not offer or quote outdated prices, the fix is publishing unambiguous facts on your own site and updating directory listings, not writing to the service's support desk.

How this differs from an SEO report

An SEO report answers the question of where the site stands. An AI visibility report answers what is said about the company and what is linked while saying it. The first counts impressions, clicks and positions; the second counts mentions, recommendations and citations.

The two do not compete and rest on each other: a page that is not indexed will not reach an AI answer either. How the foundation works is covered in our article on whether you still need SEO in the age of AI, and what to do with pages for the sake of answers is in the article on generative engine optimisation.

The last link in the chain is money. Until visits from AI services are tied to enquiries and deals, the report stays a report about visibility. How to assemble the path from source to payment into one chain is shown in our article on end-to-end analytics.

How we run this report

Syntra Systems does not sell a “guarantee of mentions” — the platforms do not publish their source selection rules, so there is nothing to promise. We build the control query set with you, set up the reports in Search Console, Bing Webmaster Tools, Yandex Webmaster and web analytics, run manual checks for the services that give no reports, and hand over a monthly analysis with an action plan.

This work sits inside project development, from $1,500 a month: a fixed number of team hours, sprints with a demonstration of the result and a quarterly review of priorities. The terms are described on the technical support page.

Let’s discuss your project

Tell us what you need, and we will estimate the timeline and cost and suggest a solution.

Discuss project development

Frequently asked questions

Where do you start if nothing has ever been measured?

With twenty control queries and one service. Check them by hand, record the share of answers that mention the brand and the share that link to the site. That is the first baseline; from there the set grows rather than being rewritten.

Do you need paid tools to measure AI visibility?

Not at the start. The free reports in Search Console, Bing Webmaster Tools and Yandex Webmaster, plus a manual check against the query list, cover the basic picture. A paid tool makes sense once there are more than a hundred queries and manual checking eats a working day.

How do you tell a mention from a recommendation?

A mention is when the company is simply named in a list. A recommendation is when the model explains why it is worth approaching or puts it first with a reason. Counting the two as one metric is wrong: they mean different things.

What if a model gets facts about the company wrong?

Find where the wrong data comes from: usually an outdated page on your own site, an old directory listing or someone else's retelling. Fix the original, publish an unambiguous statement of your own, then repeat the measurement a month later.

How do you connect AI visibility to revenue?

Through web analytics and the CRM: visits from AI services are marked as a separate channel, and from there the chain runs to enquiries and deals. Until that chain exists, the report shows visibility rather than money.

How often should the control query set change?

No more than once a quarter, and always with a note in the report. New queries can be added, but old ones are better kept: they are what makes comparison with previous months possible. Replacing the set wholesale wipes out the accumulated history.

Read also