Noma by Nurdd (NomaHQ)Noma
AI visibility

Are AI Visibility Platforms Dead? What Still Works in AEO

Are AI visibility platforms dead? What trackers cannot do, what multi-engine measurement still shows, and a 3-day test to run before you pay for one.

Sheetal Shakshi10 min read
A cracked stone frame rests on a marble plinth beside three hanging glass pendulums against a purple backdrop.

Are AI visibility platforms dead? No, but one use of them is: reporting a single ranking position in an AI answer. SparkToro's research found AI brand lists almost never repeat. What still works is measuring how often your brand appears across many runs and engines, with a prompt set you control and records you keep.

Key takeaways

  • Stop reporting a ‘position in ChatGPT’ as a headline number. Report mention rate across repeated runs, with the sample size beside it.
  • A tracker cannot tell you why an engine named a rival, what a sale was worth, or what you should write. It shows where you stand and which sources the answers cite.
  • You do not need a paid tool for 20 prompts checked monthly by hand. You do once you want daily runs, several engines and a history you can compare.
  • Before you pay, keep your own prompt list and ask each vendor what you can export.
  • Run a 3-day trial as a test, not a demo: fixed prompts, repeated runs, manual spot-checks against the tool.
  • Google says there is no special optimisation for AI features, so the work a tracker points to is mostly ordinary content, crawl access and off-site mentions.

What did the r/TechSEO doubt get right?

The thread asking whether platforms such as Peec and Profound are dead is a fair challenge, and it rests on real evidence. Three points hold up.

First, answers are unstable. SparkToro and Gumshoe.ai ran 12 recommendation prompts, each 60 to 100 times per platform. Search Engine Journal, January 2026, reports that nearly every response differed in the brands listed, their order and the number of items. ChatGPT and Google AI Overviews each returned the same list less than 1% of the time.

“If you ask an AI tool for brand/product recommendations a hundred times nearly every response will be unique.” Rand Fishkin, SparkToro, quoted by Search Engine Journal, January 2026

Second, real users do not write the prompts a tracker uses. The same study asked 142 people to write their own prompt about headphones for a travelling relative. The semantic similarity across those prompts was 0.081, so a tracked prompt is a sample, not a mirror of demand.

Third, the study came with a conflict: Gumshoe.ai sells AI tracking, which the authors disclosed. It is not peer-reviewed, and the authors left open how many runs are needed for reliable data. Read it as a warning about method, not a verdict on the category.

The same study also holds the counter-argument. Despite the varied prompts, Bose, Sony, Sennheiser and Apple appeared in 55 to 77% of 994 responses. The consideration set was stable even when the lists were not. That is the case for measuring frequency.

What can an AI visibility tracker not do?

Be clear about the limits before you buy. This table separates what a tracker can show from what it cannot, and what you do instead.

QuestionCan a tracker answer it?What to do instead
Where do we rank in ChatGPT?No. Lists and order change run to run.Report mention rate over repeated runs.
How often is our brand named for buyer questions?Yes, with enough runs and a stated sample.Track a fixed prompt set daily and show the denominator.
Which pages do the answers cite?Yes, from the sources listed in each answer.Group by owned, earned and community sources.
Why did the engine choose a rival?Not directly. It shows what the answer says and cites.Read the cited pages and compare them with yours.
How much revenue came from AI?No. Referral data lives in your analytics.Add an AI option to your ‘how did you hear about us’ field and read referrals.
What do real users type?No. Tracked prompts are your sample.Mine sales calls, support tickets and search queries for wording.
Does a fix work?Only if you measure before and after on the same prompts.Freeze the prompt set, change one thing, compare mention rate.

Ahrefs reports another source of instability: its data, summarised by Search Engine Journal, showed Google AI Mode and AI Overviews citing different sources 87% of the time for the same query. A tool that blends engines into one score hides that gap.

What does multi-engine measurement still give you?

Three things you cannot get by hand at any scale.

  1. A denominator. One manual check is an anecdote. A platform that runs the same prompt daily across engines gives you a rate, such as 9 mentions in 20 runs, and a trend.
  2. Engine-by-engine differences. Engines disagree on the top brand and on sources. Seeing ChatGPT, Gemini, Perplexity and Claude separately shows where you are strong and where a fix is needed. The why engines disagree guide explains the causes.
  3. Source maps. Citations tell you which pages feed the answer. That turns ‘we are missing’ into a list of pages to improve or places to earn a mention.

A worked example: how many runs is enough?

This is my own arithmetic, not a vendor figure. Say your brand appears in half of all runs. With 20 runs, the standard error of that rate is about 11 percentage points (the square root of 0.5 × 0.5 ÷ 20), so a 95% range is roughly plus or minus 22 points. With 100 runs it is about plus or minus 10 points.

So a move from 45% to 52% in a week on 20 runs means nothing. A move from 30% to 60% on 100 runs probably does. The AI Visibility Measurement Standard from Noma by Nurdd sets out the same rule: state the numerator and denominator and call a change only when it exceeds the margin of error.

Why do the numbers still matter if the lists change?

Because what drives visibility sits outside the answer box, and you can measure it. Ahrefs analysed 10,000 brands and about 260 million non-branded prompts. It found Reddit mentions correlated with AI visibility at roughly 0.75 (Spearman), above any other mention type, and brands with 10 times more webpage mentions received 3.7 times more AI mentions (Ahrefs, November 2026). In an earlier Ahrefs study of 75,000 brands, as reported by Search Engine Land, branded web mentions correlated at 0.664 with AI Overview visibility, against 0.218 for referring domains.

These are correlations and Ahrefs says brand size explains part of the link. Still, they point to work a tracker can verify: earn mentions where buyers and engines look, then see whether your mention rate moves. Our breakdown of the Ahrefs mentions study covers the method.

Are AI visibility tools like Peec and Profound worth it?

It depends on what you would do with the data, not on the vendor. Use this table to decide.

Your situationManual checks enough?Paid tool worth testing?
One brand, fewer than 20 buyer prompts, no budget for the work a report would triggerYes, monthlyNot yet
You need a baseline to justify AEO budgetFor a first passYes, for repeated runs and history
Four or more engines matter to your buyersSlow and hard to compareYes
Agency reporting to clientsNoYes, with exports
You will not change pages or earn mentions after seeing the dataYesNo: a dashboard alone changes nothing

Compare vendors on the same criteria, from each vendor's own pricing page: engines included, prompt limits, export or API, and trial terms. Our AI visibility tool pricing table lists the published figures with the date each was read, and the guide to choosing an AEO tool gives a pre-purchase test.

Do I need a tool to track AI visibility?

No, to begin. The Founder's AEO Plan suggests tracking 20 buyer questions by hand each month. Do that in a spreadsheet: prompt, engine, date, run number, brand named yes or no, rivals named, sources cited.

You need a tool when the hand method breaks: you want daily runs, several engines, or enough repeats for the arithmetic above to give a usable range. Twenty prompts on four engines at five runs each is 400 answers a round. Nobody keeps that up for long.

How do you own your prompts and data?

This is the part that answers ‘dead’ in practice. A platform becomes dead weight when you cannot leave it. Keep control with this checklist.

  1. Write the prompt set yourself. Keep it in a document you own, tagged by buying stage and by branded or unbranded. The guide to choosing prompts to track shows how.
  2. Freeze it. Change prompts only on a logged date, or trend lines break.
  3. Ask for the evidence. Ask each vendor whether you can read the full answer text and cited URLs behind a score, and what it says in writing.
  4. Check export and API access. Ask what leaves the tool and in what format, and on which plan.
  5. Keep a separate referral record. Read AI-sourced visits in your own analytics so your attribution does not depend on one vendor.
  6. Spot-check by hand. Re-run five prompts yourself each month and compare with the tool.

What still works in AEO, with or without a tool?

The tracker only points. The work is below, and none of it depends on a vendor.

How do you test a platform during a 3-day free trial?

Three days is short, so decide your test before you start. This plan works on any tool with a trial, including Noma by Nurdd.

  1. Day 0, before signup. Write 15 to 25 unbranded buyer prompts, and note 5 you will check by hand in ChatGPT and Perplexity. Save the answers with dates.
  2. Day 1. Add your brand, three rivals and your prompts. Check that the trial's prompt limit covers your set. Noma's trial includes 25 tracked prompts.
  3. Day 2. Compare the tool's reported mentions for your five hand-checked prompts with what you saw. Note every mismatch.
  4. Day 2. Read the cited sources. Pick three pages that appear for prompts where you are absent and decide what you would change.
  5. Day 3, before billing. Try an export or the API route if the plan offers one. Decide: did the data lead to an action you would not have found by hand? If not, cancel.

Noma takes a card at signup so billing can start on day 3. If you cancel before then, nothing is charged. Put a reminder in your calendar when you sign up.

Noma asks 13 AI engines, including ChatGPT, Gemini, Perplexity and Claude, the questions your buyers ask, every day. It reports visibility, position and sentiment per engine, lists the sources each answer cites, and compares you with competitors. Position is shown per engine, not as one ranking claim.

See it on your own brand: book a demo or start the 3-day free trial. Plans and prompt limits are on the pricing page.

What should you check for free first?

Before paying for anything, run the free AI SEO checker. It shows whether ChatGPT, Claude, Perplexity and Google AI Mode can read a given page, plus its basic SEO, with a list of top fixes. If a page fails there, a tracker will only tell you what you already know: you are absent.

Which mistakes make a tracker look dead when it is not?

  • Trusting one run. A single answer is noise. Use repeated runs and show the range.
  • Reporting position as truth. The SparkToro data shows lists and their order vary run to run, so a single position is a weak number.
  • Tracking only branded prompts. They flatter you. Buyers who do not know you ask unbranded questions.
  • Changing prompts mid-test. You then measure your edits, not the world.
  • Buying before there is an owner. Someone must act on the findings. See the AI Search Team Kit.

How we researched this

We reviewed platform documentation (Google Search Central, OpenAI), a published research study on AI answer consistency reported by an industry publication, and a vendor-published correlation study from Ahrefs. We read the primary pages where we could; the 75,000-brand figures come from a secondary report. The r/TechSEO thread supplied the question, not evidence. Facts, figures and links were checked on 2026-11-14, except where noted. We did not use any competitor pricing here; check each vendor's own page for current terms. The worked example is our own arithmetic and is labelled as such.

What should you do next?

Write your 20 prompts this week and check five by hand. If the repeat-run arithmetic shows you need more samples than you can collect, test a platform against the plan above. You can book a demo to see Noma on your own brand, or start the free trial and run the 3-day test.

See what AI engines say about your brand

Free · no account · or start a 3-day trial

Questions people ask

Are AI visibility tools like Peec and Profound worth it?

They are worth it if you will act on repeated, multi-engine data and can export it. They are not worth it as a dashboard you never act on. Compare vendors on engines, prompt limits, exports and trial terms from each vendor's own pricing page, then test two on the same prompt set.

Do I need a tool to track AI visibility?

Not at first. You can check about 20 buyer prompts by hand each month in a spreadsheet. A tool becomes useful when you want daily runs, several engines and enough repeats to tell a real change from noise.

Why do AI answers change every time I ask?

Language models generate each answer fresh, so the brands listed, their order and their number vary. SparkToro and Gumshoe.ai ran each prompt 60 to 100 times per platform and found nearly every response was unique. Frequency across many runs is steadier than any single list.

Can any tool tell me my ranking position in ChatGPT?

A tool can show where you appeared in a given answer, but not a stable rank. The SparkToro data shows lists and their order vary run to run. Use mention rate across repeated runs instead.

What should I test in a 3-day free trial of an AI visibility tool?

Load a fixed prompt set, compare the tool's results with five answers you checked by hand, read the cited sources, and try an export if the plan offers one. Cancel before billing starts if the data did not lead to an action. With Noma by Nurdd, a card is taken at signup and billing starts on day 3.

Is AEO different from SEO?

The work overlaps. Google says its SEO best practices remain relevant for AI Overviews and AI Mode and that there are no extra requirements. AEO adds measuring how engines describe and cite you, and earning mentions on third-party pages.

← Back to the blog