# Are AI Visibility Platforms Dead? What Still Works in AEO

> Are AI visibility platforms dead? What trackers cannot do, what multi-engine measurement still shows, and a 3-day test to run before you pay for one.

- Author: Sheetal Shakshi, Founder's Office, Nurdd
- Published: 2026-11-15
- Publisher: Noma by Nurdd (https://nomahq.app)
- Original page: https://nomahq.app/blog/are-ai-visibility-platforms-dead

Are AI visibility platforms dead? No, but one use of them is: reporting a single ranking position in an AI answer. SparkToro's research found AI brand lists almost never repeat. What still works is measuring how often your brand appears across many runs and engines, with a prompt set you control and records you keep.

## Key takeaways

- Stop reporting a ‘position in ChatGPT’ as a headline number. Report mention rate across repeated runs, with the sample size beside it.
- A tracker cannot tell you why an engine named a rival, what a sale was worth, or what you should write. It shows where you stand and which sources the answers cite.
- You do not need a paid tool for 20 prompts checked monthly by hand. You do once you want daily runs, several engines and a history you can compare.
- Before you pay, keep your own prompt list and ask each vendor what you can export.
- Run a 3-day trial as a test, not a demo: fixed prompts, repeated runs, manual spot-checks against the tool.
- Google says there is no special optimisation for AI features, so the work a tracker points to is mostly ordinary content, crawl access and off-site mentions.

## What did the r/TechSEO doubt get right?

The thread asking whether platforms such as Peec and Profound are dead is a fair challenge, and it rests on real evidence. Three points hold up.

First, answers are unstable. SparkToro and Gumshoe.ai ran 12 recommendation prompts, each 60 to 100 times per platform. [Search Engine Journal, January 2026](https://www.searchenginejournal.com/ai-recommendations-change-with-nearly-every-query-sparktoro/566242/), reports that nearly every response differed in the brands listed, their order and the number of items. ChatGPT and Google AI Overviews each returned the same list less than 1% of the time.

> “If you ask an AI tool for brand/product recommendations a hundred times nearly every response will be unique.” Rand Fishkin, SparkToro, quoted by [Search Engine Journal, January 2026](https://www.searchenginejournal.com/ai-recommendations-change-with-nearly-every-query-sparktoro/566242/)

Second, real users do not write the prompts a tracker uses. The same study asked 142 people to write their own prompt about headphones for a travelling relative. The semantic similarity across those prompts was 0.081, so a tracked prompt is a sample, not a mirror of demand.

Third, the study came with a conflict: Gumshoe.ai sells AI tracking, which the authors disclosed. It is not peer-reviewed, and the authors left open how many runs are needed for reliable data. Read it as a warning about method, not a verdict on the category.

The same study also holds the counter-argument. Despite the varied prompts, Bose, Sony, Sennheiser and Apple appeared in 55 to 77% of 994 responses. The consideration set was stable even when the lists were not. That is the case for measuring frequency.

## What can an AI visibility tracker not do?

Be clear about the limits before you buy. This table separates what a tracker can show from what it cannot, and what you do instead.

| Question | Can a tracker answer it? | What to do instead |
| --- | --- | --- |
| Where do we rank in ChatGPT? | No. Lists and order change run to run. | Report mention rate over repeated runs. |
| How often is our brand named for buyer questions? | Yes, with enough runs and a stated sample. | Track a fixed prompt set daily and show the denominator. |
| Which pages do the answers cite? | Yes, from the sources listed in each answer. | Group by owned, earned and community sources. |
| Why did the engine choose a rival? | Not directly. It shows what the answer says and cites. | Read the cited pages and compare them with yours. |
| How much revenue came from AI? | No. Referral data lives in your analytics. | Add an AI option to your ‘how did you hear about us’ field and read referrals. |
| What do real users type? | No. Tracked prompts are your sample. | Mine sales calls, support tickets and search queries for wording. |
| Does a fix work? | Only if you measure before and after on the same prompts. | Freeze the prompt set, change one thing, compare mention rate. |

Ahrefs reports another source of instability: its data, summarised by Search Engine Journal, showed Google AI Mode and AI Overviews citing different sources 87% of the time for the same query. A tool that blends engines into one score hides that gap.

## What does multi-engine measurement still give you?

Three things you cannot get by hand at any scale.

1. **A denominator.** One manual check is an anecdote. A platform that runs the same prompt daily across engines gives you a rate, such as 9 mentions in 20 runs, and a trend.
2. **Engine-by-engine differences.** Engines disagree on the top brand and on sources. Seeing ChatGPT, Gemini, Perplexity and Claude separately shows where you are strong and where a fix is needed. The [why engines disagree](https://nomahq.app/blog/why-engines-disagree) guide explains the causes.
3. **Source maps.** Citations tell you which pages feed the answer. That turns ‘we are missing’ into a list of pages to improve or places to earn a mention.

### A worked example: how many runs is enough?

This is my own arithmetic, not a vendor figure. Say your brand appears in half of all runs. With 20 runs, the standard error of that rate is about 11 percentage points (the square root of 0.5 × 0.5 ÷ 20), so a 95% range is roughly plus or minus 22 points. With 100 runs it is about plus or minus 10 points.

So a move from 45% to 52% in a week on 20 runs means nothing. A move from 30% to 60% on 100 runs probably does. The [AI Visibility Measurement Standard](https://nomahq.app/resources/ai-visibility-measurement) from Noma by Nurdd sets out the same rule: state the numerator and denominator and call a change only when it exceeds the margin of error.

## Why do the numbers still matter if the lists change?

Because what drives visibility sits outside the answer box, and you can measure it. Ahrefs analysed 10,000 brands and about 260 million non-branded prompts. It found Reddit mentions correlated with AI visibility at roughly 0.75 (Spearman), above any other mention type, and brands with 10 times more webpage mentions received 3.7 times more AI mentions ([Ahrefs, November 2026](https://ahrefs.com/blog/mention-types-ai-visibility/)). In an earlier Ahrefs study of 75,000 brands, as reported by [Search Engine Land](https://searchengineland.com/ai-search-seo-brand-marketing-together-501770), branded web mentions correlated at 0.664 with AI Overview visibility, against 0.218 for referring domains.

These are correlations and Ahrefs says brand size explains part of the link. Still, they point to work a tracker can verify: earn mentions where buyers and engines look, then see whether your mention rate moves. Our [breakdown of the Ahrefs mentions study](https://nomahq.app/blog/mentions-that-correlate-with-ai-visibility) covers the method.

## Are AI visibility tools like Peec and Profound worth it?

It depends on what you would do with the data, not on the vendor. Use this table to decide.

| Your situation | Manual checks enough? | Paid tool worth testing? |
| --- | --- | --- |
| One brand, fewer than 20 buyer prompts, no budget for the work a report would trigger | Yes, monthly | Not yet |
| You need a baseline to justify AEO budget | For a first pass | Yes, for repeated runs and history |
| Four or more engines matter to your buyers | Slow and hard to compare | Yes |
| Agency reporting to clients | No | Yes, with exports |
| You will not change pages or earn mentions after seeing the data | Yes | No: a dashboard alone changes nothing |

Compare vendors on the same criteria, from each vendor's own pricing page: engines included, prompt limits, export or API, and trial terms. Our [AI visibility tool pricing table](https://nomahq.app/compare/ai-visibility-tool-pricing) lists the published figures with the date each was read, and the [guide to choosing an AEO tool](https://nomahq.app/blog/aeo-tools-how-to-choose) gives a pre-purchase test.

## Do I need a tool to track AI visibility?

No, to begin. The [Founder's AEO Plan](https://nomahq.app/resources/founders-aeo-plan) suggests tracking 20 buyer questions by hand each month. Do that in a spreadsheet: prompt, engine, date, run number, brand named yes or no, rivals named, sources cited.

You need a tool when the hand method breaks: you want daily runs, several engines, or enough repeats for the arithmetic above to give a usable range. Twenty prompts on four engines at five runs each is 400 answers a round. Nobody keeps that up for long.

## How do you own your prompts and data?

This is the part that answers ‘dead’ in practice. A platform becomes dead weight when you cannot leave it. Keep control with this checklist.

1. **Write the prompt set yourself.** Keep it in a document you own, tagged by buying stage and by branded or unbranded. The [guide to choosing prompts to track](https://nomahq.app/blog/choose-prompts-to-track) shows how.
2. **Freeze it.** Change prompts only on a logged date, or trend lines break.
3. **Ask for the evidence.** Ask each vendor whether you can read the full answer text and cited URLs behind a score, and what it says in writing.
4. **Check export and API access.** Ask what leaves the tool and in what format, and on which plan.
5. **Keep a separate referral record.** Read AI-sourced visits in your own analytics so your attribution does not depend on one vendor.
6. **Spot-check by hand.** Re-run five prompts yourself each month and compare with the tool.

## What still works in AEO, with or without a tool?

The tracker only points. The work is below, and none of it depends on a vendor.

- **Crawl access.** OpenAI documents OAI-SearchBot and GPTBot as separate robots.txt controls, and says a robots.txt change can take about 24 hours to apply ([OpenAI, as checked November 2026](https://developers.openai.com/api/docs/bots)). Blocking the wrong one removes you from ChatGPT search. The [free AI crawler checker](https://nomahq.app/tools/ai-crawler-checker) tests this.
- **Ordinary SEO.** Google states that its best practices remain relevant and that **there are no additional requirements to appear in AI Overviews or AI Mode** ([Google Search Central, as checked November 2026](https://developers.google.com/search/docs/appearance/ai-features)). Treat claims of a secret AI markup with suspicion.
- **Quotable pages.** State facts in plain, dated sentences. See the [brand fact block guide](https://nomahq.app/blog/brand-fact-block-for-llms).
- **Off-site mentions.** Earn coverage on the pages engines already cite for your prompts, using the [earned media playbook](https://nomahq.app/resources/earned-media-for-ai).
- **Correction.** When an answer is wrong, fix its sources. The [guide to wrong AI answers](https://nomahq.app/blog/when-ai-gets-your-brand-wrong) shows the steps.

## How do you test a platform during a 3-day free trial?

Three days is short, so decide your test before you start. This plan works on any tool with a trial, including Noma by Nurdd.

1. **Day 0, before signup.** Write 15 to 25 unbranded buyer prompts, and note 5 you will check by hand in ChatGPT and Perplexity. Save the answers with dates.
2. **Day 1.** Add your brand, three rivals and your prompts. Check that the trial's prompt limit covers your set. Noma's trial includes 25 tracked prompts.
3. **Day 2.** Compare the tool's reported mentions for your five hand-checked prompts with what you saw. Note every mismatch.
4. **Day 2.** Read the cited sources. Pick three pages that appear for prompts where you are absent and decide what you would change.
5. **Day 3, before billing.** Try an export or the API route if the plan offers one. Decide: did the data lead to an action you would not have found by hand? If not, cancel.

Noma takes a card at signup so billing can start on day 3. If you cancel before then, nothing is charged. Put a reminder in your calendar when you sign up.

Noma asks 13 AI engines, including ChatGPT, Gemini, Perplexity and Claude, the questions your buyers ask, every day. It reports visibility, position and sentiment per engine, lists the sources each answer cites, and compares you with competitors. Position is shown per engine, not as one ranking claim.

See it on your own brand: [book a demo](https://nomahq.app/demo) or [start the 3-day free trial](https://platform.nomahq.app/signup). Plans and prompt limits are on the [pricing page](https://nomahq.app/pricing).

## What should you check for free first?

Before paying for anything, run the [free AI SEO checker](https://nomahq.app/tools/ai-seo-checker). It shows whether ChatGPT, Claude, Perplexity and Google AI Mode can read a given page, plus its basic SEO, with a list of top fixes. If a page fails there, a tracker will only tell you what you already know: you are absent.

## Which mistakes make a tracker look dead when it is not?

- **Trusting one run.** A single answer is noise. Use repeated runs and show the range.
- **Reporting position as truth.** The SparkToro data shows lists and their order vary run to run, so a single position is a weak number.
- **Tracking only branded prompts.** They flatter you. Buyers who do not know you ask unbranded questions.
- **Changing prompts mid-test.** You then measure your edits, not the world.
- **Buying before there is an owner.** Someone must act on the findings. See the [AI Search Team Kit](https://nomahq.app/resources/ai-search-team-kit).

## How we researched this

We reviewed platform documentation (Google Search Central, OpenAI), a published research study on AI answer consistency reported by an industry publication, and a vendor-published correlation study from Ahrefs. We read the primary pages where we could; the 75,000-brand figures come from a secondary report. The r/TechSEO thread supplied the question, not evidence. Facts, figures and links were checked on 2026-11-14, except where noted. We did not use any competitor pricing here; check each vendor's own page for current terms. The worked example is our own arithmetic and is labelled as such.

## What should you do next?

Write your 20 prompts this week and check five by hand. If the repeat-run arithmetic shows you need more samples than you can collect, test a platform against the plan above. You can [book a demo](https://nomahq.app/demo) to see Noma on your own brand, or [start the free trial](https://platform.nomahq.app/signup) and run the 3-day test.
