跳到正文
DEV Community· MaxAEO·· 2 小時前AI 評分51

MaxAEO 如何追蹤 AI 助理推薦的工具:40 個問題、8 個平台、2,124 條回答

How we track which tools AI assistants recommend (40 questions, 8 platforms, 2,124 answers)

AI 導讀

MaxAEO 用 40 個不含品牌名稱的問題,在 8 個 AI 平台連續 7 天追蹤工具推薦,取得 2,124 條已完成回答並計算提及率。Profound、Peec AI、Otterly.AI 和 Semrush 的整體提及率均逾 60%,在任何單一平台也都不低於 40%;作者指出,平台數據應分開呈現,否則整體平均會掩蓋差異。

正文

Chris Han, Head of Product at MaxAEO

Some context first. I work on MaxAEO, a tool that tracks how AI assistants mention brands. So I'm a player in the category I'm measuring here, and our own product is in the results, competitors included. Every number below comes from our tracker and I checked them against the raw export.

The question is simple. When someone asks an AI assistant which tool to buy, which names come back, and how often?

You can answer that for your own category without much code. Here is what we ran.

The setup

You need a fixed set of questions, a list of platforms, and a schedule.

We wrote 40 questions the way a buyer would actually type them. Two of them:

What are the best AEO tools for tracking brand visibility in AI search?

Our agency needs GEO software to monitor AI search visibility for multiple clients. Which platforms should we evaluate?

None of the 40 mention a brand. If your prompt names a product, you're mostly testing whether the model repeats your prompt back to you.

The platforms were ChatGPT, Gemini, Perplexity, Claude, Grok, Microsoft Copilot, Google AI Overviews and Google AI Mode. Each question went to each platform once a day for 7 days, October 22 to 28, 2026. That came to 2,124 completed answers.

Freeze the question set before you start. Edit a prompt mid-run and your day-over-day numbers stop meaning anything.

Counting

From each answer, pull out the tool names and normalize them. Ours does this automatically and merges variants, so "Scrunch AI" and "Scrunch" are one tool. Then:

naming rate = answers that named the tool at least once / completed answers

Three mentions in one answer still count once. Only completed answers go in the denominator.

Compute it per platform, not just overall. A bare-bones version:

// answers: [{ platform: "chatgpt", tools: ["Profound", "Peec AI"] }, ...]
function namingRates(answers) {
  const total = {};
  const hits = {};
  for (const a of answers) {
    total[a.platform] = (total[a.platform] || 0) + 1;
    for (const tool of new Set(a.tools)) {
      hits[tool] ??= {};
      hits[tool][a.platform] = (hits[tool][a.platform] || 0) + 1;
    }
  }
  const rates = {};
  for (const [tool, byPlatform] of Object.entries(hits)) {
    rates[tool] = {};
    for (const p of Object.keys(total)) {
      rates[tool][p] = (byPlatform[p] || 0) / total[p];
    }
  }
  return rates;
}

The counting is the easy bit. Getting clean names out of free text and merging aliases is where it gets fiddly.

One week of results

Tool Share of all 2,124 answers Named most by Named least by
Profound 79.5% Copilot (96%), ChatGPT (93%) AI Mode (55%)
Peec AI 70.7% Claude (89%), ChatGPT (85%), Grok (85%) AI Mode (40%)
Otterly.AI 67.5% Grok (85%), Claude (81%) Perplexity (45%)
Semrush 62.3% Gemini (71%), AI Overviews (71%) AI Mode (47%)
Ahrefs 52.4% Grok (78%), Claude (73%) Perplexity (29%)
Scrunch 33.2% Grok (62%), Claude (56%) AI Mode (6%)
AthenaHQ 30.4% Grok (65%), Claude (45%) Perplexity (9%)
HubSpot 24.4% Perplexity (37%) Copilot (14%)
SE Ranking 15.1% AI Overviews (34%) Copilot (1%)
Rankscale 13.9% Grok (40%) ChatGPT (2%)
Writesonic 13.5% Grok (28%), Claude (25%) ChatGPT, AI Overviews and AI Mode (6%)
Conductor 7.8% Copilot (19%), Claude (18%) ChatGPT and AI Mode (2%)
MaxAEO (us) 7.8% AI Mode (23%), AI Overviews (18%) ChatGPT (0%)

Just under the cutoff: ZipTie (7.7%), Goodie AI (7.6%) and Promptwatch (7.5%).

The top four held up everywhere. Profound, Peec AI, Otterly.AI and Semrush were each above 60% overall and never dropped under 40% on any single platform. Below them it gets messy.

Why platform has to be its own column

If you build one of these, don't ship a single blended score.

AthenaHQ was in 65% of Grok answers and 9% of Perplexity answers. SE Ranking was in 34% of AI Overviews answers and 1% of Copilot's. Average those and you get a number that describes no real platform.

Our own row shows it best. MaxAEO was in 23% of Google AI Mode answers and 0 of 247 ChatGPT answers. Track only ChatGPT and you'd think nobody recommends us. Track only AI Mode and you'd think we're doing fine. Neither is true.

List length plays into it too. Grok named 11.8 tools per answer on average and Claude 10.7. Perplexity named 4.6 and ChatGPT 5.3. A five-name list doesn't leave much room after the usual suspects. My guess is that's part of why Grok and Claude keep turning up in the "named most by" column, but we haven't tested it directly.

So make platform a real dimension in your schema from day one. If your buyers mostly use one assistant, that platform's numbers will tell you more than the overall column anyway.

Run it every day

A single run is noise. I compared each ChatGPT answer's #1 pick with the #1 for the same question the day before, and they matched only 38% of the time. Even a full week of 40 questions is a snapshot, not a settled ranking.

What this doesn't tell you

It shows who gets recommended, not who's best. A good tool can be rarely named, and a tool can get named a lot for reasons that have little to do with quality.

It also ran on our own tracker, in a category we compete in. The questions are generic and none of them names us, but weigh that however you think is fair.

If you'd rather not build it yourself, this per-platform breakdown is what MaxAEO does. We'll rerun the same 40 questions each month and update this post with the new numbers, our row included.

This article was written with AI assistance. The data and analysis are ours, and I checked every number against our export.

來源:DEV Community · dev.to