← Essays

AEO Is Measuring the Wrong Thing

Most AEO tools are just mirrors. They show you where you're already strong and call it a score.

distributionfield-notes

AEO — Answer Engine Optimization — is the new SEO. Except instead of ranking on Google, you’re trying to show up in AI answers. When someone asks ChatGPT to recommend a tool, find a service, or explain a solution, AEO is what determines if your product gets mentioned or not.

Most AEO tools are measuring the wrong thing.

You pick prompts. They check if your brand appears. They return a score.

But you picked those prompts. Which means you picked topics you already know about your product. Which means you’re measuring where you’re already strong.

That’s not gap analysis. That’s a mirror.

The question nobody is asking

The real question is what people are asking AI that leads to your category — the conversations happening right now where your product is completely absent and you don’t even know it.

You can’t find that by choosing your own prompts. Your blind spots are, by definition, the things you don’t think to look for.

Nobody has cleanly solved this yet. Which means most AEO scores are measuring confidence, not coverage. They tell you how visible you are inside the territory you already mapped. They say nothing about the territory you haven’t found.

That gap is where your actual AEO problem lives.

What a partial fix looks like

The closest practical fix is switching from brand queries to category queries. Instead of testing “does my product appear when I search for myself,” test the generic problem statements your users have before they know your product exists — “AI for Excel,” “automate data analysis,” “spreadsheet AI tool.”

You won’t rank well. That’s the point. The gap between your brand query score and your category query score is the closest proxy we have for actual AEO blind spots.

It’s not a complete solution — you still have to guess the category queries, which means blind spots you don’t know to test still exist. But it’s directionally correct: you’re measuring territory you haven’t mapped yet, not territory you already own.