Understand how AI decides who to recommend
ChatGPT, Perplexity, and other AI assistants do not work like Google. Google ranks pages. AI assistants build answers from multiple sources and decide which brands to name inside those answers. The signals they use, the way they evaluate trust, and the number of available positions are all different.
There are three differences that matter most:
| Factor | Google Search | AI assistants (ChatGPT, Perplexity) |
|---|---|---|
| What you compete for | 10 blue links on page 1 | 3–4 brand mentions inside one answer |
| How trust is evaluated | Backlinks, domain authority, page experience | Entity recognition, source consistency, third-party mentions |
| Where signals come from | Your website primarily | Your website + review platforms + Wikipedia + news + forums + training data |
| How often results change | Stable until algorithm update | Different answer every session |
| Overlap with traditional rankings | 100% (it IS Google) | Only 12% of AI-cited URLs rank in Google's top 10 for the same query (Ahrefs study, August 2025) |
That last row is the one most businesses miss. Only 12% of URLs cited by AI assistants also rank in Google's top 10 for the original query, and over 80% of AI citations come from pages that do not rank in Google's top 100 at all. Ranking well on Google does not mean AI will recommend you.
Three layers where AI processes your brand
Every time someone asks ChatGPT a question about your industry, the answer passes through three layers. Your competitors beat you at one or more of these layers:
- Parametric layer — what the AI learned during training. If your brand appeared consistently in training data (articles, reviews, forums, Wikipedia), the model "knows" you. If not, you don't exist in its base knowledge.
- Retrieval layer — what the AI finds when it searches the web in real time. When web search is enabled, ChatGPT pulls fresh pages. If your site is slow, blocks crawlers, or buries the answer under irrelevant content, the retrieval system skips you.
- Contextual ranking layer — how the AI decides which retrieved results to include in its answer. Even if your page is retrieved, the model may rank a competitor's content higher because it has better structure, clearer entity signals, or more third-party validation.
Your competitors can beat you at any of these layers, and the fix is different for each one. The rest of this article diagnoses which layer is causing your specific problem and gives you the exact fix.
Recognize the symptom: your competitors appear, you don't
The symptom is straightforward. You ask ChatGPT a question that a potential customer would ask about your industry, and the AI names your competitors but not you.
Normal: Your brand appears in at least 3 out of 5 test prompts across multiple AI platforms.
Problem: Your brand appears in 0–1 out of 5 prompts, while competitors appear in 3–5.
To test this quickly, open ChatGPT in incognito mode and run these three prompts (replacing the brackets with your industry):
- "What are the best [your category] companies/tools in 2026?"
- "I need [your category] for [your target audience]. What do you recommend?"
- "Compare the top options for [specific problem you solve]"
If your competitors show up and you don't, you have an AI visibility gap. The question is: which layer is causing it?
ChatGPT now typically names only 3–4 brands per answer, down from 6–7 before the October 2025 entity update (Profound). The available slots are shrinking, which means every month you wait, the gap between you and your competitors widens.
Diagnose which layer is blocking you
Before fixing anything, identify where the breakdown happens. Run these two tests:
Test 1: Parametric check (web search off)
Ask ChatGPT with web search disabled: "What is [your brand] and what does it do?"
- If ChatGPT gives an accurate description, your parametric presence is intact. The problem is at the retrieval or contextual layer.
- If ChatGPT says it doesn't know your brand or gives inaccurate information, your parametric layer is the problem. The AI never learned about you.
Test 2: Retrieval check (web search on)
Ask ChatGPT with web search enabled: "What are the best [your category] companies?"
- If your brand now appears (but didn't appear with web search off), your retrieval layer works but your parametric layer is weak. You depend entirely on real-time retrieval, which is less reliable.
- If your brand still doesn't appear even with web search on, you have a retrieval or contextual ranking problem. The AI either can't find your content or finds it but ranks competitors higher.
| Test result | Layer affected | Priority fixes |
|---|---|---|
| Unknown with search off, absent with search on | All three layers | Entity identity (reason 1), third-party mentions (reason 3) |
| Known with search off, absent with search on | Retrieval + contextual | Site speed (reason 5), crawler access (reason 6), content structure (reason 8) |
| Known with search off, appears with search on but not without | Parametric (weak) | Third-party mentions (reason 3), review platforms (reason 7) |
| Appears in Perplexity but not ChatGPT | Contextual (platform-specific) | Content structure (reason 8), structured data (reason 4) |
Fix reason 1: your brand has no entity identity
Layer: Parametric + Retrieval
AI systems recognize brands as entities, similar to how a database stores records. An entity has attributes: name, category, description, founding date, key products, associated people. If your brand lacks a clear entity definition that appears consistently across the web, the AI doesn't recognize you as a distinct entity worth mentioning.
Your competitors likely have consistent entity signals across their website, social profiles, business directories, and third-party mentions. Their brand name, description, and category are the same everywhere. The AI connects all these mentions and builds a strong entity profile.
How to check (2 minutes): Search "[your brand name]" in Google. Look at the right sidebar (Knowledge Panel). If Google has a Knowledge Panel for your brand, the entity signals are likely adequate. If not, AI systems probably have the same problem recognizing you.
The fix:
- Add Organization schema markup (JSON-LD) to your homepage with: name, description, url, logo, sameAs (linking to all official profiles). See our guide on AEO tools and structured data for implementation details.
- Make your brand description identical on your website About page, LinkedIn, Google Business Profile, Crunchbase, and industry directories. Even small inconsistencies fragment the entity signal.
- If your brand name is a common word or phrase, always pair it with a category descriptor: "[Brand] — [category] for [audience]" in your page titles and meta descriptions.
Binary indicator:
- Entity recognized: Google Knowledge Panel exists, ChatGPT accurately describes your company with web search off
- Entity not recognized: No Knowledge Panel, ChatGPT doesn't know you or confuses you with another company
Fix reason 2: your content doesn't answer the actual question
Layer: Contextual ranking
Your website has content about your industry, but it doesn't directly answer the questions that users ask AI. The AI retrieves your page, scans it, and finds that a competitor's page answers the question more directly.
44.2% of LLM citations come from the first 30% of a page's text (Search Engine Land). If your page opens with company history, a welcome message, or background context before addressing the user's question, the AI may never reach your actual answer.
How to check (3 minutes): Take the three test prompts from the symptom section. Open your most relevant page for each prompt. Read the first two paragraphs. Does the page directly answer the question within those first two paragraphs, or does it start with background information?
The fix:
- Restructure your main service and category pages so the first paragraph answers the most common question about that topic. Put the definition or direct answer first, context second.
- Add an H2 section that matches common AI queries word-for-word. If users ask "What is the best [category] for [use case]?", have a section with an H2 like "Choose the best [category] for [use case]" that gives a direct comparison.
- Write each section so it can stand alone. AI systems extract individual sections, not full pages. If a section requires reading previous sections to make sense, the AI will skip it in favor of a self-contained answer from a competitor. See our complete AEO guide for more on answer-first content structure.
Binary indicator:
- Content aligned: First two paragraphs of your key pages directly answer a user question
- Content misaligned: First two paragraphs contain welcome text, company history, or general background
Fix reason 3: no third parties mention you
Layer: Parametric + Contextual ranking
AI systems weigh third-party mentions heavily when deciding which brands to recommend. If the only source of information about your brand is your own website, the AI treats your claims with lower confidence. Your competitors appear in industry articles, comparison posts, review sites, and forums, which gives the AI multiple independent signals confirming their relevance.
Think of it from the AI's perspective. If 12 independent sources mention Competitor A as a solution for a specific problem, and only your own website mentions your brand, the AI has far more confidence recommending Competitor A.
How to check (3 minutes): Search Google for your brand name with a minus operator: "[your brand]" -site:yourdomain.com. Count the results. Then do the same for your top competitor. If they have 5–10x more third-party mentions, this is likely your primary gap.
The fix:
- Get listed on industry comparison and roundup articles. Reach out to publishers who write "best [category] tools" or "[category] comparison" articles and ask for inclusion. These are exactly the types of articles AI systems retrieve and cite.
- Contribute guest content to industry publications. A bylined article on an industry blog creates a third-party entity mention that AI can discover during retrieval.
- Participate in forums and communities where your target audience asks questions (Reddit, Quora, industry-specific forums). Genuine, helpful answers that mention your product create the kind of distributed mentions that AI systems aggregate. Our guide on how to get recommended by AI covers the full third-party strategy.
- Build profiles on relevant review platforms. This connects to reason 7, but the core principle is the same: AI trusts distributed confirmation over self-reported claims.
Binary indicator:
- Third-party presence: 50+ independent pages mention your brand in relevant context
- Third-party gap: Fewer than 10 independent pages mention your brand
Fix reason 4: your structured data is missing or broken
Layer: Retrieval + Contextual ranking
Structured data (schema markup) is machine-readable code that tells AI systems exactly what your page is about, what your organization does, and how your content relates to entities. Without it, the AI has to infer this information from unstructured text, which is less reliable and slower.
Your competitors may have implemented Organization, Product, FAQ, Article, and Review schema markup that gives AI systems a clean, structured signal about their brand and offerings.
How to check (2 minutes): Paste your homepage URL into Google's Rich Results Test. Check whether Organization, Product, or Article schema is detected. Then check your top competitor's URL. If they have structured data and you don't, this is a contributing factor.
The fix:
- Add Organization schema to your homepage with all required fields (name, url, logo, description, sameAs, contactPoint).
- Add Product or Service schema to your product/service pages with pricing, features, and reviews.
- Add Article schema to your blog posts with author, datePublished, dateModified, and headline.
- Validate all schema with Google's Rich Results Test and Schema.org's validator. Broken schema is worse than no schema because it sends conflicting signals. Check our AEO tools guide for a list of schema validation tools.
Binary indicator:
- Schema present: Rich Results Test shows Organization + at least one content type schema
- Schema absent: Rich Results Test shows no structured data or only basic webpage schema
Fix reason 5: your site is too slow for AI crawlers
Layer: Retrieval
When ChatGPT enables web search, it sends crawlers to fetch pages in real time. These crawlers have timeout limits. If your page takes too long to load, the crawler moves on to the next result. Your competitor's faster page gets retrieved and cited instead.
Pages with First Contentful Paint under 0.4 seconds receive an average of 6.7 citations, compared to 2.1 citations for slower pages (Search Engine Journal, November 2025). Speed is a binary gate: either you load fast enough for the crawler to process you, or you don't.
How to check (1 minute): Run your URL through Google PageSpeed Insights. Check the Time to First Byte (TTFB) and Largest Contentful Paint (LCP). If TTFB exceeds 600ms or LCP exceeds 2.5 seconds, your pages may be too slow for AI crawlers.
The fix:
- Target a TTFB under 400ms. This is the single most important speed metric for AI crawlers, because they need the HTML content, not the visual rendering.
- Enable server-side caching. AI crawlers request the same pages repeatedly. A cached response is delivered in milliseconds.
- Minimize render-blocking resources. The AI crawler needs your content, not your JavaScript animations. Make sure the main content is in the initial HTML response, not loaded via client-side JavaScript.
- Use a CDN if your audience (and AI crawlers) access your site from multiple geographic regions.
Binary indicator:
- Fast enough: TTFB under 400ms, LCP under 2.5s
- Too slow: TTFB over 600ms, or LCP over 4s
Fix reason 6: you block AI crawlers without realizing it
Layer: Retrieval
Your robots.txt file or server configuration may block AI crawlers from accessing your content. Many websites added blocks for GPTBot, ClaudeBot, or other AI user agents during 2023–2024, often through CMS plugins or hosting provider defaults. If AI crawlers can't access your pages, you can't appear in AI answers that use web search.
How to check (1 minute): Open your robots.txt file at yourdomain.com/robots.txt. Search for these user agents: GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Applebot-Extended. If any of these have Disallow: / rules, you're blocking that AI system from crawling your site.
The fix:
- Remove blanket disallow rules for AI crawlers in your robots.txt. If you want AI systems to recommend you, they need access to your content.
- Check for Cloudflare or hosting-level bot blocking. Some security configurations block automated requests, including AI crawlers. Check your server logs for 403 responses to AI user agents.
- If you use WordPress, check your SEO plugin settings. Some plugins added AI crawler blocking as a default or checkbox option.
- You can selectively allow crawling of public content while blocking sensitive pages. Blocking AI entirely is a binary choice between invisibility and potential visibility.
Binary indicator:
- Crawlers allowed: robots.txt permits GPTBot, ChatGPT-User, and PerplexityBot
- Crawlers blocked: robots.txt disallows one or more AI crawlers, or server returns 403 to AI user agents
Fix reason 7: you have no presence on review platforms
Layer: Parametric + Contextual ranking
AI systems pull data from review platforms (G2, Capterra, Trustpilot, Google Reviews, Yelp) as independent trust signals. Reviews create distributed third-party mentions that AI systems aggregate when building entity profiles. Your competitors have dozens or hundreds of reviews on these platforms. You may have none.
How to check (2 minutes): Search "[your brand] reviews" in Google. Check whether you have profiles on the review platforms relevant to your industry. Then check your top competitor. Count their total reviews across platforms versus yours.
The fix:
- Create profiles on the 3–5 review platforms most relevant to your industry. For B2B SaaS: G2, Capterra, TrustRadius. For local businesses: Google Business Profile, Yelp, Tripadvisor. For e-commerce: Trustpilot, Amazon reviews.
- Ask existing customers for reviews. A systematic review collection process (email after purchase/delivery, in-app prompt after positive interaction) builds the review volume that AI systems aggregate.
- Respond to existing reviews, both positive and negative. Active engagement signals that the review profile is maintained, which increases its weight as a trust signal.
- Make sure your brand name on review platforms matches your brand name everywhere else (connecting back to entity identity in reason 1).
Binary indicator:
- Review presence: 20+ reviews across 2+ relevant platforms
- Review gap: Fewer than 5 reviews total, or no profiles on major review platforms
Fix reason 8: your content buries the answer
Layer: Contextual ranking
Your page contains the right information, but it's structured in a way that AI systems can't efficiently extract. Long introductions, walls of text without subheadings, and answers embedded deep in the page all reduce your chances of being cited.
Remember: 44.2% of LLM citations come from the first 30% of page text (Search Engine Land). If your answer lives in the bottom half of the page, you're competing with one hand tied behind your back.
How to check (2 minutes): Open your most important product or category page. Scroll to find where the page first directly answers the question "What do you do and who is it for?" If the answer is below the fold or after more than three paragraphs of introductory text, you have a content structure problem.
The fix:
- Move the direct answer to the first paragraph of every page. State what you do, who it's for, and what makes you different within the first 100 words.
- Use descriptive H2 headings that match user questions. "Choose the best CRM for small teams" is extractable. "Our solutions" is not.
- Break long paragraphs into sections of 100–200 words each. Each section should be understandable on its own, without needing to read what came before it.
- Use tables for any comparison content. AI systems extract tables more reliably than prose comparisons. If you're comparing features, pricing, or options, put it in a table.
- Add bold keywords at the start of important points. This helps AI systems identify the main takeaway of each paragraph.
Binary indicator:
- Content extractable: Direct answer in first paragraph, H2s match user questions, sections are self-contained
- Content buried: Answer below the fold, generic H2s, sections depend on prior context
Fix reason 9: you optimize for Google, not for AI extraction
Layer: All three layers
This is the most common and most misunderstood reason. Many businesses have invested years in SEO and assume that Google rankings translate to AI visibility. They don't. Google rewards signals like backlinks, keyword density, and page experience. AI systems reward signals like entity clarity, source consistency, answer directness, and third-party validation.
The gap shows in the numbers: 89% of B2B buyers now use generative AI for research (Forrester, 2025), AI referral traffic has grown over 300% year-over-year (Search Engine Land, September 2025), and AI-recommended traffic converts at 4.4x the rate of traditional organic traffic (MarTech). Yet over 80% of the pages AI cites are not in Google's top 100 results.
The contrarian reality: a small brand with strong entity signals, clear content structure, and distributed third-party mentions can outperform a large competitor with 10x the domain authority. Google ranking and AI recommendation are different competitions with different winners. Our complete guide to AEO explains why this matters and how the two systems differ at the signal level.
How to check (3 minutes): Compare your Google rankings with your AI visibility. If you rank on page 1 for your target keywords but don't appear in ChatGPT answers for those same queries, you have a gap between your SEO investment and your AI visibility.
The fix:
- Treat AI optimization as a separate channel from SEO. Different signals, different output format, different strategy.
- Audit your content against the other 8 reasons in this article. Most "I rank well but AI ignores me" situations result from a combination of missing entity signals (reason 1), lack of third-party mentions (reason 3), and buried content structure (reason 8).
- Add answer-first structure to your highest-traffic pages. You don't need to rebuild your entire site. Start with the 10 pages that get the most organic traffic and restructure them so the first paragraph directly answers the query they rank for.
- Monitor your AI visibility separately from your SEO rankings. Use the process described in our brand checking guide to track AI visibility on a weekly basis.
Binary indicator:
- Dual optimization: Content structured for both Google rankings and AI extraction
- Single channel: Content optimized only for Google, with no AI-specific structural elements
See how an online school went from 0% to visible in 30 days
An online education company came to Far & Wide after discovering that three direct competitors had 52–62% share of voice in ChatGPT for their target queries, while they had 0% (Far & Wide research, 2026). They ranked well in Google for the same keywords, which made the gap even more frustrating.
We ran the three-layer diagnostic described above and identified the following problems:
- Parametric layer: The brand had limited third-party mentions. Competitors appeared in 15–20 industry roundup articles; the client appeared in 2.
- Retrieval layer: The site loaded in 2.8 seconds (TTFB of 1.1s). AI crawlers were not blocked, but response times were above the threshold for consistent retrieval.
- Contextual ranking layer: Service pages opened with a 400-word company history section before describing what the school actually taught. No Organization schema was implemented.
The fixes focused exclusively on on-site changes (no link building, no PR campaign):
- Restructured the 5 main service pages: moved the answer to the first paragraph, added descriptive H2s, converted comparison prose to tables.
- Implemented Organization, Course, and Review schema across the site.
- Optimized server response time from 1.1s to 340ms TTFB through caching configuration.
- Rewrote the About page to provide a clear, consistent entity definition that matched their Google Business Profile and LinkedIn.
Within 30 days, the school started appearing in ChatGPT responses for 4 of their 7 target queries and generated 20 new leads per month attributed to AI-assisted discovery (Far & Wide research, 2026). The competitors' share of voice dropped to 40–48% as the available answer slots redistributed.
The takeaway: you don't always need a multi-month PR campaign to become visible. Sometimes the problem is purely structural, and on-site changes alone can break through. Full details of this project are in our online school case study.
Avoid these 5 common mistakes when fixing AI visibility
- Publishing more blog posts without restructuring existing content. Volume doesn't improve AI visibility. Structure does. One well-structured page outperforms ten poorly structured ones because AI systems select the best answer, not the most answers.
- Copying competitor content format without matching their entity signals. If your competitor appears in ChatGPT, it's tempting to copy their content structure. But their visibility likely comes from entity authority (third-party mentions, review profiles, consistent brand signals), not just their page layout. Copying the layout without building the entity foundation won't work.
- Treating AI visibility as a one-time project. AI answers change with every session. A brand that appears today may not appear next week if the model updates its retrieval preferences. Monitor your visibility monthly using the process in our brand checking guide and treat this as an ongoing channel.
- Focusing only on ChatGPT and ignoring other platforms. Each AI platform retrieves differently. You might be invisible in ChatGPT but visible in Perplexity, or vice versa:
Platform Primary retrieval method Why you might be visible here but not elsewhere ChatGPT Training data + optional web search (Bing-based) Strong parametric presence from training data Perplexity Always-on web search (multiple search APIs) Strong recent web content, good site speed Gemini Google index integration Strong Google rankings and Google Business Profile Claude Training data primarily, limited web search Strong presence in high-quality training sources Copilot Bing index + GPT-4 Strong Bing rankings and Microsoft ecosystem presence - Blocking AI crawlers for "data protection" and then wondering why you're invisible. You cannot simultaneously prevent AI from accessing your content and expect it to recommend you. If you choose to block AI crawlers, accept that AI invisibility is the trade-off. This is a business decision, not a technical problem.
Calculate what AI invisibility costs you
AI invisibility has a concrete cost that you can estimate with three inputs:
Step 1: Estimate the monthly AI-driven searches in your category. Take your category keyword search volume from Google (available in any SEO tool) and multiply by 12–15%. AI search traffic has grown over 300% year-over-year (Search Engine Land, September 2025), and the share of queries shifting to AI continues to increase.
Step 2: Multiply by your average conversion rate, then multiply by 4.4x. AI-recommended traffic converts at 4.4x the rate of traditional organic traffic (MarTech), because users receive specific recommendations rather than choosing from a list of links.
Step 3: Multiply by your average customer value.
Example calculation:
| Input | Value |
|---|---|
| Monthly Google search volume for your category | 50,000 |
| Estimated AI search share (12–15%) | 6,250 queries |
| Your share if recommended (1 of 3–4 brands = ~25–30%) | 1,563–1,875 visits |
| Conversion rate (traditional 2% x 4.4x AI multiplier) | 8.8% |
| Converted leads per month | 137–165 |
| Average customer value | €500 |
| Monthly revenue from AI channel | €68,500–€82,500 |
The numbers in this example are illustrative. Your actual calculation will depend on your industry, conversion rate, and customer value. But the framework shows why the cost of invisibility grows every month as more users shift queries to AI.
ChatGPT alone has 900 million weekly active users (OpenAI, February 2026). Some of those users are asking about your category right now and hearing your competitors' names instead of yours.
Run the 15-minute self-diagnostic checklist
Use this checklist to identify your specific visibility problems in 15 minutes. Each item maps to one of the 9 reasons above.
Entity identity (reasons 1, 4) — 4 minutes
- Search your brand name in Google. Do you have a Knowledge Panel? (Yes = pass, No = fix reason 1)
- Open your robots.txt. Are GPTBot and ChatGPT-User allowed? (Allowed = pass, Blocked = fix reason 6)
- Run your homepage through Google Rich Results Test. Does Organization schema appear? (Yes = pass, No = fix reason 4)
- Compare your brand description on your website, LinkedIn, and Google Business Profile. Are they identical? (Identical = pass, Different = fix reason 1)
Content structure (reasons 2, 8) — 4 minutes
- Open your main service page. Does the first paragraph directly answer what you do and who it's for? (Yes = pass, No = fix reasons 2 and 8)
- Check your H2 headings. Do they describe actions or answers, or are they generic labels like "Our Services"? (Action-oriented = pass, Generic = fix reason 8)
- Can each section of your main pages be understood without reading previous sections? (Yes = pass, No = fix reason 2)
Technical access (reasons 5, 6) — 3 minutes
- Run your homepage through PageSpeed Insights. Is TTFB under 400ms? (Under 400ms = pass, Over 600ms = fix reason 5)
- Check your server logs or Cloudflare dashboard. Are AI crawlers receiving 200 responses? (200 = pass, 403/429 = fix reason 6)
Third-party validation (reasons 3, 7) — 4 minutes
- Search
"[your brand]" -site:yourdomain.comin Google. Do you have 50+ results? (50+ = pass, Under 10 = fix reason 3) - Check your review platform presence. Do you have 20+ reviews on 2+ platforms? (Yes = pass, No = fix reason 7)
- Search your brand name on ChatGPT with web search disabled. Does it know you? (Accurate description = pass, Unknown = fix reasons 1 and 3)
Scoring:
- 10–12 passing: Your foundation is strong. Focus on content structure and ongoing monitoring.
- 6–9 passing: You have specific gaps. Fix them in priority order: entity identity first, then content structure, then third-party validation.
- 0–5 passing: You have a systemic visibility problem. Start with reasons 1 (entity), 6 (crawler access), and 5 (speed) because they are binary gates that block everything else.
Find out exactly why AI ignores your brand
A Far & Wide Brand Visibility Report (€80) tests your brand across 10 real customer queries on ChatGPT, audits your homepage across 9 technical parameters and 8 content criteria, and delivers 10 prioritized recommendations. One report, one fee, no subscription.
Get your report