After optimizing our content for GenAI and LLM crawling—using clean semantic structure, FAQ formats, and author attribution—we started showing up more consistently as cited sources in tools like Perplexity and ChatGPT's browsing results. The top result? A noticeable increase in high-intent traffic from branded queries we didn't rank for before. We haven't blocked AI crawlers, but we do monitor them closely to ensure they're not overloading our servers or repurposing content without attribution.
We're seeing a steady increase in traffic from AI assistants like ChatGPT, Perplexity, and Claude. One of the biggest results has been better visibility of our product and docs in natural language responses, which drives high-intent traffic from technical users who are asking real questions. We haven't blocked any AI crawlers. In fact, we do the opposite: we make sure they can crawl our content efficiently by keeping our site fast, well-structured, and easy to parse. Our goal is to meet users where they search, whether that's on Google or in an AI assistant.
Top result after GenAI crawling optimization for us: According to discussions and case studies brought out by our SEO experts, these are some of the top benefits they've seen after GenAI crawling optimization: 1. More "Mention-Based" Visibility Even without a single backlink, certain brands have seen incredible traffic spikes and visibility gains for being simply mentioned in well-crafted content that's easy to extract and summarize for GenAI models. 2. Featured in AI Summaries & Answers Seamless content is likely to be sucked into AI-generated answers on platforms like: - Perplexity.ai summaries, - ChatGPT web search answers (if active), - Google AI summaries (SGE), seeing more exposure than usual search snippets. 3. More Top-of-Funnel Engagement Topical hubs or FAQs with clearly constructed, authoritative websites are likely to get more engagement from "AI-referred" traffic — particularly users looking for thorough, trustworthy information. 4. Faster Indexation by AI-Powered Tools Some publishers noticed that optimized sites with good semantic markup (e.g., schema.org, proper heading structure, and alt text) are crawled and indexed more deeply by LLMs with browser access or API. We haven't blocked AI crawlers at all, because SEO is one of the most important marketing strategy for us and, since GenAI is getting popular, we also rely on it to get our products sale.
Our website has a large section with top-of-funnel informational content, and we've found that a lot of this content gets picked up by LLMs and AI summaries, like the one Google displays above the search results. We've seen a surprising amount of traffic from these sources, and it's increasing every week, which suggests this could eventually become a larger channel than organic search.
At Cafely we've taken explicit steps to make our site more accessible for GenAI tools like ChatGPT. Our biggest success is how we can now reliably trace AI-generated recommendations for our business among new customers who have only recently come across us. These are people who have asked for the best Vietnamese coffee or authentic specialty brews, and our brand has naturally appeared in those answers. That organic mention is irreplaceable as it's like a trusted word-of-mouth referral. To help with this, we've directed our attention to clear, conversational product pages together with up-to-date FAQs that LLMs can easily parse. Focus has shifted from "optimizing for Google" to writing content that really answers the questions that people may ask to an AI. So far we haven't blocked any AI crawlers because for us, the exposure outweighs any risk of scraped content, though I do keep an eye on it. But I'd reconsider if an AI tool started using our content in a way that misrepresented our brand or hurt our SEO.
Optimizing a website for generative AI and large language models can significantly boost visibility, engagement, and conversions. Enhanced crawling leads to increased re-indexing by search engines, showcasing more relevant content. For example, a technology review site that used structured data markup and improved content clarity saw a notable rise in search visibility, especially in featured snippets and "People also ask" sections on Google.