What happens when the feature is turned on | Expected effects |
Search engines such as Googlebot and Bingbot visit the site and collect and index page content | May be displayed in search results on Google, Bing, etc. |
AI agents such as ChatGPT and Claude read and navigate public pages | Site content may be reflected in AI search, answers, and recommendation results. |
Provide the site as Markdown documents and RSS feeds in a format that is easy for AI to read. | AI reads content more accurately, improving search result reflection, summary accuracy, and content usability. |
AI and search engines navigate the site structure by following the public page tree | Not only individual pages but the entire site content is better searchable and connected |