Steps
- Open the settings of the page you want to change.
- Find Let AI assistants read this page.
- Turn it on to allow AI crawlers. Turn it off to disallow them.
What each choice does
Allow is the default. AI crawlers can read the page, its llms.txt file and its structured data.
Disallow sends the noai signals for that page. These signals ask AI crawlers not to use the page. Each crawler decides whether to follow them.
One policy per page
You set the policy for each page, not once for your account. A change on one page leaves your other pages as they are.
Premium includes up to 5 pages, and each page has its own policy.
AI crawler visits
Your analytics show how often AI crawlers read your page. Check this number before and after you change the policy.
AI assistants answer questions about you from what they can read. Think about this before you disallow.
Questions about this
Is the policy for my whole account?
No. Each page has its own policy. You choose allow or disallow for each page.
Feature page: AI-native pages
Open the feature page