LLMentions
Audit checks · bot_treated_differently

Homepage treats AI bots differently

Homepage responds differently to an AI bot's user agent: why it keeps you out of AI answers and how to fix it. Audit check bot_treated_differently (warning).

↓ Markdown for agents
Check id
bot_treated_differently
Severity
warning
Tool
site_audit

Many CDNs and WAFs ship one-click "block AI bots" rules. If your homepage returns a challenge, an error or different content to an AI user agent, the engines see that instead of your site.

How to fix it

Check your CDN/WAF bot rules (e.g. Cloudflare 'Block AI bots'). Real bots are also verified by IP, so confirm in your server logs with bots_report.

How LLMentions checks it

site_audit crawls your site the way AI bots do (raw HTML, no JavaScript), reads robots.txt for every known AI and search bot, and renders a few pages in a real browser for comparison. This check reports as bot_treated_differently with severity warning, which fails CI with --fail-on warning.

terminal
llmentions audit example.com

The result lists every issue with the pages affected, most severe first, and what changed since your last audit. See the site audit guide.