About AEOAuditBot

AEOAuditBot fetches a website only when someone asks for an audit of it on this site. It is not a general web crawler and doesn't follow links beyond the audited site.

What does it fetch?

For one audit: the homepage, /robots.txt, /llms.txt, the XML sitemap (and up to two child sitemaps) and up to five other pages, at most three requests at a time. It also requests the homepage once with ChatGPT's published browsing user agent, to test whether a firewall treats AI assistants differently from normal visitors. A domain audited in the last hour is answered from a short-lived cache instead of being fetched again.

It reads public pages only. It never logs in, submits forms, or probes for vulnerabilities.

How do I block it?

Block the user agent AEOAuditBot in your firewall. Because an audit is a one-off check of what crawlers see, it reads robots.txt to report on it rather than to decide what to fetch.

Questions or concerns? See our terms and contact details.