Skip to content

AgentReadyBot

AgentReadyBot is the scanner behind Index Harmony reports. It only visits a website when someone explicitly submits that site for an audit — it does not crawl the web on its own.

What it does

  • Fetches your homepage, robots.txt, llms.txt, sitemap and a handful of well-known URLs.
  • Repeats the homepage request with common AI bot identities to measure what each one really receives.
  • Sends at most a few dozen requests per scan, one connection at a time, with a 15-second timeout.

User-Agent

AgentReadyBot/1.0 (+https://www.indexharmony.com/agentready/bot)

How to block it

Add this to your robots.txt — AgentReadyBot respects it:

User-agent: AgentReadyBot
Disallow: /

Data & retention

Scan results are stored for 90 days for anonymous scans. Report pages are unlisted (noindex) and reachable only via their link. To remove a report, contact us.