What our checker reads.

AI Search Watch checks a selected public URL and its robots.txt. It identifies itself as AgentsOX-AISearchWatch/1.0, limits page size and redirects, and uses bounded requests. Paid monitoring runs daily for each selected URL.

We read published crawler rules and indexing directives. Our request comes from Cloudflare’s network, not a verified OpenAI, Google, Anthropic or Perplexity crawler. A successful probe does not prove a crawler visited; a firewall challenge does not prove it is blocked.

Our report suggests changes. You decide which restrictions are intentional and whether to change your website. For questions or to report unwanted checks, email ai-search-watch@agentsox.com.

Back to the checker