AI Crawler Index MCP Tools

• whoami

  whoami

• example

  example

• classify_user_agent

  classify user agent

• lookup_crawler Read-only

  lookup crawler

• list_crawlers Read-only

  list crawlers

• generate_robots_txt

  generate robots txt

• is_verified_crawler_ip

  is verified crawler ip

• whats_changed

  whats changed

• changes_since

  changes since

This list was read from the server itself, by connecting to it and calling tools/list on 24 September 2026. It is what the server actually exposes, not what its listing claims.

Mutating and Read-only are read off each tool's name, not its schema — a hint, not a guarantee. The registry stores tool names only; connect the server for its live schemas.