Skip to content
mcp/harbor
Verified official

Atalaya AI crawler check MCP

v1.1.0 changelog · 1

com.atalaya-ai/ai-crawler-check

Which AI crawlers (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot) a website allows, and why.

transport:streamable-http tools:2
Website

Target client

run in your project directory 

claude mcp add --transport http ai-crawler-check https://atalaya-ai.com/mcp

setup guides: Claude Code Claude Desktop Cursor VS Code Zed Windsurf Cline Gemini CLI Grok ChatGPT Claude.ai LangChain

Adds it for this project only. Append --scope user to make it available everywhere. Claude Code docs

check_ai_crawler_access Read-only

check ai crawler access

list_ai_crawlers Read-only

list ai crawlers

All 2 tools, one page each

Mutating and Read-only are read off each tool's name, not its schema — a hint, not a guarantee. Check the server's own documentation before granting access.