AI Crawler Checker — Robots.txt Policy for Six Bots for Zed
io.github.kriton-dev/ai-crawler-access-check
Check declared robots.txt permissions for six AI crawlers at URL paths
client:Zed
transport:streamable-http
Install AI Crawler Checker — Robots.txt Policy for Six Bots in Zed
~/.config/zed/settings.json · windows: %APPDATA%\Zed\settings.json
{
"context_servers": {
"ai-crawler-access-check": {
"url": "https://mcp.apify.com/?tools=hermeskd/ai-crawler-access-check"
}
}
}
Merge this into your existing settings object — do not replace the file. Zed docs