robots txt checker for Zed
io.github.ryuamarines/robots-txt-checker
Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).
client:Zed
transport:streamable-http
tools:1
Install robots txt checker in Zed
~/.config/zed/settings.json · windows: %APPDATA%\Zed\settings.json
{
"context_servers": {
"robots-txt-checker": {
"url": "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
}
}
}
Merge this into your existing settings object — do not replace the file. Zed docs