Skip to content

robots txt checker for Zed

io.github.ryuamarines/robots-txt-checker

Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).

client:Zed transport:streamable-http tools:1

Install robots txt checker in Zed

~/.config/zed/settings.json · windows: %APPDATA%\Zed\settings.json

{
  "context_servers": {
    "robots-txt-checker": {
      "url": "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
    }
  }
}

Merge this into your existing settings object — do not replace the file. Zed docs

What Zed can do once it is connected

robots txt checker in other clients