robots txt checker for ChatGPT

io.github.ryuamarines/robots-txt-checker

Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).

client:ChatGPT transport:streamable-http tools:1

Install robots txt checker in ChatGPT

Settings → Connectors → Advanced → Developer mode

https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp

Custom connectors are a paid-plan feature and take a remote URL only. ChatGPT cannot run a packaged server locally. ChatGPT docs