robotstxt ai for Claude Code

io.github.sharozdawa/robotstxt-ai

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.

client:Claude Code transport:stdio runtime:npm

Install robotstxt ai in Claude Code

run in your project directory

claude mcp add robotstxt-ai -- npx -y robotstxt-ai-mcp

Adds it for this project only. Append --scope user to make it available everywhere. Claude Code docs