robots exclusion rules mcp for LangChain
io.github.mrfentmen/robots-exclusion-rules-mcp
Robots Exclusion Rules MCP: read, check, lint, scaffold and run code.
client:LangChain
transport:stdio
runtime:npm
Install robots exclusion rules mcp in LangChain
pip install langchain-mcp-adapters
from langchain_mcp_adapters.client import MultiServerMCPClient
client = MultiServerMCPClient({
"robots-exclusion-rules-mcp": {
"transport": "stdio",
"command": "npx",
"args": ["-y", "@mrfentmen/robots-exclusion-rules-mcp"],
}
})
tools = await client.get_tools()
get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs