crawl readiness for LangChain
io.github.grubbomatic/crawl-readiness
Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.
client:LangChain
transport:stdio
runtime:npm
Install crawl readiness in LangChain
pip install langchain-mcp-adapters
from langchain_mcp_adapters.client import MultiServerMCPClient
client = MultiServerMCPClient({
"crawl-readiness": {
"transport": "stdio",
"command": "npx",
"args": ["-y", "crawl-readiness-mcp"],
}
})
tools = await client.get_tools()
get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs