Robots Inspect for LangChain
io.github.sadri-dridi/robots-inspect
Fetch a public robots.txt and return group counts only.
client:LangChain
transport:streamable-http
tools:30
Install Robots Inspect in LangChain
pip install langchain-mcp-adapters
from langchain_mcp_adapters.client import MultiServerMCPClient
client = MultiServerMCPClient({
"robots-inspect": {
"transport": "streamable_http",
"url": "https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-inspect/mcp",
}
})
tools = await client.get_tools()
get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs
What LangChain can do once it is connected
- inspect-robots
- utc-time
- timezone
- validate-json
- normalize-url
- domain-shape
- citation
- compatibility
- status-catalog
- iana-zones
- web-fetch
- fetch-status
- github-repo-shape
- weather-hint
- memory-key-count
- file-path-ok
- browser-url-ok
- think-steps
- search-query-len
- hn-front-count
- lib-docs-hint
- playwright-url-ok
- figma-url-shape
- jira-key-shape