web_crawl — robotbase content MCP Tool
web_crawl
(web crawl) is one of 35 tools on the
robotbase content
MCP server. Connect the server and your client discovers it on the handshake.
by client
How to call web_crawl from your client
- Claude Code robotbase content web_crawl run in your project directory
- Claude Desktop robotbase content web_crawl ~/Library/Application Support/Claude/claude_desktop_config.json
- Cursor robotbase content web_crawl ~/.cursor/mcp.json
- VS Code robotbase content web_crawl .vscode/mcp.json
- Zed robotbase content web_crawl ~/.config/zed/settings.json
- Windsurf robotbase content web_crawl ~/.codeium/windsurf/mcp_config.json
- Cline robotbase content web_crawl ~/Library/Application Support/Code/User/globalStorage/saoudrizwan.claude-dev/settings/cline_mcp_settings.json
- Gemini CLI robotbase content web_crawl ~/.gemini/settings.json
- Grok robotbase content web_crawl .mcp.json (in your project root)
- ChatGPT robotbase content web_crawl Settings → Connectors → Advanced → Developer mode
- Claude.ai robotbase content web_crawl Settings → Connectors → Add custom connector
- LangChain robotbase content web_crawl pip install langchain-mcp-adapters
Fastest route
claude mcp add --transport http robotbase-content https://content.robotbase.cc/mcpOther tools on this server
- web_search
- web_fetch
- web_screenshot
- web_map
- web_fetch_batch
- web_feed
- web_metadata
- web_extract
- web_act
- web_crawl_async
- web_crawl_job
- web_extract_schema
- web_diff
- web_monitor_set
- web_monitor_list
- web_monitor_delete
- social_hot
- attention_trend
- cyberlibrary_book_meta
- cyberlibrary_fulltext_search
- cyberlibrary_search_books
- cyberlibrary_search_passages
- cyberlibrary_semantic_search
- cyberlibrary_rag_context
- cyberlibrary_get_chapter
- cyberlibrary_get_markdown
- cyberlibrary_catalog_index
- cyberlibrary_get_toc
- cyberlibrary_cite
- cyberlibrary_verify_quote
- cyberlibrary_get_chunks
- cyberlibrary_language_shard
- cyberlibrary_service_info
- cyberlibrary_search
This list was read from the server itself, by connecting to it and calling tools/list on 23 October 2026. It is what
the server actually exposes, not what its listing claims.
Mutating and Read-only are read off each tool's name, not its schema — a hint, not a guarantee. The registry stores tool names only; connect the server for its live schemas.