web_crawl_async — robotbase content MCP Tool
web_crawl_async
(web crawl async) is one of 35 tools on the
robotbase content
MCP server. Connect the server and your client discovers it on the handshake.
by client
How to call web_crawl_async from your client
- Claude Code robotbase content web_crawl_async run in your project directory
- Claude Desktop robotbase content web_crawl_async ~/Library/Application Support/Claude/claude_desktop_config.json
- Cursor robotbase content web_crawl_async ~/.cursor/mcp.json
- VS Code robotbase content web_crawl_async .vscode/mcp.json
- Zed robotbase content web_crawl_async ~/.config/zed/settings.json
- Windsurf robotbase content web_crawl_async ~/.codeium/windsurf/mcp_config.json
- Cline robotbase content web_crawl_async ~/Library/Application Support/Code/User/globalStorage/saoudrizwan.claude-dev/settings/cline_mcp_settings.json
- Gemini CLI robotbase content web_crawl_async ~/.gemini/settings.json
- Grok robotbase content web_crawl_async .mcp.json (in your project root)
- ChatGPT robotbase content web_crawl_async Settings → Connectors → Advanced → Developer mode
- Claude.ai robotbase content web_crawl_async Settings → Connectors → Add custom connector
- LangChain robotbase content web_crawl_async pip install langchain-mcp-adapters
Fastest route
claude mcp add --transport http robotbase-content https://content.robotbase.cc/mcp
Other tools on this server
- web_search
- web_fetch
- web_screenshot
- web_map
- web_fetch_batch
- web_feed
- web_metadata
- web_crawl
- web_extract
- web_act
- web_crawl_job
- web_extract_schema
- web_diff
- web_monitor_set
- web_monitor_list
- web_monitor_delete
- social_hot
- attention_trend
- cyberlibrary_book_meta
- cyberlibrary_fulltext_search
- cyberlibrary_search_books
- cyberlibrary_search_passages
- cyberlibrary_semantic_search
- cyberlibrary_rag_context
- cyberlibrary_get_chapter
- cyberlibrary_get_markdown
- cyberlibrary_catalog_index
- cyberlibrary_get_toc
- cyberlibrary_cite
- cyberlibrary_verify_quote
- cyberlibrary_get_chunks
- cyberlibrary_language_shard
- cyberlibrary_service_info
- cyberlibrary_search
This list was read from the server itself, by connecting to it and calling tools/list on 23 October 2026. It is what
the server actually exposes, not what its listing claims.
Mutating and Read-only are read off each tool's name, not its schema — a hint, not a guarantee. The registry stores tool names only; connect the server for its live schemas.