Skip to content
LangChain

Merge Datasets & Remove Duplicates for LangChain

io.github.nero-engine/dataset-merge-dedupe

Merge many Apify datasets, CSV files and Google Sheets into one list with duplicates removed.

client:LangChain transport:streamable-http

Install Merge Datasets & Remove Duplicates in LangChain

pip install langchain-mcp-adapters

from langchain_mcp_adapters.client import MultiServerMCPClient

client = MultiServerMCPClient({
        "dataset-merge-dedupe": {
            "transport": "streamable_http",
            "url": "https://mcp.apify.com/?tools=nerolabs/dataset-merge-dedupe",
        }
})

tools = await client.get_tools()

get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs

Merge Datasets & Remove Duplicates in other clients