Skip to content
LangChain

LLM Latency Tracker for LangChain

dev.llmlatency/llm-latency-tracker

Measured latency, time to first token and uptime for ~45 AI inference APIs, by region.

client:LangChain transport:streamable-http tools:2

Install LLM Latency Tracker in LangChain

pip install langchain-mcp-adapters

from langchain_mcp_adapters.client import MultiServerMCPClient

client = MultiServerMCPClient({
        "llm-latency-tracker": {
            "transport": "streamable_http",
            "url": "https://llmlatency.dev/mcp",
        }
})

tools = await client.get_tools()

get_tools() returns the server's tools as LangChain tools, ready for an agent. LangChain docs

What LangChain can do once it is connected

LLM Latency Tracker in other clients