How to add an MCP server to AnythingLLM

AnythingLLM reads its MCP servers from anythingllm_mcp_servers.json in the AnythingLLM storage plugins directory and connects to them over stdio (a local process), Streamable HTTP and HTTP+SSE. 123,389 of the 123,389 servers we can write a config for work in it.

A local server

A local server runs on your machine, started by AnythingLLM from its package. It needs Node.js installed first. For example, Azure MCP Server goes in anythingllm_mcp_servers.json in the AnythingLLM storage plugins directory:

{
  "mcpServers": {
    "azure": {
      "command": "npx",
      "args": ["-y", "@azure/[email protected]", "server", "start"]
    }
  }
}

Every step for this server in AnythingLLM

A remote server

A remote server runs on its publisher's machines, and AnythingLLM connects to its address. Nothing needs installing. For example, Context7 goes in anythingllm_mcp_servers.json in the AnythingLLM storage plugins directory:

{
  "mcpServers": {
    "context7": {
      "type": "streamable",
      "url": "https://mcp.context7.com/mcp"
    }
  }
}

Every step for this server in AnythingLLM

Which servers work in AnythingLLM

AnythingLLM can send a key in a header, so the 3,272 servers that need one work in it.

Runs	Servers	In AnythingLLM?
Local (stdio)	85,197	Works
Remote, Streamable HTTP	31,209	Works
Remote, Streamable HTTP, key in a header	3,225	Works
Remote, HTTP+SSE	3,711	Works
Remote, HTTP+SSE, key in a header	47	Works

If the server does not show up

Matches the official docs The configs follow AnythingLLM's MCP docs, read on 2026-11-01.

AnythingLLM on plug.directory · Best MCP servers for AnythingLLM