LLM Router Gateway

Example Use Cases

• 1

  Unify access to multiple LLM providers through a single API endpoint.

• 2

  Protocol translation between OpenAI and Anthropic Messages formats.

• 3

  Smart routing and load balancing across different LLM providers based on tags and load.

Description

LLM Router acts as a single gateway to multiple large language model providers such as OpenAI, Claude, Gemini, Ollama, Mistral, and ZAi. It supports protocol translation between OpenAI and Anthropic Messages formats, weight-based load balancing, and smart routing using customizable scripts. The server also aggregates tools from multiple remote MCP servers with namespace isolation and provides OpenAI-compatible responses and n8n-compatible conversation management APIs. Optional authentication and an admin UI are available for secure and convenient management.