OllaBridge LLM Gateway

Example Use Cases

• 1

  Create enrollment tokens to add new compute nodes securely.

• 2

  List and monitor connected LLM compute nodes.

• 3

  Check the health and status of the LLM gateway.

Description

OllaBridge acts as a centralized control plane that routes requests to multiple LLM compute nodes running anywhere—local machines, cloud GPUs, or remote workstations—without requiring port forwarding or VPNs. It supports secure API key authentication, rate limiting, and encrypted connections, enabling seamless integration with any OpenAI-compatible SDK or tool. The built-in MCP server allows AI agents to manage infrastructure by creating enrollment tokens, listing nodes, and checking gateway health, facilitating scalable and secure LLM deployments.