Higress AI Gateway

Example Use Cases

• 1

  Call various AI tools and services through hosted MCP servers with unified authentication and observability.

• 2

  Connect to multiple LLM model providers with multi-model load balancing, token rate limiting, and caching.

• 3

  A feature-rich Kubernetes ingress controller or microservice gateway with deep integration to service registries and security features.

Description

Higress is a cloud-native API gateway built on Istio and Envoy, extendable with Wasm plugins in Go, Rust, or JS. It supports hosting MCP (Model Context Protocol) servers, enabling AI agents to call various tools and services easily. Higress provides unified management for LLM and MCP APIs, with features like unified authentication, rate limiting, audit logs, and observability. It is production-grade, supports streaming processing, and offers easy extensibility and security features.