FastAPI BitNet API

Example Use Cases

• 1

  Programmatically control and interact with BitNet model chat sessions.

• 2

  Benchmark and evaluate GGUF models automatically.

• 3

  Integration with VS Code Copilot Chat for enhanced developer workflows.

Description

This MCP server provides a robust REST API for starting, stopping, and managing multiple BitNet model sessions using llama-cli and llama-server. It supports batch operations, interactive chat, model benchmarking, and resource estimation, all containerized with Docker for easy deployment. Additionally, it integrates with VS Code Copilot Chat via the Model Context Protocol for seamless developer experience.