humanus.cpp LLM Framework

Example Use Cases

• 1

  Fast, local execution of LLMs with minimal overhead.

• 2

  Standardized tool interaction via the Model Context Protocol (MCP).

• 3

  Modular and extensible architecture to integrate various models and tools.

Description

humanus.cpp is a lightweight, efficient C++ framework designed for creating local large language model (LLM) agents. It features minimal dependencies, cross-platform compatibility, and native support for the Model Context Protocol (MCP) to standardize tool interactions. The framework supports vectorized memory retrieval using HNSW-based similarity search and offers a modular architecture for easy integration of new models, tools, or storage backends. It is ideal for embedded or resource-constrained environments and is actively evolving.