Local RAG Server

Example Use Cases

• 1

  Query and chat with local PDF and DOCX documents without internet access.

• 2

  A privacy-focused document search solution running entirely offline on Windows.

• 3

  A lightweight, easy-to-setup local server with a web interface for document interaction.

Description

local-rag-server allows users to chat with and search PDF and DOCX documents entirely offline on their Windows PC. It uses lightweight llama.cpp GGUF models and a Qdrant vector database to provide fast, private, and efficient document querying through a simple web interface. No cloud access or internet connection is required after installation, ensuring user privacy and ease of use.