MCP Web Integration

Example Use Cases

• 1

  Perform web searches and retrieve formatted search results (title, URL, description) from a SearxNG instance with configurable result limits and time-range filters.

• 2

  Crawl web pages and extract main content, internal/external links, and metadata using Crawl4AI with options for caching, timeouts, and headless browsing.

• 3

  Integrate web search and crawling into MCP workflows while customizing request headers, handling errors, and applying content length/word-count thresholds.

Description

This MCP server bundles web integration tools to let agents perform privacy-respecting web searches via SearxNG and extract page content and links using Crawl4AI. It supports configurable search result counts, time-range filtering, content extraction options, caching modes, custom HTTP headers, and error reporting. The package is intended to be run as an MCP server and integrated with the MCP Inspector or other MCP tooling for agent use.