Web Content Analyzer

Example Use Cases

• 1

  Fetch and convert web pages into clean, structured markdown suitable for downstream analysis or indexing.

• 2

  Answer user questions about a specific web page by retrieving the most relevant content and using OpenAI models to generate concise responses.

• 3

  Integrate web content extraction and Q&A into developer workflows or IDEs (Claude Desktop, VS Code, Cursor, JetBrains).

Description

Web Analyzer MCP is a FastMCP-based server that scrapes web pages (including JavaScript-driven sites via Selenium), filters out noise (ads/navigation), ranks essential content, and converts results into structured markdown. It also offers a RAG-style Q&A tool that chunks content, selects relevant context, and generates answers using OpenAI models. The server is optimized for developer workflows with multi-IDE integration and supports multiple GPT model choices for flexible accuracy and cost trade-offs.