MCP Smart Crawler

MCPOpen SourceMIT26.0

by loo-y • Workflow & Task Management

An MCP server that uses Playwright to crawl Xiaohongshu posts, extract metadata, and download images and videos for use by agents.

Example Use Cases

1
Fetch and summarize the content (title, description) of Xiaohongshu (小红书) posts to provide contextual responses.
2
Download and serve images and videos from Xiaohongshu share links for further analysis or presentation.
3
Playwright-based web crawling integrated into an MCP workflow to supply real web context and resources to downstream models.

Description

MCP Smart Crawler is a Model Context Protocol (MCP) server which uses Playwright to automate browsing, scrape metadata (title, description, images) from Xiaohongshu (小红书) posts, and download linked media such as videos and images. It provides an example MCP client configuration (npx) to integrate crawling and media retrieval into agent workflows. The server is useful for supplying up-to-date web content and resources as context for language models and other agents.

Quick Actions

View on GitHub

Security

Scanned 2 month(s) ago

Risk Level

MINIMAL

Read-only data retrieval, no side effects

Trust Score

D44/100

4/17 checks passed

Scores are informational only and provided “as is” without warranty. AgentHotspot assumes no liability for actions taken based on these ratings.

Quick Stats

Service TypeMCP

Pricing ModelUnknown

Capabilities0 Tools / 0 Prompts / 0 Resources

Ownerloo-y

CategoryWorkflow & Task Management

DependenciesStandalone