Loading connector details…
Loading connector details…
Choose a unique username to continue using AgentHotspot
by DevEnterpriseSoftware • Documentation & Docs
A versatile server for using the ScrAPI service to scrape web pages and extract data efficiently.
Extract HTML content from websites with advanced protection measures.
Convert webpage data into Markdown format for easy consumption.
Flexible deployment options for web scraping services.
The ScrAPI MCP Server facilitates web scraping by providing an easy-to-use interface for extracting HTML and Markdown content from websites, even when they are protected with advanced measures like bot detection or captchas. It serves as a reliable solution for developers needing to integrate web data extraction into their projects. The server is available for use both on-premise and in the cloud, offering flexible deployment options.
Use a URL to scrape a website using the ScrAPI service and retrieve the result as HTML. Use this for scraping website content that is difficult to access because of bot detection, captchas or even geolocation restrictions. The result will be in HTML which is preferable if advanced parsing is required. BROWSER COMMANDS: You can optionally provide browser commands to interact with the page before scraping (e.g., clicking buttons, filling forms, scrolling). Provide commands as a JSON array string. Available commands: - Click: {"click": "#buttonId"} - Click an element using CSS selector - Input: {"input": {"input[name='email']": "value"}} - Fill an input field - Select: {"select": {"select[name='country']": "USA"}} - Select from dropdown - Scroll: {"scroll": 1000} - Scroll down (negative values scroll up) - Wait: {"wait": 5000} - Wait milliseconds (max 15000) - WaitFor: {"waitfor": "#elementId"} - Wait for element to appear - JavaScript: {"javascript": "console.log('test')"} - Execute custom JS Example: [{"click": "#accept-cookies"}, {"wait": 2000}, {"input": {"input[name='search']": "query"}}]
Use a URL to scrape a website using the ScrAPI service and retrieve the result as Markdown. Use this for scraping website content that is difficult to access because of bot detection, captchas or even geolocation restrictions. The result will be in Markdown which is preferable if the text content of the webpage is important and not the structural information of the page. BROWSER COMMANDS: You can optionally provide browser commands to interact with the page before scraping (e.g., clicking buttons, filling forms, scrolling). Provide commands as a JSON array string. Available commands: - Click: {"click": "#buttonId"} - Click an element using CSS selector - Input: {"input": {"input[name='email']": "value"}} - Fill an input field - Select: {"select": {"select[name='country']": "USA"}} - Select from dropdown - Scroll: {"scroll": 1000} - Scroll down (negative values scroll up) - Wait: {"wait": 5000} - Wait milliseconds (max 15000) - WaitFor: {"waitfor": "#elementId"} - Wait for element to appear - JavaScript: {"javascript": "console.log('test')"} - Execute custom JS Example: [{"click": "#accept-cookies"}, {"wait": 2000}, {"input": {"input[name='search']": "query"}}]
Scores are informational only and provided “as is” without warranty. AgentHotspot assumes no liability for actions taken based on these ratings.