webscraping-ai-mcp-server
9
WebScraping.AI MCP Server is designed to facilitate web data extraction, offering tools for structured, plain text, and HTML content retrieval with advanced features like JavaScript rendering and device emulation. It integrates seamlessly with Model Context Protocol (MCP) enabled platforms to enhance automated data extraction processes.
WebScraping.AI MCP Server
A Model Context Protocol (MCP) server implementation integrating with WebScraping.AI for web data extraction. It offers features such as:
- Question answering about web page content
- Structured and plain text data extraction
- CSS selector-based content extraction
- JavaScript rendering using headless Chrome/Chromium
- Proxy and concurrency management
- Device emulation for desktop, mobile, and tablets
- Account usage monitoring
Configuration
- Requires WebScraping.AI API key
- Optional settings available for concurrency, proxy type, timeout, etc.
Tools
- Question Tool - Questions about web page content
- Fields Tool - Structured data extraction
- HTML Tool - Full HTML retrieval with rendering
- Text Tool - Visible text extraction
- Selected Tool - Content extraction using CSS selector
- Selected Multiple Tool - Multiple CSS selectors
- Account Tool - WebScraping.AI account information
Error Handling
- Automatic retries, rate limit handling, and detailed error messages.
Integration
Compatible with MCP-enabled LLM platforms for web scraping tasks.