watercrawl-mcp

watercrawl-mcp

3
browser_automationdeveloper_tools

WaterCrawl MCP is a Model Context Protocol server that gives AI systems the ability to perform web crawling, scraping, and search tasks. It offers integration with AI assistants and supports command-line options for configuration and testing. The project is open to contributions.

WaterCrawl MCP

A Model Context Protocol (MCP) server for WaterCrawl, built with FastMCP. This package provides AI systems with capabilities for web crawling, scraping, and search through a standardized interface.

Quick Start

  • Use without installation via npx.
  • Provides API key usage and base-url configuration options.

Installation

  • Available for global or local installation via npm.

Configuration

  • Can be configured using environment variables with options for SSE mode.

Available Tools

  1. Scrape content from a URL.
  2. Perform web searches.
  3. Download sitemaps from crawl requests.
  4. Manage crawl and search requests.
  5. Monitor requests in real-time.

Development and Contribution

  • Project includes testing and development setup instructions.
  • Contributors are welcome.