mcp-server-webscan

mcp-server-webscan

7
browser_automation

The MCP Webscan Server is a Model Context Protocol server designed for web content scanning and analysis. It offers tools to fetch, analyze, and extract web page information, supporting tasks like page fetching, link extraction, and sitemap generation.

MCP Webscan Server

A Model Context Protocol (MCP) server for web content scanning and analysis, providing tools for fetching, analyzing, and extracting information from web pages.

Features

  • Page Fetching: Convert web pages to Markdown for easy analysis
  • Link Extraction: Extract and analyze links from web pages
  • Site Crawling: Recursively crawl websites to discover content
  • Link Checking: Identify broken links on web pages
  • Pattern Matching: Find URLs matching specific patterns
  • Sitemap Generation: Generate XML sitemaps for websites

Installation

Installing via Smithery

To install Webscan for Claude Desktop automatically via Smithery.

Usage

Starting the Server

The server runs on stdio transport, making it compatible with MCP clients like Claude Desktop.

  1. fetch-page Fetches a web page and converts it to Markdown.
  2. extract-links Extracts all links from a web page with their text.
  3. crawl-site Recursively crawls a website up to a specified depth.
  4. check-links Checks for broken links on a page.
  5. find-patterns Finds URLs matching a specific pattern.
  6. generate-site-map Generates a simple XML sitemap by crawling.

Development

  • Node.js >= 18
  • npm

Building

To build the project, run npm run build.