webcrawl-mcp

webcrawl-mcp

3.5
browser_automation

The MCP-Server-Template project builds a Model Context Protocol server facilitating web crawling via a unified server architecture. It integrates with any MCP-compliant client and offers modern and legacy transport methods.

Top Comments

MCP-Server-Template

This repository implements a Model Context Protocol (MCP) server for web crawling capabilities, providing tools for any MCP-compliant client. Features include a unified server architecture with centralized configuration. Key components comprise the server integration with Express and MCP capabilities, organized routing for API and MCP endpoints, and business logic through controllers.

Quick Start

Using Docker

Start with Docker by running docker-compose up --build.

Running Locally

  1. Install dependencies.
  2. Define environment variables.
  3. Start the server.

API Endpoints

  • MCP Streamable HTTP (Recommended): /mcp/v2
  • MCP SSE (Deprecated): /mcp/sse
  • API Endpoints: /api/health, /api/version

Key Components

  • Server: Express and MCP server integration.
  • Routes: Organized for API and MCP endpoints.
  • Controllers: Handle business logic.
  • Configuration: Centralized with module-specific settings.
  • MCP Transport: Modern Streamable HTTP and legacy SSE support.