jcrawl4ai-mcp-server

jcrawl4ai-mcp-server

3.5
browser_automation

jcrawl4ai-mcp-server is a Java-based MCP server using Spring Boot to interface with the Crawl4ai API. It is designed for web crawling tasks, allowing users to specify URLs, strategies, and retrieve results based on task IDs.

Top Comments

Project Overview

jcrawl4ai-mcp-server is a Spring Boot-based MCP server that interacts with the Crawl4ai API to perform web crawling. The main functionalities include:

  • Crawling specified URLs using a given strategy, maximum depth, and output format.
  • Getting the crawl result by a given task ID.

Configuration

application.properties

Configure the following properties in the src/main/resources/application.properties file:

  • cawl4ai.base-url: Base URL of the Crawl4ai server.
  • cawl4ai.api-token: API token for the Crawl4ai server.

Dependencies

The project depends on the following libraries:

  • Spring AI MCP Server
  • Spring Boot
  • Hutool

APIs

Crawl4aiApi

crawl Method
  • Description: Call the Crawl4ai API to crawl the specified URLs.
  • Parameters:
    • urls: Array of target website URLs.
    • strategy: Crawl strategy.
    • max_depth: Maximum depth.
    • output_format: Output format.
task Method
  • Description: Get the crawl result by a given task ID.
  • Parameters:
    • taskId: Task ID.

Logging

Log file path: ./target/mcp-stdio-server.log.