Crawl4AI-RAG-MCP-Server

Crawl4AI-RAG-MCP-Server

1
browser_automationdatabasesai_chatbot

The Crawl4AI RAG MCP Server is designed to enhance the capabilities of AI agents and AI coding assistants by providing powerful web crawling and RAG functionalities. It allows users to scrape, store, and utilize web content efficiently through a Model Context Protocol implementation. Notable features include intelligent URL handling and parallel page processing.

crawl_single_page`

Quickly crawl a single web page and store its contents into a vector database

smart_crawl_url`

full.txt or regular web pages that require recursive crawling) intelligently crawl the entire website

get_available_sources`

Get a list of all available sources (domain names) in the database

perform_rag_query`

Use semantic search (optional source filtering) to find relevant content