seo-mcp-tools
2
SEO MCP Tools is a server providing tools to analyze robots.txt files for SEO purposes, allowing users to extract sitemap URLs effectively. It operates as a Model Context Protocol (MCP) server, using regex and HTTP requests for parsing data.
SEO MCP Tools
A Model Context Protocol (MCP) server that offers SEO tools specifically for analyzing robots.txt
files. The main features include extracting the first sitemap URL and all sitemap URLs from robots.txt
files.
Features
- Extract the first sitemap URL from a
robots.txt
file. - Extract all sitemap URLs from a
robots.txt
file.
Requirements
- Python 3.8+
- FastMCP
- advertools
- requests
- pandas
Installation
- Clone the repository.
- Install the required dependencies.
Usage
Start the server and utilize the tools using the MCP client to extract sitemap URLs from specified robots.txt
files.
Testing
Run tests to verify server functionality and ensure proper operation with real-world robots.txt
files.