webSearch-Tools
1
WebSearch is a robust web search and content extraction tool that leverages the Firecrawl API for sophisticated web scraping and analysis. It integrates as a Model Context Protocol (MCP) server, offering features like advanced search, content extraction, and web crawling.
WebSearch - Advanced Web Search and Content Extraction Tool
A powerful web search and content extraction tool built with Python, leveraging the Firecrawl API for advanced web scraping, searching, and content analysis capabilities.
🚀 Features
- Advanced Web Search: Perform intelligent web searches with customizable parameters
- Content Extraction: Extract specific information from web pages using natural language prompts
- Web Crawling: Crawl websites with configurable depth and limits
- Web Scraping: Scrape web pages with support for various output formats
- MCP Integration: Built as a Model Context Protocol (MCP) server for seamless integration
📋 Prerequisites
- Python 3.8 or higher
- uv package manager
- Firecrawl API key
- OpenAI API key (optional, for enhanced features)
- Tavily API key (optional, for additional search capabilities)
🎯 Usage
Setting Up With Claude for Desktop
Instead of running the server directly, you can configure Claude for Desktop to access the WebSearch tools.
Available Tools
- Search
- Extract Information
- Crawl Websites
- Scrape Content
🔧 Configuration
Environment Variables
The tool requires certain API keys to function. A .env.example file is provided as a template.
Getting the API Keys
Configure API keys from services such as OpenAI and Firecrawl to enable features.