nowledge
The Nowledge MCP Server is designed to fetch web content from any public URL via the Model Context Protocol, converting it into Markdown for various output formats. It focuses on performance with features such as fast crawling and HTML sanitization.
Top Comments
Nowledge MCP Server
This is the official Nowledge MCP Server. It enables web content fetching by taking a web URL via the Model Context Protocol (MCP), crawling relevant pages, converting them to Markdown, and providing outputs as either a single document or a list of pages.
Features
- Web-wide content fetching from public URLs
- HTML sanitization by removing unnecessary elements
- Link rewriting for enhanced Markdown integration
- Offers multiple output formats
- Fast performance with adjustable concurrency and depth
- NLP capabilities for search
Usage
Prompts include fetching documentation using URLs or specifying libraries/repository names. Various configurations can be set for crawling depth and concurrency to optimize performance.
Configuration
The server allows configuration via environment variables such as maximum concurrency, request timeout, retries, and retry delay.
Docker Deployment
Docker images can be built and run for both development and production use, with configuration through environment variables.
Development
Instructions are provided for local development, including installation of dependencies, running in development mode, testing, and linting.
See my other projects
Check out more projects such as AI Prompts, codefetch, and aidex on GitHub.