scraperis-mcp

scraperis-mcp

6
browser_automation

Scraper.is MCP is a package integrating Model Context Protocol with the Scraper.is tool, allowing AI assistants to perform web scraping tasks. It supports features such as obtaining web content in various formats and real-time progress updates.

Overview

Scraper.is MCP is a Model Context Protocol (MCP) integration package for Scraper.is, a robust web scraping tool designed for AI assistants. It allows AI assistants to retrieve web content through the MCP protocol, providing up-to-date information from the web.

Features

  • Web Scraping: Extract content from any website
  • Screenshots: Capture visual representations of web pages
  • Multiple Formats: Obtain content in markdown, HTML, or JSON
  • Progress Updates: Real-time progress reporting during scraping operations
  • MCP Integration: Compatible with MCP-supported AI assistants

Prerequisites

  • Obtain a Scraper.is API key to use this package

Usage

  • Set up your environment by creating a .env file with your API key
  • Integrate with Claude Desktop or use the MCP Inspector for development and testing

Installation

  • Use npm or yarn to install the package globally

Development

  • Follow steps to clone the repository, install dependencies, and build the project