AI-Cursor-Scraping-Assistant
If you are the rightful owner of AI-Cursor-Scraping-Assistant and would like to certify it and/or have it hosted online, please leave a comment on the right or send an email to henry@mcpreview.com.
AI-Cursor-Scraping-Assistant is a tool that uses Cursor AI and MCP to generate web scrapers for various websites.
AI-Cursor-Scraping-Assistant is a powerful tool designed to simplify the process of web scraping by leveraging Cursor AI and Model Context Protocol (MCP). It allows users to quickly analyze websites and generate appropriate Scrapy or Camoufox scrapers with minimal effort. The project includes Cursor Rules, which guide Cursor AI in creating different types of Scrapy spiders, and MCP Tools, which enhance Cursor's capabilities for web scraping tasks. The tool is particularly useful for creating scrapers for e-commerce sites, handling both Product Listing Pages (PLP) and Product Detail Pages (PDP). It also integrates with Camoufox to create stealth scrapers that can bypass anti-bot measures. The modular design of the project allows for easy customization and extension to support additional scraper types and features.
Features
- Automated Web Scraper Generation: Quickly generate Scrapy or Camoufox scrapers for various websites.
- Cursor AI Integration: Uses Cursor AI to analyze websites and create scrapers based on predefined rules.
- MCP Tools: Enhances web scraping capabilities with tools for XPath generation and analysis.
- Camoufox Integration: Supports stealth scraping to bypass anti-bot measures.
- Modular Design: Easily extendable to support new scraper types and features.
Tools
- xpath_server.py: MCP server with web scraping tools for generating XPath selectors.
- Camoufox_template.py: Template for creating Camoufox scrapers.
Related MCP Servers
View all browser_automation servers →Fetch
by modelcontextprotocol
A Model Context Protocol server that provides web content fetching capabilities, enabling LLMs to retrieve and process content from web pages.
markdownify-mcp
by zcaceres
Markdownify is a Model Context Protocol (MCP) server that converts various file types and web content to Markdown format.
deepwiki-mcp
by regenrek
This is an unofficial Deepwiki MCP Server that processes Deepwiki URLs, crawls pages, converts them to Markdown, and returns documents or lists by page.
mcp-playwright
by executeautomation
A Model Context Protocol server that provides browser automation capabilities using Playwright.
fetch-mcp
by zcaceres
This MCP server provides functionality to fetch web content in various formats, including HTML, JSON, plain text, and Markdown.
web-eval-agent
by Operative-Sh
operative.sh's MCP Server is a tool for autonomous debugging of web applications directly from your code editor.
cursor-talk-to-figma-mcp
by sonnylazuardi
This project implements a Model Context Protocol (MCP) integration between Cursor AI and Figma, allowing Cursor to communicate with Figma for reading designs and modifying them programmatically.