mcp-pyautogui-server

mcp-pyautogui-server

19

The mcp-pyautogui-server is a Model Context Protocol server enabling automated GUI testing and control through PyAutoGUI. It supports mouse and keyboard operations, screen operations, and offers cross-platform compatibility.

Overview

A MCP (Model Context Protocol) server that provides automated GUI testing and control capabilities through PyAutoGUI.

Features

  • Control mouse movements and clicks
  • Simulate keyboard input
  • Take screenshots
  • Find images on screen
  • Get screen information
  • Cross-platform support (Windows, macOS, Linux)

Tools

Mouse Control

  • Move mouse to specific coordinates
  • Click at current or specified position
  • Drag and drop operations
  • Get current mouse position

Keyboard Control

  • Type text
  • Press individual keys
  • Hotkey combinations

Screen Operations

  • Take screenshots
  • Get screen size
  • Find image locations on screen
  • Get pixel colors

Installation

  • Python 3.12+ and PyAutoGUI are required. Dependencies are installed automatically.
  • Install via pip install mcp-pyautogui-server.

Development

  • Sync dependencies, build, and publish to PyPI.
  • Configure debugging with MCP Inspector.