PyAutoGUI MCP Server

Example Use Cases

• 1

  Programmatically control mouse and keyboard to interact with desktop applications (click, double-click, drag, type, and press hotkeys).

• 2

  Capture screenshots, inspect pixel colors, and query screen resolution or mouse position for vision-based or UI-aware automation.

• 3

  A simple stdio-based MCP integration to add desktop automation capabilities to AI workflows or Claude Desktop setups.

Description

This server exposes PyAutoGUI functionality over an MCP (Model Context Protocol) stdio transport, allowing clients to perform clicks, drags, typing, hotkeys, scrolling, screenshots, and pixel color queries. It is intended for developers and AI systems that need to automate desktop workflows reliably and simply, and can be integrated with tools like Claude Desktop. The package is installable via pip and requires Python 3.11+; appropriate OS permissions may be necessary for input/screen access.