Computer Use MCP Server

Example Use Cases

• 1

  Control a desktop environment and interact with GUI apps via VNC and Anthropic's computer-use tools.

• 2

  Drive web automation and scraping using Playwright or Puppeteer over CDP/WebDriver BiDi with a proxied Chromium instance.

• 3

  Record and replay user/browser sessions (rrweb) to debug or reproduce automated interactions.

Description

This project embeds an MCP server into an Anthropic 'computer use' Docker image to expose the three Anthropic computer-use tools via a TypeScript implementation (src/server.ts) and a Dockerfile that installs and runs it. It also adds a Chromium instance and a proxy for Playwright and Puppeteer (CDP/BiDi), a NoVNC/Streamlit UI, and an rrweb-based recorder and viewer for capturing and replaying browser sessions. Designed to be launched as a container and wired into Claude Desktop as an MCP server, it helps agents automate GUI and browser interactions while letting developers observe actions via VNC and proxy logs.