HandsOn Desktop Automation

Example Use Cases

• 1

  Automate desktop applications including legacy apps without APIs.

• 2

  Visually verify and correct their own work on the screen.

• 3

  Interact with UI elements using accessibility trees, OCR, or visual detection.

Description

HandsOn is a Claude Code plugin that allows Claude to see and interact with any application on your desktop using accessibility APIs, OCR, and computer vision. It supports Windows and macOS, enabling automation of legacy apps without APIs, visual verification of tasks, and complex multi-step workflows. The plugin uses a layered targeting strategy for reliable element detection and supports multiple UI frameworks, providing a powerful general-purpose desktop assistant experience.