Vercel Labs Ships agent-desktop for Cross-Platform Computer Use
Vercel Labs has introduced agent-desktop, a CLI and C library that lets AI agents inspect and operate desktop applications through operating-system accessibility trees on macOS, Windows, and Linux. The project documentation says agents can receive actionable JSON references, click or type against them, and re-check the interface, while the tool itself contains no model. It also warns that snapshots, clipboard reads, screenshots, command output, and debug artifacts may expose private desktop content.
agent-desktop offers a model-agnostic interface for building computer-use agents across three major desktop platforms, though its advertised capabilities come primarily from project documentation rather than independent testing.
Computer use CLI for AI agents

https://agent-browser.dev/desktop
agent-desktop
Computer use for AI agents: see and operate desktop apps on macOS, Windows, and Linux through the OS accessibility tree.