agent-desktop: Computer use for AI agents through the operating system accessibility tree.
What problem it solves AI agents need a way to observe and operate desktop applications through their native user interfaces. agent-desktop provides this interaction model by reading the accessibility tree, returning actionable references in JSON, and allowing agents to verify the result by reading the interface again. Key features Accessibility-tree snapshots with actionable references — Snapshot…
github.comhttps://github.com/vercel-labs/agent-desktop