Volcano Engine presents OS Agent for computer and mobile UI automation
Volcano Engine presented OS Agent as an execution-oriented AI agent that interprets natural-language goals, plans steps, and operates desktop or mobile interfaces through mouse, keyboard, or touch controls. Its architecture includes Computer Use Agent (CUA) for browsers and desktops and Mobile Use Agent (MUA) for Android apps, with listed use cases including app testing, enterprise application operation, and browser-based information collection. Volcano Engine says online task success rates reached about 95% on mobile and 97% on desktop, though these performance figures and the claimed ability to handle changing interfaces remain vendor-reported and unverified.
OS Agent targets enterprise automation beyond fixed APIs, scripts, and RPA flows, but its vendor-reported metrics, example tasks, and broad interface-operation claims have not been independently confirmed.
01 AI 已经很会思考问题,但为什么还不能把事办完整?
假如你要做这样一个任务:“打开xx APP,查找从昨晚到现在,与某品牌有关的负面内容;并逐条记录内容的标题、发布时间和互动数据;如果有疑似投诉的帖子,需要进入详情页取证;最后,把所有结果汇总成一份舆情简报。”
对人来说,这项任务相当于一串熟悉的操作:打开 APP、搜索关键词、切换排序、滚动页面、进入详情页、截图取证、复制链接、整理结果。但对传统 AI 来说,这里面却隔着一道很现实的鸿沟——它可以告诉你应该怎么做,却未必能替你在真实界面里完成这些动作。
过去,企业主要通过 API、脚本或 RPA 来跨越这道鸿沟。它们能做很多事,但都有各自清晰的适用边界:API 依赖系统开放接口;脚本与 RPA 依赖预先配置的流程和界面元素;一旦面对没有 API 的 APP、频繁变化的页面、长尾操作或需要语义判断的流程,它们的自动化就容易卡住。
#Volcano Engine#OS Agent#Computer Use Agent (CUA)#Mobile Use Agent (MUA)