Momentic发布自主应用QA智能体
Momentic发布Mo,一套可自主规划、探索并测试网页、iOS和Android应用控件与用户流程的智能体框架,并计划支持桌面应用。在Momentic对四个开源应用开展的60分钟厂商测试中,Mo发现269个缺陷,召回率为19.3%、精确率为84%,召回率高于Codex、Claude Code和Devin,但结果未经独立验证。创始人还称,公司已推出针对Vercel和Cloudflare部署预览的拉取请求测试,并为新注册用户提供250美元Mo使用额度。
Momentic正将自主智能体用于多平台端到端QA,但其基准领先和训练规模仍缺乏独立验证。
Hey HN, we’re Wei-Wei and Jeff. We’re building Momentic, QA agents that autonomously plan, explore, and bug-bash controls and user flows in your web, iOS, Android, and (soon) desktop apps to catch bugs.
Here’s a demo: https://youtu.be/BFsM-Se1Fh8
We’re both software engineers that spent our careers on dev tooling and infra across companies like Robinhood, Retool, WeWork, and Qualtrics. Testing was always a pain in the ass (esp Playwright and Selenium), so we built agents to do it for us.
Modern day software has a ton of bugs and the change failure rate is only growing faster as coding agent adoption scales. LLMs are really good at generating code, but reinforce their own assumptions, write a ton of useless tests, and are bad at visual understanding. On DeepSWE v1.1, Sonnet 5.5 hit 66.2% pass rate when banned from writing tests, versus 65.3% when allowed.
OSS end-to-end testing frameworks like Playwright, Selenium, or Maestro force you to hardcode implementation details like XPath, text, or aria-* attributes in your tests. Even with agents, these take a nontrivial amount of time and tokens to build and maintain.