Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Momentic launches autonomous QA agents for apps

AI summary

Momentic launched Mo, a custom agent harness that autonomously plans, explores, and tests app controls and user flows across web, iOS, and Android, with desktop support planned. In a vendor-run 60-minute benchmark on four open-source apps, Mo found 269 bugs at 19.3% recall and 84% precision, ahead of Codex, Claude Code, and Devin on recall, though the evaluation was not independently validated. The founders also said Momentic shipped pull-request testing for Vercel and Cloudflare deployment previews and offered new signups $250 in Mo usage credit.

In-depth insight

Momentic is applying autonomous agents to end-to-end QA across multiple app platforms, but its reported benchmark lead and claimed training scale still require independent validation.

Hey HN, we’re Wei-Wei and Jeff. We’re building Momentic, QA agents that autonomously plan, explore, and bug-bash controls and user flows in your web, iOS, Android, and (soon) desktop apps to catch bugs.

Here’s a demo: https://youtu.be/BFsM-Se1Fh8

We’re both software engineers that spent our careers on dev tooling and infra across companies like Robinhood, Retool, WeWork, and Qualtrics. Testing was always a pain in the ass (esp Playwright and Selenium), so we built agents to do it for us.

Modern day software has a ton of bugs and the change failure rate is only growing faster as coding agent adoption scales. LLMs are really good at generating code, but reinforce their own assumptions, write a ton of useless tests, and are bad at visual understanding. On DeepSWE v1.1, Sonnet 5.5 hit 66.2% pass rate when banned from writing tests, versus 65.3% when allowed.

OSS end-to-end testing frameworks like Playwright, Selenium, or Maestro force you to hardcode implementation details like XPath, text, or aria-* attributes in your tests. Even with agents, these take a nontrivial amount of time and tokens to build and maintain.

#Momentic#Mo#Vercel#Cloudflare#Codex#Claude Code#Devin

Original · 3 min readRead the original
Group chat

No comments yet. Start the conversation.