五款模型生成80款应用,偏好各有不同
Reddit 创作者 u/trez63 连续三周使用同一段提示,让 Claude、ChatGPT、Gemini、Grok 和 Muse 生成无外部库、可离线运行的单文件 HTML 应用,并发布了80个基本未经编辑的结果。创作者称,Claude 偏爱数学和物理玩具,ChatGPT 制作安静的生产力工具,Muse 偏向家庭实用工具,Grok 经常使用“Forge”后缀,Gemini 则偏好 CamelCase 命名;报告的平均文件大小从 Grok 的12 KB到 ChatGPT 的44 KB不等。这项实验来自单个创作者的自述,部分应用获得过后续提示,另有部分定时任务因额度或错误未完成。
这一对照直观展示了五款 AI 模型面对相同开放式编程请求时的偏好差异,但属于社区观察,而非严格受控的基准测试。
The scheduled prompt is the same every day: you’re in a coding contest, write one self-contained HTML file, no libraries, no network, you pick what to build, and it can’t repeat anything you’ve built before. No follow-ups, no fixes. Whatever comes back gets published but in a few cases I asked for some added vibe coding post generation.
Models: Claude, ChatGPT, Gemini, Grok, Muse. 80 apps so far. Things I didn’t expect:
Left alone, they each pick a lane.
- Claude builds math and physics toys: a wave tank, a spectrogram you draw on, an orrery, a Hilbert curve explorer.
- ChatGPT builds calm productivity tools with one-word names: Tradeoff, Stillpoint, Backplan, Draftloom.
- Muse builds household utilities: a budget, a pantry tracker, a meeting cost meter.
- Grok has named 5 of its 9 apps “something-Forge”: PulseForge, DealForge, CanvasForge, FlowForge, PipelineForge.
- Gemini does CamelCase compounds: ChromaWave, KanbanFlow, DocuForge, LoadMaster.
They size the job very differently. Same prompt, average file size: ChatGPT 44 KB, Claude 36 KB, Muse 21 KB, Gemini 17 KB, Grok 12 KB.
I did have it focus on productivity and business apps for a week but I then removed that restriction as it was getting very boring.