Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

GLM-Omni Research Tests Knowledge Transfer From Images to Language

AI summary

A joint Tsinghua University and Zhipu AI paper disclosed the previously unreleased internal model GLM-Omni, with Zhipu chief scientist Tang Jie as corresponding author. In the MagicWorld experiments, GLM-Omni achieved 54% average visual-generation accuracy but only 14.57% on text answers; interleaved image-text alignment raised text accuracy to 26.86%, while Visual Chain-of-Thought further raised it to 41.14%. The paper did not establish which product version, if any, corresponds to GLM-Omni.

In-depth insight

The paper provides concrete evidence that visual generation training does not automatically make knowledge available to language responses, while joint image-text training and generating images before answering improved performance in controlled experiments.

导语:图像生成正确率 54%,文字问答仅 14.57%。

GLM-5.5 要来了?唐杰最新论文,曝出智谱神秘模型

图像生成正确率 54%,文字问答仅 14.57%。

    作者丨郑佳美

    编辑丨岑   峰

智谱内部的 GLM-Omni,先在一篇论文里露了面。

#Tsinghua University#Zhipu AI#GLM-Omni#GLM-4.1V-Thinking#X-Omni#MagicWorld#BAGEL#ByteDance#SenseNova-U1#SenseTime

Original · 8 min readRead the original
Group chat

No comments yet. Start the conversation.