SenseNova 发布 Loop-9B-Preview 多模态模型
AI 总结
r/LocalLLaMA 转发的 SenseNova 模型文档称，SenseNova-Loop-9B-Preview 是一款面向长上下文和智能体工作流的 9B 多模态语言模型。该模型可接收文本和图像并生成文本，用于文档理解、编程和外部工具交互，采用循环解码器、双流流形约束超连接、混合注意力以及最长 262,144 token 的训练方案。文档指出，24 个解码器层被执行两次，以 32 个不同层实现 56 次层执行。
深度见解
该预览版面向多模态智能体与长上下文任务，并采用共享权重的循环架构，但相关技术细节来自厂商文档，尚未经过独立测试。
| Overview SenseNova-Loop-9B-Preview is a multimodal language model developed for long-context and agentic workflows. It accepts text and images and generates text for applications that combine document understanding, coding, and interaction with external tools. The model combines a looped decoder with two-stream manifold-constrained hyper-connections (mHC). A contiguous block of decoder layers is executed twice with shared weights, while learned mappings manage information flow between two residual streams in the looped section. Together, these components provide a deeper execution path without duplicating the repeated block's parameters. Documented training recipes combine long sequences, multimodal inputs, and supervised task trajectories, with a maximum training sequence length of 262,144 tokens. For the best model performance, we recommend using our documented deployment environment and configuration parameters. Model highlights submitted by /u/jacek2023 [link] [comments] |