英伟达研究团队提议用短笔记模型替代长上下文
AI 总结
英伟达研究人员认为,语言模型往往无需处理完整上下文窗口,并称这种方式速度慢、成本高且容易出错。据 The Decoder 报道,其测试显示,定期摘要与定向关键词检索通常能以更低成本取得与完整上下文相当的结果,研究团队还提出了一类使用短笔记的新模型。
深度见解
这项提议为减少上下文使用提供了一条研究路径,并据称可使摘要配合定向检索在较低成本下保持相近结果。

Nvidia researchers argue that language models often don't need their full context windows—which are slow, expensive, and prone to errors—and propose an alternative. In tests, periodic summaries and targeted keyword search usually matched full-context results at a fraction of the cost. The team even proposes a new class of models that works with short notes instead of long context.
The article Nvidia researchers argue huge AI context windows are a dead end appeared first on The Decoder.