本地 LLM 基准维护者称帕累托前沿两个月未变
AI 总结
LocalLM 基准网站维护者在一篇 Reddit 帖子中展示了帕累托前沿图，其依据是在两张 RTX 3090 GPU 上运行的中等规模社区基准集合。维护者称，该前沿似乎已有两个月未变，并将这一时期与 DeepSeek-V4-Flash-Vision-Exp 和 Qwen3.8-Flash-Next 的发布时间联系起来。帖子还提到网站新增了按领域、语言及其他条件筛选的功能，并表示网站从一开始就保存了时间、令牌数和得分数据。作者披露自己维护该网站和大多数基准，另有四名常规贡献者参与，偶尔还有其他人员贡献。
深度见解
该可视化将基准得分与推理时间和令牌数进行比较，呈现了本地 LLM 性能及其前沿所体现的权衡。发布者同时维护网站和大多数基准，这一披露有助于解读此次更新。
| Seems it didn't change since two months, when DeepSeek-V4-Flash-Vision-Exp and Qwen3.8-Flash-Next have been released. Guess Qwen4-Flash will break it! There are more filters (by domain / languages / other) available on https://beta.locallm.top . The time/tokens vs score data has been saved since the beginning, I only realized it is good to visualize it recently. Disclaimer: I am the maintainer of the website and majority of the benchmarks, and there is a small community of 4 regular contributors, with some people occasionally contributing more. I call anyone who is interested in fine-grained local LLMs capabilities mapping to help and collaborate! submitted by /u/EmilPi [link] [comments] |
#LocalLM benchmark website#DeepSeek-V4-Flash-Vision-Exp#Qwen3.8-Flash-Next#RTX 3090