LFM3-1.7B量化报告称无损占用3.6GB显存
AI 总结
r/LocalLLaMA分享的报告称，LFM3-1.7B采用无损量化后占用3.6 GB显存，降至2.2 GB时仅有轻微性能下降。报告还援引LiquidAI自有基准称，LFM3-1.7B全面超过MiniCPM5-2B，同时提供两倍上下文，并在准无损量化下仅占约一半显存。
深度见解
这些测量结果表明，LFM3-1.7B在显存较为有限的设备上仍可能具备本地推理实用价值。
| This model looks quite spectacular. According to LiquidAI's own benchmarks, it scores higher than MiniCPM5-2B across the board, while offering 2x the context and taking up half the space in VRAM (3.6 GiB vs. 7.1 GiB for a quasi-lossless quant). Read the report: https://github.com/crusaderky/pixi-llm-recipes/blob/main/perplexity/LFM3-1.7B/README.md Raw plots as interactive HTML: https://htmlpreview.github.io/?https://raw.githubusercontent.com/crusaderky/pixi-llm-recipes/main/perplexity/LFM3-1.7B/report.html submitted by /u/crusaderky [link] [comments] |