Edge0-145B NAS Storage Test Shows 51x Slower Cold Reads
A workstation test read the same 105,368,210,944-byte file cold in 18.3 seconds from local NVMe and 15.6 minutes from a gigabit NAS, about 51 times slower. Based on the official model card cited by the author, the report recommends keeping the 51.20 GB lexicon layer on local SSD and the 40.08 GB expert library in system memory or fast local NVMe. The author did not download, load, or run Edge0-145B, so the report contains no measured inference throughput, latency, or memory use.
The test provides detailed deployment guidance for placing Edge0-145B weights, while showing that the reported 51x gap concerns file reading rather than model inference.
DGX Spark 完整教程,Edge0-145B 98GB 分三层
结论先行:官方把 40GB 放内存、48GB 放 SSD,赌的是命中率,不是带宽
这句判断来自一次实测量出来的数:同一份 105,368,210,944 字节的文件,同一台工作站,放本机 NVMe 冷读 18.3 秒,放 NAS 15.6 分钟。
环境、命令、量出来的数都在下面,可以直接照着重跑。
权重下完,98GB 躺在盘上,多数人的下一步都一样:把路径填进启动命令,然后等。
我今天只把「路径填哪」这一段单独拿出来量了一遍。
#Edge0-145B#Edge0-145B-q3k#Edge0-145B-NVFP4#NVIDIA DGX Spark