Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Edge0-145B NAS Storage Test Shows 51x Slower Cold Reads

AI summary

A workstation test read the same 105,368,210,944-byte file cold in 18.3 seconds from local NVMe and 15.6 minutes from a gigabit NAS, about 51 times slower. Based on the official model card cited by the author, the report recommends keeping the 51.20 GB lexicon layer on local SSD and the 40.08 GB expert library in system memory or fast local NVMe. The author did not download, load, or run Edge0-145B, so the report contains no measured inference throughput, latency, or memory use.

In-depth insight

The test provides detailed deployment guidance for placing Edge0-145B weights, while showing that the reported 51x gap concerns file reading rather than model inference.

DGX Spark 完整教程,Edge0-145B 98GB 分三层

结论先行:官方把 40GB 放内存、48GB 放 SSD,赌的是命中率,不是带宽

这句判断来自一次实测量出来的数:同一份 105,368,210,944 字节的文件,同一台工作站,放本机 NVMe 冷读 18.3 秒,放 NAS 15.6 分钟。

环境、命令、量出来的数都在下面,可以直接照着重跑。

权重下完,98GB 躺在盘上,多数人的下一步都一样:把路径填进启动命令,然后等。

我今天只把「路径填哪」这一段单独拿出来量了一遍。

#Edge0-145B#Edge0-145B-q3k#Edge0-145B-NVFP4#NVIDIA DGX Spark

Original · 10 min readRead the original
Group chat

No comments yet. Start the conversation.