Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Nvidia V100

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 4

  1. 12 Used V100 GPUs Run DeepSeek V4.1 Flash's Full Expert Set

    Nick Mermiges expanded his private AI server from eight to 12 used Nvidia V100 GPUs, with four cards on each of three boards. He reports that the system runs all 15,360 DeepSeek V4.1 Flash experts on the cards using 4-bit NVFP4. His measurements show 157–184 tokens per second for a single code stream, a 28.1-second first-token time for a 128K context, and power draw of up to about 2,100W. The reports attribute these figures to the owner and note that answer quality in use was not established.

    Tom’s Hardware · 🔥 11
  2. Three Used V100 GPUs Reach 100.8 Tokens/s With Qwen 3.6 35B

    A homelab builder measured 100.8 tokens per second for Qwen 3.6 35B at Q8 on three used Nvidia V100 GPUs with a 4K context, falling to 72.7 tokens per second at 128K. Across more than 130 llama.cpp tests, the dense Qwen 3.6 27B managed 24.3 tokens per second at 4K. In the reported 128K run, the three-V100 build consumed about half the GPU energy of the three-P100 setup. The listed $1,042 price covers only the GPUs and selected components, excluding RAM, storage, the case, cooling, and one of the two CPUs.

    Tom’s Hardware · 🔥 0
  3. Eight-V100 workflow brings DeepSeek-V4.1-Flash closer to NVFP4 precision

    A builder released the public Volta Max uPLIft workflow for running DeepSeek-V4.1-Flash on eight Nvidia V100 GPUs with a 524,288-token context. Its hybrid quantization keeps all routed experts in 2-bit form while storing the most frequently used experts at NVFP4 precision. In the builder’s tests, the build matched the next token produced by Nvidia’s full NVFP4 package on 95.1% of compared tokens, up from 92.2% for the 2-bit build. Code output slowed from 160–215 to 150–180 tokens per second. The builder also reports that Claude Code wrote the custom kernels and ran the benchmarks under his direction.

    r/LocalLLaMA · 🔥 0
  4. User Reports Nearly 400 Tokens/sec for Qwen-Flash-Next

    A Reddit user says they built an inference engine that runs Qwen-Flash-Next at nearly 400 tokens per second on three 32GB NVIDIA V100 GPUs in an older Dell R740. The engine was originally forked from Strata, with its internals rebuilt for the older Volta generation. The performance claim has not been independently corroborated and the post provides limited technical detail.

    r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my Nvidia V100 experienceAsk about Nvidia V100

Nobody has shared their experience with Nvidia V100 yet.