Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

NVIDIA HGX B300

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 3

  1. WEKA and NAND Research launch Inference Economics Scorecard

    WEKA and NAND Research launched the Inference Economics Scorecard at Supercomputing 2026, with nine metrics for assessing inference productivity and economic value beyond GPU utilization. The framework requires at least eight-hour test runs, counts only successful outputs, and was used in an eight-hour WEKA-Nebius benchmark on an NVIDIA HGX B300 system. WEKA reported that its NeuralMesh configuration produced 3.7 times more output tokens per GPU-hour than the HBM-only setup, though the performance results have not been independently verified here.

    科技新报 · 🔥 4
  2. NVIDIA releases Snapshot for faster GPU inference recovery

    NVIDIA released Snapshot as an open-source component of the NVIDIA DSX AI Factory Platform for checkpointing and restoring initialized GPU workloads on Kubernetes. NVIDIA Technical Blog reports that it captures CPU and GPU memory state and restores compatible replicas without repeating model loading, compilation or warmup, while partner tests reported readiness times falling from roughly eight minutes to 31 seconds and vLLM startup times dropping from two to 8.5 minutes to six to 34 seconds.

    NVIDIA Blog · 🔥 0
  3. vLLM: Kimi K3 on AMD MI355X tops NVIDIA HGX B300 throughput per GPU

    A vLLM blog post details the engineering behind serving Kimi K3 on an eight-GPU AMD Instinct MI355X system with vLLM, covering cache reuse of conversation state, eliminating duplicate MoE work across GPUs, fusing memory traffic, an AMD AITER assembly path that speeds long-context MLA decoding, and parallelized KDA prefill and speculative decoding. Citing a SemiAnalysis InferenceX snapshot from October 9, 2026, it reports about 7,567 total tokens/s/GPU at 50 tokens/s/user P90 interactivity versus 6,083 for NVIDIA HGX B300, a 24.4% advantage. Using modeled TCO of $1.50 versus $2.26 per GPU-hour, it claims 87.4% more tokens per dollar; the figures come from a vendor-adjacent source and modeled cost assumptions, with no independent replication reported.

    vLLM Blog · 🔥 0

Experience and discussion from the community

Share my NVIDIA HGX B300 experienceAsk about NVIDIA HGX B300

Nobody has shared their experience with NVIDIA HGX B300 yet.