AgentX

Headlines · 3

1. 3d
   NVIDIA Revises Vera Rubin Specifications for Volume Production

   NVIDIA said the revised Vera Rubin specifications represent what its systems sustain after qualification and volume production, rather than the preliminary architectural targets published during development. The changes lower the per-Rubin GPU HBM4 bandwidth from 22 TB/s to 19.2 TB/s and NVLink 6 bandwidth from 3.6 TB/s to 3 TB/s across the platform. NVIDIA also said Vera Rubin NVL72 is shipping and that published third-party agentic benchmarks used the production specifications, but the supplied reports do not independently verify those claims.

   Wccftech · 🔥 0
2. Oct 23
   vLLM scales GLM-5.3 to 1M-token contexts on 16 H200 GPUs

   vLLM Blog reports a GLM-5.3 serving deployment that uses 16 NVIDIA H200 GPUs, divided into separate prefill and decode nodes. Prefill Context Parallelism splits prompts by token, Decode Context Parallelism shards the KV cache, and Hybrid HiSparse keeps decode KV data in host memory. On AgentX, the tested PCP8 × DCP8 configuration with Hybrid HiSparse reported 1.7–3.2× per-user speed at equal throughput to data-parallel serving and was the only tested configuration that served 1M-token contexts; however, these results came from the project's own contributors.

   vLLM Blog · 🔥 0
3. Oct 16
   vLLM: Kimi K3 on AMD MI355X tops NVIDIA HGX B300 throughput per GPU

   A vLLM blog post details the engineering behind serving Kimi K3 on an eight-GPU AMD Instinct MI355X system with vLLM, covering cache reuse of conversation state, eliminating duplicate MoE work across GPUs, fusing memory traffic, an AMD AITER assembly path that speeds long-context MLA decoding, and parallelized KDA prefill and speculative decoding. Citing a SemiAnalysis InferenceX snapshot from October 9, 2026, it reports about 7,567 total tokens/s/GPU at 50 tokens/s/user P90 interactivity versus 6,083 for NVIDIA HGX B300, a 24.4% advantage. Using modeled TCO of $1.50 versus $2.26 per GPU-hour, it claims 87.4% more tokens per dollar; the figures come from a vendor-adjacent source and modeled cost assumptions, with no independent replication reported.

   vLLM Blog · 🔥 0

Experience and discussion from the community

Share my AgentX experienceAsk about AgentX