AMD ROCm

Headlines · 4

1. 2d
   4x Radeon R9700 runs Qwen3.8 Flash-Next at ~190 tok/s, 6,800 tok/s prefill

   A Reddit user (/u/Anarchaotic) posted initial benchmarks for a four-GPU Radeon R9700 system (3x Gigabyte, 1x XFX, all power-limited to 210W) running Radiance v1.17.0 with a qwen3.8-next-flash-fp8-iq4r-moe.rad MoE model on Ubuntu 26.04.1 and ROCm 10.1. Client-side measurements show one user writing at about 190 tok/s, aggregate prefill of about 6,800 tok/s regardless of user count, and agent follow-up turns returning the first token in 0.2-2.5 s at 80-225 tok/s per user with 94-99% prefix-cache hits. The reported worst case of eight simultaneous fresh 128K prompts took about 151 seconds for the first token, while the two middle cards reached 91 C hotspot and 92 C memory during prefill.

   r/LocalLLaMA · 🔥 0
2. Nov 2
   Dell and AMD scale enterprise AI with modular rack infrastructure

   Dell Technologies and AMD are expanding an enterprise AI infrastructure strategy built around Dell PowerEdge servers, AMD Instinct accelerators and the modular Dell AI Platform with AMD. The platform integrates AMD ROCm for on-premises model training, fine-tuning and serving, while Dell has added support for AMD Instinct MI350P PCIe GPUs in the PowerEdge XE7745 and R7725 servers. Dell representatives say AMD-based systems can consolidate multiple servers and improve rack density, though those performance and efficiency figures have not been independently verified.

   SiliconANGLE AI · 🔥 0
3. Oct 27
   AMD Invests $1B in Meta and Expands AI Infrastructure Partnership

   AMD announced a $1 billion investment in Meta’s equity offering alongside an expanded infrastructure partnership covering EPYC CPUs, Instinct GPUs, Helios rack-scale systems, Pensando networking and ROCm software. AMD and Meta said the first Helios systems have been installed at Meta and are undergoing testing, with broader deployment planned in the near future. The companies also set a goal of building gigawatt-scale AI infrastructure, while AMD said Meta has deployed millions of EPYC processors and uses Instinct GPUs for training, ranking and recommendation workloads.

   科技新报 · 🔥 0
4. Oct 14
   AMD unveils Helion agentic AI rack design; Helios racks enter production

   At the OCP Global Summit 2026, AMD chair and CEO Lisa Su introduced Helion, an open rack-scale reference design for agentic AI workloads built to OCP's Open Rack v3 (ORv3) 44OU specification, with configurations planned for availability in November 2026 and specs to be submitted to the OCP community. AMD says Helion comes in CPU-only and CPU-GPU configurations supporting up to 32,768 Zen 6 CPU cores, 16 Instinct MI350P accelerators, 74 petaflops of FP4 compute and 102 Tbps of networking, with Venice CPU and power options split across personal-assistant, enterprise and technical-computing agent workloads, plus an integrated token router that directs agent model requests across frontier and open-source models. AMD also said its Helios AI rack, first shown at OCP last year, has entered production, with the first systems installed and running at OpenAI, Meta, Microsoft and Oracle; Helios combines Instinct GPUs, EPYC processors, Pensando networking and the ROCm software stack.

   科技新报 · 🔥 0

Experience and discussion from the community

Share my AMD ROCm experienceAsk about AMD ROCm