AMD EPYC 7443
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- EPYC 7443 upgrade boosts local MoE inference in one system
In a field report, an r/LocalLLaMA user replaced a Core Ultra 7 265KF and MSI Z890 with an EPYC 7443 and Supermicro H12SSL-NT while retaining the same GPU inventory. The upgrade also increased memory from 64 GB DDR5 to 256 GB DDR4 ECC RDIMM and widened PCIe links. After tuning BMC fan thresholds, RAM overclocking, IOMMU and BIOS settings, the author reported GLM-5.3-Flash and DeepSeek-V4.1-Flash decode speeds increasing by roughly fourfold, while Qwen3.8-27B dense-model performance was broadly unchanged. The author attributes the large MoE gains mainly to the models fitting in VRAM and RAM, with less data being read from NVMe storage. These are results from one user's system. One GPU was unavailable during the post-change MoE tests, so those runs used three GPUs rather than four, and Maya was updated from versions 1.0.34 or 1.1.20 to 1.1.42 during testing.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my AMD EPYC 7443 experienceAsk about AMD EPYC 7443
Nobody has shared their experience with AMD EPYC 7443 yet.