Reddit 称 AMD MI455X 登顶批量推理对比
AI 总结
一名 Reddit 用户转述了一篇文章，称该文使用 Kimi K3 等四个模型比较大型数据中心 GPU 的推理表现。文章称，批量越大，总 tokens per second 越高，但单请求速度越低，并称 AMD MI455X 位居榜首；原文章与基准细节在现有材料中缺失。
深度见解
该结果反映了 LLM 批量推理中总吞吐与单请求响应速度之间的权衡，并显示 AMD MI455X 在这一场景可能具有较强表现。
| Article compares performance of large data center cards. Tells us for larger batches , inference speed of individual requests goes down, but overall performance of the entire batch goes up. In other words more tokens per second for the batch, but lower TPS for each request. Article uses Kimi k3 and 3 other models to compare performance. Surprisingly says the AMD MI455x comes up on top. submitted by /u/Terminator857 [link] [comments] |