NVIDIA 910B

Headlines · 1

1. Nov 3
   Modeling collective communication for inference

   A report on inference infrastructure models collective communication latency as synchronization steps, startup latency and bytes transferred per card, then relates the results to NVLink, RDMA, NUMA and PCIe topology. It compares ReduceScatter, AllGather, AllReduce, AllToAll and other primitives, and presents model estimates plus reported H20 measurements for intra- and inter-machine communication. The H20 topology references a public SGLang machine matrix; the supplied report does not describe independent replication of its measurements.

   掘金 · 人工智能 · 🔥 0

Experience and discussion from the community

Share my NVIDIA 910B experienceAsk about NVIDIA 910B