PCIe
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Modeling collective communication for inference
A report on inference infrastructure models collective communication latency as synchronization steps, startup latency and bytes transferred per card, then relates the results to NVLink, RDMA, NUMA and PCIe topology. It compares ReduceScatter, AllGather, AllReduce, AllToAll and other primitives, and presents model estimates plus reported H20 measurements for intra- and inter-machine communication. The H20 topology references a public SGLang machine matrix; the supplied report does not describe independent replication of its measurements.
掘金 · 人工智能 · 🔥 0
Experience and discussion from the community
Share my PCIe experienceAsk about PCIe
Nobody has shared their experience with PCIe yet.