Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Microsoft previews USB4 RDMA for distributed AI inference on Windows 11

AI summary

Microsoft announced a developer preview of USB4-based RDMA that lets two or more compatible Windows 11 PCs pool memory and GPU capacity to run a shared AI model through supported inference frameworks, without dedicated RDMA adapters or switches. Microsoft reported round-trip latency of about 28–50 microseconds for small transfers. In separate vendor tests, Microsoft used three AMD mini PCs to run a four-bit-quantized 235-billion-parameter Qwen3 model at about 18.5 tokens per second; AMD reported about 22 tokens per second for Qwen3-235B-A22B, while Intel reported 54.2 tokens per second for GPT-OSS-120B on four Core Ultra Series 3 PCs.

In-depth insight

The preview provides a USB4-based route for distributed local-AI inference across compatible Windows 11 systems without dedicated RDMA adapters or switches. The report also includes vendor-reported latency and model-throughput measurements, although test conditions differed and independent validation was not provided.

微软公布 USB4 多 Win11 电脑协同 AI 方案,搭积木式叠加内存 / 显卡算力跑本地模型 - IT之家

首页

IT圈

最会买

设置

  • 日夜间 随系统 浅色 深色
  • 主题色 黑色

#Microsoft#Windows 11#AMD#Ryzen AI Max+ 395#Intel#Core Ultra Series 3#Qwen3#Qwen3-235B-A22B#GPT-OSS-120B

Original · 3 min readRead the original
Group chat

No comments yet. Start the conversation.