open-jet

Headlines · 1

1. Oct 20
   Developer reports 190 tok/s for Qwen3.8-27B on two RTX 3090s

   A developer reports that the Geezuz dual-GPU CUDA kernel ran Qwen3.8-27B on two power-limited RTX 3090s at 190 tok/s for one request and an aggregate 622 tok/s across eight requests. The open-source project splits computation across two GPUs over PCIe, supports tensor-core quantization paths and MTP drafting, and includes an OpenAI-compatible server, but its speed and output-quality comparisons have not been independently verified.

   r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my open-jet experienceAsk about open-jet