OpenJet

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

5d
OpenJet Adds Concurrent Coding-Agent Inference on One GPU
OpenJet released an update that serves multiple coding agents concurrently on a single GPU using a custom CUDA megakernel for Qwen3.8-27B Q4_K_M. Its developer reported 64–72 tokens per second per agent with four agents on an RTX 3090 for short prompts, and 52–55 tokens per second with 23K contexts, though no independent measurements were provided.
r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my OpenJet experience Ask about OpenJet

Nobody has shared their experience with OpenJet yet.