Qwen3.8 27B
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 15
- When Does Self-Hosting an Open-Weight LLM Beat the API?
OpenRouter Blog calculates that GPU rental generally costs less than an API only when traffic keeps the hardware sufficiently utilized. Using October 8, 2026 prices, it reports that DeepSeek V4.1 Flash on four rented H200s never reaches break-even against the cheapest zero-data-retention endpoint, while Qwen3.8 27B on one rented RTX 3090 reaches break-even at roughly 6% to 12% load. The estimates exclude engineering time and spare capacity, making them lower bounds, and API prices can change quickly.
OpenRouter Blog · 🔥 0 - ComfyUI v0.45.0 Boosts Qwen3.x Token Generation
Comfy says it rewrote ComfyUI’s local text-generation path for Qwen3.x, enabling token generation up to twice as fast without changing the models or output quality. It reports that Qwen3.5 9B rose from 106 to 219 tokens per second on an RTX 5090, while Qwen3.8 27B rose from 55 to 122 tokens per second for 1536×1536 image descriptions. The improvements are available in ComfyUI v0.45.0, but the performance figures have not been independently verified.
Comfy Blog · 🔥 0 - OpenRouter test finds no detected accuracy difference across fp8, fp4 and fp16
OpenRouter analyzed 1,455 provider endpoints on October 20, 2026, finding that 865, or 59.5%, did not report a precision label. In a test of six Qwen3.8 27B endpoints on that day, it detected no accuracy difference among fp8, fp4 and fp16 across 240 scored tasks; all six scored between 98.3% and 99.2%. One fp4 endpoint ranked lowest on 40 additional multiplication tasks, but by a gap too small to rule out chance. Lower precision was generally cheaper, but not universally: 8-bit cost less than 16-bit for 14 of 24 compared models, while 4-bit cost less than 8-bit for 26 of 33. The quality comparison covered one model on one day, and OpenRouter could not determine which quantization methods the providers used.
OpenRouter Blog · 🔥 0 - Qwen3.8 27B leads AA-PersonalityBench for longest responses
ArtificialAnlys reported that Qwen3.8 27B produced the longest responses in AA-PersonalityBench, averaging about 1,030 words per answer. That was roughly six times the 174-word average for GPT-6 Sol, while K2 Horizon 375B A23B and Qwen3.8 Max (0902) ranked next at 922 and 863 words, respectively.
ArtificialAnlys (X) · 🔥 0 - Developer releases Saber Rust inference engine for AMD R9700
A developer released Saber, an LLM inference engine written in Rust and targeting AMD R9700 GPUs. It supports tensor parallelism settings of 1, 2 or 4, as well as Qwen3.8 27B. The developer reported 6,645 tokens per second for prefill and a 316 tokens per second decode peak on Qwen3.8 27B, using two R9700 GPUs, an AMD Ryzen 9900X and a Taichi X870E. The developer also claims Saber beats existing available engines on Qwen3.8 27B and Flash Next.
r/LocalLLaMA · 🔥 0 - Kapitsa 0.2.26 adds SSD offloading and Apple Silicon benchmarks
Kapitsa contributor Ye announced version 0.2.26, adding support for DiffuSpace's Clover 35B. He reported that Qwen Flash-Next 180B reads prompts 46% faster and Qwen3.8 27B writes 8% faster than its previous M5 Max results. The release also adds SSD offloading for Flash-Next 180B: contributor Ye said experts that do not fit in RAM can stream from an SSD, enabling a reported 61 tokens per second on a 48 GB MacBook Pro. Benchmarks on a 2026 M5 Max MacBook Pro with 128 GB of memory covered six models at context lengths from 1K to 32K. The figures came from a project contributor, who invited others to submit comparable results and warned that the new codebase could contain prefill or decode bugs.
r/LocalLLaMA · 🔥 0 - 64GB M4 Max Runs a 27B Model for Long-Context Coding Agents
A Reddit user reports running Qwen3.8 27B in LM Studio on a 64GB M4 Max for coding-agent sessions containing roughly 100,000 to 200,000 tokens. At 164,000 tokens, the LM Studio engine reportedly used 48GB of memory, including 46GB of GPU memory; cache misses triggered a full prefill of about 20 minutes. The author says prompt caching made the setup usable, while quantized KV caching was limited by LM Studio’s MLX vision path and hybrid-model behavior.
r/LocalLLaMA · 🔥 0 - Reddit user reports mixed Qwen3.8-Flash-Next performance
A Reddit user said Qwen3.8-Flash-Next performed well on coding and adjacent tasks, including evaluating open-source repositories and running models. In general research, however, the user reported confusion, verbose and dense prose, and difficulty maintaining consistent answers. The test used Pi with llama.cpp, UD_Q4_K_M quantization, and MTP, with sampling parameters copied from Qwen3.8 27B.
r/LocalLLaMA · 🔥 0 - Survival LLM launches offline emergency assistant for local computers
Survival LLM is a free, open-source AI assistant and emergency library that runs locally on a user's computer. Its product description says setup requires an internet connection, after which the model and library can operate offline while showing the source articles and passages used for each answer. The app includes emergency, medical, survival, repair and reference material and can select models such as NVIDIA Nemotron 3.5 Super, Qwen3.8 27B, NVIDIA Nemotron 3.5 Lightning or IBM Granite 4.2 8B based on available memory.
Hacker News 首页(100+ 分) · 🔥 0 - Reddit post shares Qwen3.8 27B GGUFs as “statistically lossless”
A Reddit post titled “Statistically Lossless Qwen3.8 27B GGUFs” shared a Hugging Face link for the files. The poster said they were reposting the link because the original analysis was behind a blog paywall. The supplied report does not include methodology, benchmark results, quantization details, or independent validation of the claim.
r/LocalLLaMA · 🔥 0 - Community post labels Qwen3.8 27B GGUFs statistically lossless
A community post labeled Qwen3.8 27B GGUFs as statistically lossless. The poster was unsure whether the EAR99 quantization was related to the IST-DASLab SLQ project and said that, after roughly 30,000 tokens, it felt the same as or better than FP8, while explicitly describing the test as unscientific.
r/LocalLLaMA · 🔥 0 - Six Inference Engines Benchmarked on RTX 5090
A TensorSharp author benchmarked six inference engines running Qwen3.8 27B on one RTX 5090 32 GB, with and without DFlash2 speculative decoding. NInfer led speculative and aggregate concurrent throughput, while llama.cpp recorded the highest plain single-request decode rate; the tests also covered 32K prompts, image input, and a four-turn tool loop. The report attributes results to complete configurations because checkpoints, drafters, and KV formats differed, and its author disclosed being TensorSharp’s creator.
r/LocalLLaMA · 🔥 0 - Qwen3.8 27B Ties Opus 5.5 in User-Run Korean RAG Test
A Reddit user evaluated Qwen3.8 27B and Opus 5.5 on Allganize’s Korean RAG dataset, which contains 300 questions and 64 PDFs, giving both models the same prompt and top five retrieved pages. With thinking enabled, Qwen3.8 27B scored 77.3%, versus 76.6% for Opus 5.5. When Opus 5.5 served as judge, the scores were 80.6% and 80.3%, respectively. The author reported a McNemar test result of p=0.82. The author also cautioned that this was a single run at temperature 0, that 11 verdicts changed on different hardware, and that 20 additional unanswerable questions were too easy because every model refused them. The one-point gap therefore was not treated as conclusive.
r/LocalLLaMA · 🔥 0 - Hands-on: an iPhone Duo app that dispatches agent tasks to a home Mac Studio
APPSO published a first-hand account of pairing a 21,499-yuan iPhone Duo with an 86,749-yuan Mac Studio to build what it calls a personal AI hub, with the desktop left at home to run models and execute agent tasks while the phone connects remotely. The team wrote a custom app tailored to the Duo's three states: closed, half-folded hover and fully unfolded, giving each a different agent interface — an approval dashboard, a live execution view with voice dispatch, and a two-column console for previewing outputs. On the network side, an HTTPS proxy on the Mac listens on its LAN address and forwards phone requests to a local Bridge service, with Tailscale suggested for cellular access; tasks are tracked by session ID, and a dropped phone connection does not cancel them while the Mac keeps running. Models including DeepSeek V4 Flash, Qwen3.8 27B and GLM 5.3 Flash were served locally through LM Studio, with DeepSeek Harness handling planning and tool use; APPSO said one pelican-on-a-bicycle generation took 2 minutes 18 seconds, averaging 34 tokens per second after two rounds of edits.
爱范儿 · 🔥 0 - Qwen3.8 27B sums big numbers in words, hitting 167/169 with reasoning on
Simon Willison re-ran an experiment Colin Frasier first tried two years ago with GPT-4o: have a model compute large sums but return the answer in words. He ran it on local hardware (a DGX Spark), using a Codex Remote session (GPT-6 Astra) to write and execute the test with Qwen3.8-27B-Q4_K_M.gguf. With reasoning disabled he sampled 30 attempts per cell; with reasoning enabled each run took so long that he used one sample per pair, and the model got 167 of 169 attempts right.
Simon Willison's Weblog · 🔥 0
Experience and discussion from the community
Share my Qwen3.8 27B experienceAsk about Qwen3.8 27B
Nobody has shared their experience with Qwen3.8 27B yet.