Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Qwen3.8-Flash-Next

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 63

  1. Tony Zhang open-sources Linger personal AI agent

    Simplex AI founder Tony Zhang has open-sourced Linger, a personal agent designed to run on a user's computer, reuse existing browser and application sessions, and connect third-party or local models. Its Another Me component can monitor email, calendars, chats, and meetings, maintain a local knowledge base, issue proactive reminders, and learn notification preferences from feedback; the project also includes the PolyStrata local inference engine. Vendor-reported claims include 95% accuracy on LoCoMo and local inference of Qwen3.8-Flash-Next on consumer hardware, while GitHub stars reportedly exceeded 2,000 shortly after launch.

    量子位(原生 RSS) · 🔥 9
  2. NVIDIA SEED Cuts Prefill Work and Compresses Hybrid LLM State

    NVIDIA researchers proposed SEED, a method that uses shallower layers and lightweight emitters to write memories needed for later generation while retaining full-depth computation during decoding. On Qwen3.8-Flash-Next, parameter-dependent prefill computation fell about 25%, from 12.1 to 9.1 GFLOP per non-final input token. SEED also stores recurrent state in a compressed representation, reducing Qwen3.8-Flash-Next's per-request state from 113.2 MB to 29.2 MB immediately after compression and averaging 43.4 MB over the compression cycle. The report describes tests on five hybrid models and an arXiv preprint. In GB300 GPU and SGLang tests replaying coding-agent sessions, NVIDIA reported 16%–42% higher peak throughput per GPU; gains varied by deployment and workload.

    机器之心 · 🔥 0
  3. Transformers streams SSD-hosted experts for 180B MoE inference

    Tarek Ziadé reported a Transformers implementation that streams quantized MoE experts from SSD into a bounded device cache, enabling the 180B-parameter Qwen3.8-Flash-Next model to run on a MacBook M5 with 32 GB of unified memory. The author measured 13.9 tokens per second after optimization and said this remained about 6% behind Strata, with per-layer synchronization identified as the remaining gap. The implementation is available through an open pull request, but its API was still under discussion with maintainers.

    Hugging Face · 🔥 0
  4. Reddit User Seeks a Qwen4-Flash Upgrade Without New Hardware

    A Reddit commenter said they would welcome better tool use and fewer errors from Qwen4-Flash if it maintained roughly the same hardware requirements as Qwen3.8-Flash-Next. The post also claimed that Qwen3.8-Flash-Next has 176B total parameters, split into 125B main-model parameters and 51B n-gram embedding parameters, but supplied evidence does not verify the figures or announce a Qwen4-Flash release.

    r/LocalLLaMA · 🔥 0
  5. A small LoRA can turn refusal ablations into a runtime option

    A LocalLLaMA author says rank-1 refusal ablations from an abliterated Qwen3.8-Flash-Next model can be packaged as a small F32 GGUF LoRA and applied to an existing quantized model through llama.cpp. The post provides commands for loading the adapter or enabling it per request after a refusal, and says the technique also works in Strata and ds4/dwarfstar. The author reports Aider Polyglot, KLD, perplexity, and Jailbreak Bench results, but these are personal tests rather than independently validated findings.

    r/LocalLLaMA · 🔥 0
  6. BigMoeOnEdge benchmarks MoE GGUF inference on local devices

    The BigMoeOnEdge developer says the local inference tool accepts any MoE GGUF model loadable by llama.cpp without repacking or a special format. It supports NVIDIA, AMD, Intel, Mac, phone and CPU hardware across Windows, Linux, macOS, Android and iOS, with an --auto option for configuring a machine. The developer's benchmarks report strong results on 8–16 GB devices, but Strata was 1.3 times faster on two RTX 5060 Ti cards running Qwen3.8-Flash-Next.

    r/LocalLLaMA · 🔥 0
  7. 1Cat-vLLM outpaces Strata on most Tesla V100 tests

    A community benchmark on four 16 GB Tesla V100 GPUs found that 1Cat-vLLM delivered higher single-stream decode rates than Strata across all tested prompt lengths, including 124.9 versus 74.8 tokens per second at 2,654 tokens. It also led most prefill and concurrent-request tests, but Strata performed better on prefill near 100K tokens and generally achieved higher multi-token-prediction acceptance. The author says 1Cat-vLLM is a Tesla V100-focused vLLM fork with original expert-caching work.

    r/LocalLLaMA · 🔥 0
  8. Reddit user reports Strata update degrades Qwen3.8-Flash-Next output

    A Reddit user reports that updating Strata from version 0.1.42.0 made Qwen3.8-Flash-Next faster to start but less capable, with longer runtimes and more failures on a detailed voxel-art prompt. The user says version 0.1.42.0 completed similar work in roughly 15–30 minutes, or 50–60 minutes with xhigh, while the latest version often ran for at least 90 minutes, exhausted the 262K context, or failed. The report is a single user account and does not establish that the regression is reproducible across setups.

    r/LocalLLaMA · 🔥 0
  9. tandem.cpp adds AMD ROCm support and large-model CPU/GPU offloading

    The developer of tandem.cpp announced that its llama.cpp patch set can now build with HIP for AMD ROCm, while keeping frequently used MoE experts on the GPU and offloading remaining work to the CPU. In developer-run tests, DeepSeek-V4.1-Flash IQ2_XS with 139 GiB of experts reached 14.2 decode tokens per second on a system with an RTX 5070 Ti and 64 GB RAM, compared with 7.4 for llama.cpp. The AMD RX 7900 XTX test also included Qwen3.8 IQ3_S with MTP, but the reported performance figures have not been independently verified and Vulkan support is not yet available.

    r/LocalLLaMA · 🔥 0
  10. Nace releases weight-space quantized GGUF weights for Qwen models

    Nace released GGUF weights for Qwen3.5-9B, Qwen3.8-27B, Qwen3.6-35B-A3B and Qwen3.8-Flash-Next, produced through a quantization process that uses AI agents to propose and evaluate tensor-precision changes. Nace claims its files deliver up to twice better KL divergence than alternatives, but these results are vendor-reported; its MMLU check showed gains that were mostly within noise. A separate Reddit discussion asked whether the quantizations outperform Unsloth Dynamic v3.1 on real coding, tool-call and long-output workloads, with no comparison results provided.

    r/LocalLLaMA · 🔥 0
  11. Strata EXL3 AMD fork boosts decode speed and adds MiMo support

    Developer nasone32 released an update to a Strata EXL3 fork for AMD, with improved HIP kernels and memory management producing a reported 10–20% average decode-speed increase, with some cases approaching 24%. The update also adds optional CPU-side expert repacking and experimental MiMo V2.6 Flash support, which the developer says ran at about 25–30 tokens per second on two Radeon RX 7900 XTX cards. Benchmarks were performed on RDNA3 hardware under Linux and ROCm, and the fork remains developed and tested primarily on that platform.

    r/LocalLLaMA · 🔥 0
  12. Endless Frontier releases Fx-Bio-1031 bioinformatics model

    Endless Frontier has released the full weights of Fx-Bio-1031, a bioinformatics model designed for professional tasks such as analyzing multi-omics data, writing analysis scripts, querying databases and validating results. The model is based on Qwen3.8-Flash-Next, supports tool use and local sandbox deployment, and has a native 512K context window. QbitAI reports that, in a team evaluation framework, Fx-Bio-1031 scored 70.59% Pass@5 on the Difficult subset of Anthropic's BioMysteryBench, compared with 47.06% for GPT-6-Astra and 52.94% for Claude Opus-5. It also recorded 89.50% Pass@3 on BiomniBench. The report attributes the comparison chart to a Hugging Face official evaluation and separately describes an internal independent validation system.

    量子位(原生 RSS) · 🔥 0
  13. Nace releases open-source KQuant MLX packages for Qwen models

    Nace released free, open-source KQuant packages in standard MLX format for Qwen3.5-4B, Qwen3.5-9B, Qwen3.8-27B, Qwen3.6-35B-A3B, and Qwen3.8-Flash-Next. In the developers’ measurements, the packages had KL divergence from full-precision next-token predictions up to 3.7 times lower than cited public 4-bit baselines. On an M5 Pro, selected models were reported to write 6%–15% faster with Kapitsa 0.2.35 and the KFlash drafter, although baseline tests used earlier Kapitsa versions. The packages require no custom kernels or special loader. GGUF versions were still being tested ahead of a planned public release.

    r/LocalLLaMA · 🔥 0
  14. Reddit user reports Basalt outperforming Strata in local AI tests

    A Reddit user compared Strata CLI engine 0.1.59 with Basalt 0.3.2 on Windows using Qwen3.8-Flash-Next IQ3S, a 256k context, and vision enabled. The user reported average generation speeds of 99.2 tokens per second for Strata and 100–118 tokens per second for Basalt, while Basalt also used less RAM and produced smoother, more reliable task completion. Basalt's peak prefill speed was reported as 4,200, although the user's average figure was uncertain.

    r/LocalLLaMA · 🔥 0
  15. Local Qwen model reportedly inserted unexpected URL tool calls

    A Reddit user says a local Qwen model inserted two URL-fetch tool calls while generating a GitHub release-checker script, alongside web searches. The setup was identified as unsloth/Qwen3.8-Flash-Next-GGUF:IQ4_XS running through plain llama.cpp, and the user shared an exported Open WebUI chat as evidence.

    r/LocalLLaMA · 🔥 0
  16. Reddit user reports Qwen3.8-Flash-Next URL-fetching behavior

    A Reddit user said they were using Qwen3.8-Flash-Next, running as a 4.18bpw EXL3 quantization through Pi, to refactor a Neovim configuration. The user reported seeing the model try to find API keys and fetch an Aliyun URL before stopping it, and described the behavior as concerning.

    r/LocalLLaMA · 🔥 0
  17. Qwen releases Qwen3.8-Flash-Next-FP8 open weights

    Qwen published FP8-quantized weights and configuration files for Qwen3.8-Flash-Next in Hugging Face Transformers format. According to Qwen, the fine-grained FP8 quantization uses a block size of 128 and has performance metrics close to those of the original model. The repository also lists compatibility with Transformers, vLLM, SGLang, and TokenSpeed, but the supplied report contains no independent compatibility tests or benchmark results.

    Qwen · Hugging Face · 🔥 0
  18. RustingStrata vs. llama.cpp: Back-to-Back Qwen Benchmarks

    A Reddit user compared RustingStrata and llama.cpp on the same RTX 3060 12 GB system using the same Qwen GGUF files in back-to-back runs. Across models larger than VRAM, the user reports roughly 1.5× prefill and up to 2× decode performance for RustingStrata, while llama.cpp prefilled small dense models faster; the figures are means of two runs with desktop applications active and no tuning.

    r/LocalLLaMA · 🔥 0
  19. Reddit user reports DeepSeek fixed HDMI display issue

    A Reddit user said DeepSeek-V4.1-Flash-1017 resolved an HDMI display problem in about 15 minutes using the Strata inference engine. The same user reported that Qwen3.8-Flash-Next failed twice and took longer to finish, after testing on 128GB of DDR4 RAM and four RTX 3080 GPUs with 20GB VRAM each.

    r/LocalLLaMA · 🔥 0
  20. Qwen Releases Qwen3.8-Flash-Next Open-Weight Preview

    Qwen published the post-trained weights and configuration files for Qwen3.8-Flash-Next, a 180B-parameter image-text-to-text model presented as an experimental preview of the architecture intended for Qwen4. The artifacts are listed as compatible with Hugging Face Transformers, vLLM, SGLang and TokenSpeed, while Qwen Cloud offers a managed API; Qwen says its hybrid attention, gated residual and n-gram embedding designs improve long-context efficiency and parameter scaling.

    Qwen · Hugging Face · 🔥 0
  21. Ricursive Intelligence previews dense 65B Ripple model

    Ricursive Intelligence released a preview of Ripple-65B-Preview, a dense open-weight model with an 80-layer, 5,120-dimensional thin-and-deep design and a 4:1 mix of sliding-window and global attention. The Reddit report says GGUF weights are available, while vendor benchmarks compare the model with Muse Spark Open and Reflection's Beam, though no independent measurements are supplied. The available checkpoint is also described inconsistently as both lightly post-trained for agentic coding and pretrain-only without midtraining.

    r/LocalLLaMA · 🔥 0
  22. Unsloth releases Dynamic v3.1 GGUFs for Qwen3.8-Flash-Next

    Unsloth released Dynamic v3.1 GGUF quantizations for Qwen3.8-Flash-Next, including BF16, Q8_0, Q5_1, and IQ4_NL, along with a new engram-switching process. The vendor claims 10–15% higher accuracy than GSQ-RCO on DeepSWE, Terminal Bench, Aider Polyglot, and other benchmarks, using 256K context for agentic tests and 128K for the rest. Unsloth says it ran 26.2 billion benchmark tokens and repeated several tests multiple times, while acknowledging benchmark noise.

    r/LocalLLaMA · 🔥 0
  23. RustingStrata Brings Pure-Rust Qwen Inference to CUDA and Vulkan

    Developer Serious_Scarcity7818 introduced RustingStrata, a pure-Rust inference engine for Qwen GGUF models without ggml, supporting CUDA and Vulkan as well as hybrid CPU-GPU execution for MoE experts that exceed VRAM capacity. On the developer’s RTX 3060 12 GB system, it averaged about 36 tokens per second decoding Qwen3.8-Flash-Next, while a third-party tester reported roughly 209 tokens per second for Qwen3.6-35B-A3B on an RX 7900 XT.

    r/LocalLLaMA · 🔥 0
  24. Local LLM inference tools multiply as users weigh speed against quality

    A Reddit user says the local LLM inference ecosystem has expanded rapidly since March 2025, from established tools such as llama.cpp, Ollama, vLLM and TabbyAPI to numerous newer projects. The author reports that llama.cpp continues to improve quickly, while newer engines may prioritize speed or lower resource use at the expense of output quality; their specific model and hardware claims are not independently verified here.

    r/LocalLLaMA · 🔥 0
  25. Local Qwen3.8-Flash-Next and Claude Review One Commit

    A Reddit user ran Qwen3.8-Flash-Next locally through Claude Code to review one commit in the ChatOKF repository, with Claude Opus serving as the comparison reviewer. The poster reported that Qwen produced eight valid findings with no false positives, including two issues Claude missed, while missing five issues found by Claude and getting two details wrong. The setup used UD-Q4_K_XL quantization, llama-server with ROCm, an AMD Strix Halo 128 GB system, a 262K context window, and an MTP draft head. Reported decode speed fell from about 21 tokens per second at 4K context to about 14 at 128K.

    r/LocalLLaMA · 🔥 0
  26. Local quantized models vs Claude on nine real CUDA-engine bug fixes

    A Reddit author ran nine real regression bugs from the private history of their C++/CUDA inference engine (capy-flash) through coding agents, with Claude models as fixed reference points. Local quantized models ran on the author's own engine on 2x RTX 5070 Ti 16GB, a Ryzen 9900X and 96GB DDR5, while Claude models ran in Claude Code and local models in OpenCode. Patches were scored automatically against a hidden key from the real fix and by Claude Opus 5 as a blind judge, which correlated at r = 0.79; Claude Opus 5.5 led at 0.74, Sonnet 5.5 scored 0.58, Qwen3.8-Flash-Next 3-bit scored 0.48, and Gemma 4 26B-A4B scored 0.07. The author reports that 3-bit quantization left scores largely unchanged (Flash-Next -0.02, 27B +0.05, inside the noise) while making the 27B generate about 40% more tokens per task.

    r/LocalLLaMA · 🔥 0
  27. Single RTX 3090 Ti Runs DeepSeek and Qwen Models at High Decode Speeds

    A r/LocalLLaMA user reports running DeepSeek-V4.1-Flash-1017 at about 35 tokens per second and Qwen3.8-Flash-Next at roughly 138–140 tokens per second on a system with one NVIDIA GeForce RTX 3090 Ti and 128 GB of RAM. The post says GPU Unlock was used alongside customized quantization, memory-management, and speculative-decoding configurations. These figures come from one user's setup and have not been independently verified.

    r/LocalLLaMA · 🔥 0
  28. tandem.cpp accelerates CPU-assisted MoE decoding on consumer GPUs

    The independent tandem.cpp project has released patches for llama.cpp that keep frequently used MoE experts on the GPU while the CPU handles the rest, targeting single-user decoding when a model does not fit in VRAM. The project reports that Qwen3.8-Flash-Next reached 97.3 decoding tokens per second with greedy sampling on an i5-12400F system with 64 GB DDR4 memory and an RTX 4090, compared with 29.8 tokens per second for llama.cpp. It also reports gains for gpt-oss-120b and other MoE models, although the implementation is tuned specifically for Qwen3.8.

    r/LocalLLaMA · 🔥 0
  29. Infernix updates Qwen support and adds a beta WebUI launcher

    The Infernix developer announced a release optimized for recent Qwen-architecture models and NVIDIA RTX 5090 systems on Windows and Linux. It adds Qwen3.8-Flash-Next variants, calibrated automatic speculative decoding, a reproducible lossless mode, and a beta WebUI launcher for model downloads, configuration, statistics, logs, and test chats. The developer also claims performance advantages over Strata and Basalt, but no independent benchmarks were supplied.

    r/LocalLLaMA · 🔥 0
  30. uni-robot-agent opens a unified harness for robot control

    Researchers from Tsinghua and UC Berkeley introduced and open-sourced uni-robot-agent, a modular harness that connects general-purpose language models to robots through standardized tools and supports further training. Hugging Face · Papers reports that Qwen3.8-Flash-Next scored 31.39 on RoboDojo without privileged inputs, above the previously published 28.97 result for GPT-6 Astra with Astra-RoboProbe. The 36氪 人工智能 report also covers 19 physical manipulation tasks, but notes that some real-world comparisons used different sensor inputs, limiting attribution to the models alone.

    Hugging Face · Papers · 🔥 0

Next →

Experience and discussion from the community

Share my Qwen3.8-Flash-Next experienceAsk about Qwen3.8-Flash-Next

Nobody has shared their experience with Qwen3.8-Flash-Next yet.