Qwen3-4B-Instruct-2507

Headlines · 5

1. 4d
   Cactus Compute releases 22 MB on-device vision model Mirage

   Cactus Compute released Mirage, a 51.3M-parameter vision model with a 22 MB weights file for phones, wearables, robots and other consumer devices. The vendor says it performs scene description, object detection, OCR, segmentation, spatial-relation analysis and decision-making in one pass, with end-to-end measurements of 74 ms on a Samsung Galaxy S26 NPU and 107 ms on its CPU. Its HConvGLU encoder shares image features between detection and mask generation, while Simple Attention and Hadamard MLP components support the decoder.

   r/LocalLLaMA · 🔥 0
2. 4d
   Author reports Oc-e-Non-v1 cuts Qwen mean response length by 50%

   Reddit user /u/-p-e-w- announced Oc-e-Non-v1, a tersified version of Qwen3-4B-Instruct-2507 created with Heretic and its config.terse.toml configuration. The author says the model reduces Qwen’s mean response length by 50%, with examples showing shorter answers than GPT-5.6 Terra with reasoning disabled. The post also notes that Heretic does not yet support controlling reasoning effort.

   r/LocalLLaMA · 🔥 0
3. 5d
   RustingStrata vs. llama.cpp: Back-to-Back Qwen Benchmarks

   A Reddit user compared RustingStrata and llama.cpp on the same RTX 3060 12 GB system using the same Qwen GGUF files in back-to-back runs. Across models larger than VRAM, the user reports roughly 1.5× prefill and up to 2× decode performance for RustingStrata, while llama.cpp prefilled small dense models faster; the figures are means of two runs with desktop applications active and no tuning.

   r/LocalLLaMA · 🔥 0
4. Oct 21
   AWS walkthrough: training Qwen3 on Trainium with torchtitan

   An AWS Machine Learning Blog post walks through training Qwen3 on a single trn2.48xlarge Trainium instance using torchtitan, saying TorchNeuron registers Trainium as a native PyTorch device so torchtitan can use it through standard PyTorch interfaces. The post describes three configurations that share the same torchrun launch pattern and config structure: Hugging Face Transformers v5 as a modeling backend running Hub models through AutoModelForCausalLM with published safetensors, torchtitan's native Qwen3 selected by changing config.model_spec, and an NKI mixture-of-experts path using kernels from the torchtitan-neuron recipes attached via torchtitan's override registry. AWS says the setups support both pre-training from random initialization and fine-tuning published weights, and pins versions including torch 2.14.0, torch_neuronx 2.14.3, transformers 5.16.0 and torchtitan-neuron release-2.33.

   AWS Machine Learning Blog · 🔥 0
5. Oct 14
   Athanor: Claude Opus 5.5 agents autonomously post-train Qwen3-4B to match instruct

   An arXiv paper introduces Athanor, an open agent-native system for autonomous post-training research (AutoPostTrain) that runs on real GPUs. In a 104-hour campaign, four Claude Opus 5.5 agents, each on an eight-GPU node and given no research advice, improved Qwen3-4B-Base from 15.9 to 67.3 on a six-task development suite and from 9.2 to 48.2 on a held-out suite the agents were unaware of, against 66.5 and 47.9 for the official Qwen3-4B-Instruct-2507. The authors say the agents worked in a sandbox without external teacher models and reached this level by combining supervised fine-tuning on public reasoning data, reinforcement learning with a rollout change introduced by one agent, weight merges across agents and rounds of self-distillation, which they call the first demonstration of its kind; all results are author-reported.

   Hugging Face · Papers · 🔥 0

Experience and discussion from the community

Share my Qwen3-4B-Instruct-2507 experienceAsk about Qwen3-4B-Instruct-2507