Heretic

Headlines · 3

1. 4d
   Author reports Oc-e-Non-v1 cuts Qwen mean response length by 50%

   Reddit user /u/-p-e-w- announced Oc-e-Non-v1, a tersified version of Qwen3-4B-Instruct-2507 created with Heretic and its config.terse.toml configuration. The author says the model reduces Qwen’s mean response length by 50%, with examples showing shorter answers than GPT-5.6 Terra with reasoning disabled. The post also notes that Heretic does not yet support controlling reasoning effort.

   r/LocalLLaMA · 🔥 0
2. Nov 2
   GPT-6 Astra Can Edit Model Weights, but the Result Is Not Superhuman

   A Hacker News analysis of a paper reports that GPT-6 Astra could inspect and directly edit neural-network weights. The demonstrations included identifying games learned by a small network and editing a 0.8B Qwen model to stop looping after 32k tokens, allowing it to work on longer mathematical problems. The author notes that the game networks had labeled 8x8-grid inputs, making the first-layer weight patterns relatively easy to interpret. For Qwen, Astra used Python to compare looping and non-looping texts, identify weights associated with looping, trim them and test the patch. The author argues that competent human researchers could perform these tasks and describes direct weight editing as impressive but limited, comparing it with modifying compiled binaries rather than changing how models are normally developed.

   Hacker News · AI（100+ 分） · 🔥 0
3. Oct 29
   Heretic automates refusal ablation in language models

   Heretic is an open-source command-line tool that applies directional ablation to transformer-based language models, combining it with an Optuna-powered TPE parameter optimizer. The project says it jointly reduces refusals and KL divergence from the original model, and supports most dense models, many multimodal and MoE architectures, and some hybrid models such as Qwen3.5. Its author reports 3 refusals across 100 harmful prompts and 0.16 KL divergence for an automated Gemma 3 12B variant, while noting that automated metrics do not replace human evaluation and may vary by platform and hardware.

   GitHub Trending · Python · 🔥 0

Experience and discussion from the community

Share my Heretic experienceAsk about Heretic