Nous Research Releases Arete-27B, a Value-Aligned Qwen Fine-Tune
AI summary
Nous Research announced Arete-27B, a 27B supervised fine-tune of Alibaba’s Qwen3.8-27B, using text-only SFT with a 64k training context and no RL, preference optimization, or architectural changes. The company says the model was trained to alter responses on politically sensitive topics, raising its internal fact score from 2.32 to 2.98 out of 5 and reducing propaganda-containing answers from 22% to 0.9%; these evaluations were not independently verified.
In-depth insight
The release provides an open model variant designed for users seeking different value framings, while its behavioral and benchmark improvements remain vendor-reported and require independent testing.
| from NousResearch: Arete-27B We post-trained over Alibaba's Qwen3.8-27B to reinforce western values on a Chinese-trained model. We call this new model Arete-27B. Open source models give labs the raw tools to mold intelligence to varied preferences. The values a model ships with should not be the only values its users get to choose from. We observed firsthand refusals, deflections, and CCP-framed answers on politically sensitive topics in Qwen3.8-27B, and post-trained to alter those biases. On our evaluation, Arete-27B raised its fact score from 2.32 to 2.98 out of 5 and cut answers containing propaganda from 22% to 0.9%. The improvement held in all seven value categories, without a meaningful regression on the general-capability and agentic benchmarks we ran. That is not to claim that we remedied all behaviors associated with the extant viewpoint, but that we have addressed a potential root cause. We believe it's important that labs and researchers continue to create models that align with their values and worldviews, and we are thankful that companies like Alibaba provide the raw materials to do so. Blog post · Evaluation (links look broken now) Model details We used supervised fine-tuning only. No RL, no preference optimization, and no architectural modification. What we trained for We focused on seven value categories: Before we could begin post-training we had to measure what we were shooting for. We separated factual recall, the ability to corroborate verified sources of truth, from framing: whether an answer adopts the Chinese state's account as its own. Arete-27B is intended for general assistance and agentic work where users want this change in viewpoint, and for research into how post-training changes a model's values and behavior. We encourage the community to test it against their own requirements and continue experimenting with value-alignment. submitted by /u/jacek2023 [link] [comments] |