Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Nous Research Releases Arete-27B, a Value-Aligned Qwen Fine-Tune

AI summary

Nous Research announced Arete-27B, a 27B supervised fine-tune of Alibaba’s Qwen3.8-27B, using text-only SFT with a 64k training context and no RL, preference optimization, or architectural changes. The company says the model was trained to alter responses on politically sensitive topics, raising its internal fact score from 2.32 to 2.98 out of 5 and reducing propaganda-containing answers from 22% to 0.9%; these evaluations were not independently verified.

In-depth insight

The release provides an open model variant designed for users seeking different value framings, while its behavioral and benchmark improvements remain vendor-reported and require independent testing.

from NousResearch: Arete-27B We post-trained over Alibaba's Qwen3.8-27B to reinforce western values on a Chinese-trained model. We call this new model Arete-27B. Open source models give labs the raw tools to mold intelligence to varied preferences. The values a model ships with should not be the only values its users get to choose from. We observed firsthand refusals, deflections, and CCP-framed answers on politically sensitive topics in Qwen3.8-27B, and post-trained to alter those biases. On our evaluation, Arete-27B raised its fact score from 2.32 to 2.98 out of 5 and cut answers containing propaganda from 22% to 0.9%. The improvement held in all seven value categories, without a meaningful regression on the general-capability and agentic benchmarks we ran. That is not to claim that we remedied all behaviors associated with the extant viewpoint, but that we have addressed a potential root cause. We believe it's important that labs and researchers continue to create models that align with their values and worldviews, and we are thankful that companies like Alibaba provide the raw materials to do so. Blog post · Evaluation (links look broken now) Model details We used supervised fine-tuning only. No RL, no preference optimization, and no architectural modification. What we trained for We focused on seven value categories: Before we could begin post-training we had to measure what we were shooting for. We separated factual recall, the ability to corroborate verified sources of truth, from framing: whether an answer adopts the Chinese state's account as its own. Arete-27B is intended for general assistance and agentic work where users want this change in viewpoint, and for research into how post-training changes a model's values and behavior. We encourage the community to test it against their own requirements and continue experimenting with value-alignment. submitted by /u/jacek2023 [link] [comments]

#Arete-27B#Nous Research#Qwen3.8-27B#Alibaba#Inkling

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.