Nous Research发布Arete-27B价值对齐模型
AI 总结
Nous Research宣布推出Arete-27B,这是基于Alibaba的Qwen3.8-27B的27B参数监督微调模型,采用纯文本SFT和64k训练上下文,未使用RL、偏好优化或架构修改。Nous称模型旨在调整政治敏感议题的回答,其内部事实评分由2.32升至2.98(满分5分),含宣传内容回答由22%降至0.9%,但这些结果尚未经独立验证。
深度见解
该发布提供了面向不同价值取向的开放模型变体,但其行为变化和基准表现目前主要来自厂商自测,仍需独立测试。
| from NousResearch: Arete-27B We post-trained over Alibaba's Qwen3.8-27B to reinforce western values on a Chinese-trained model. We call this new model Arete-27B. Open source models give labs the raw tools to mold intelligence to varied preferences. The values a model ships with should not be the only values its users get to choose from. We observed firsthand refusals, deflections, and CCP-framed answers on politically sensitive topics in Qwen3.8-27B, and post-trained to alter those biases. On our evaluation, Arete-27B raised its fact score from 2.32 to 2.98 out of 5 and cut answers containing propaganda from 22% to 0.9%. The improvement held in all seven value categories, without a meaningful regression on the general-capability and agentic benchmarks we ran. That is not to claim that we remedied all behaviors associated with the extant viewpoint, but that we have addressed a potential root cause. We believe it's important that labs and researchers continue to create models that align with their values and worldviews, and we are thankful that companies like Alibaba provide the raw materials to do so. Blog post · Evaluation (links look broken now) Model details We used supervised fine-tuning only. No RL, no preference optimization, and no architectural modification. What we trained for We focused on seven value categories: Before we could begin post-training we had to measure what we were shooting for. We separated factual recall, the ability to corroborate verified sources of truth, from framing: whether an answer adopts the Chinese state's account as its own. Arete-27B is intended for general assistance and agentic work where users want this change in viewpoint, and for research into how post-training changes a model's values and behavior. We encourage the community to test it against their own requirements and continue experimenting with value-alignment. submitted by /u/jacek2023 [link] [comments] |