Ornith发布1.5-122B自我改进模型
AI 总结
Ornith推出Ornith-1.5-122B,在前代模型基础上将任务生成、脚手架构建和解题 rollout 纳入联合优化。开发者称,该模型可持续生成训练任务、寻找解题策略,并通过强化学习改进策略,公告中同时提供了官方和 Unsloth 的 GGUF 文件。
深度见解
此次发布以122B模型形式呈现了Ornith的端到端自我改进方案,并扩展了对训练任务、执行框架和rollout的持续优化。
| from Ornith: Ornith-1.5-122B Chirp Chirp! 🐦 We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For more details on the task, harness, and rollout reward design, please refer to our blog. https://huggingface.co/ornith-ai/Ornith-1.5-122B-GGUF https://huggingface.co/unsloth/Ornith-1.5-122B-GGUF submitted by /u/jacek2023 [link] [comments] |
#Ornith#Ornith-1.5-122B#Ornith-1.0#Qwen3.5#Gemma4#Unsloth#Hugging Face