Xiaomi's MiMo-V2.6 report scales RL toward self-improvement
Xiaomi's LLM-Core Team released a technical report on the MiMo-V2.6 series, an omni-modal family that scales reinforcement-learning compute to push model intelligence. The report says it mid-trains on a broad multimodal corpus, then scales RL on a pretrained hybrid-SWA architecture with batches consuming 1,568 samples and 2.7–3.7B tokens per step at context lengths up to 1M, across code, general, visual and cyber environments, using groupwise agentic grading for better long-horizon reward signals. The team says it open-sourced training dynamics, RL environments and the RL framework, and froze the MoE router with multi-layer defenses against reward hacking.
It adds another vendor's public account of large-scale RL training and infrastructure, offering material for reproducible research on scaled RL and model self-improvement.
Computer Science > Computation and Language
arXiv:2610.11959 (cs)
[Submitted on 8 Oct 2026]
Title:MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement
Authors:Xiaomi LLM-Core Team: Zongming Qiao, Ziyue Hua, Zirui Ou, Zihao Yue, Zihan Jiang, Zhuo Huang, Zhiyang Chen, Zhixian Zheng, Zhipeng Xu, Zhengrui Ma, Yuyang Hu, Yuhang Dong, Yuechen Zhang, Yudong Wang, Yuanxin Liu, Yixin Yang, Yishuo Cai, Yikai Zhao, Yihan Yan, Yifan Zhang, Yifan Song, Xiyu Wei, Xing Zhang, Xin Zhang, Xiaoqian Liu, Xiaodong Ji, Xiangwei Deng, Xueyu Guo, Wenhan Ma, Weimin Xiong, Weikun Wang, Weiji Zhuang, Shuo Liu, Shuhuai Ren, Shuhao Gu, Shimao Chen, Shijie Cao, Shihua Yu, Shicheng Li, Shengjie Zhou, Shaolei Zhang, Rang Li, Qiying Wang, Qingkai Fang, Qianli Chen, Minzheng Wang, Liwen Wang, Linli Yao, Linghao Zhang, Liangyu Cheng, Liang Zhao, Lei Li, Jinhao Dong, Jinyu Xiang, Jianyu Wei, Jiangshan Duo, Huaqiu Liu, Huanjie Fan, Hongyi Guan, Hongshen Xu, Hao Tian, Hanyu Li, Hailin Zhang
, Yijie Zhang, Yanshu Xin, Xun Zhang, Xingjian Zhao, Wenyu Yang, Wenshan Huang, Wenhao Li, Tingwei Huang, Tianyu Yu, Tianyang Lu, Taoyu Yang, Sinan Du, Shutong Tian, Shulin Du, Shengfan Wang, Shanchuan Fang, Qihao Zhang, Qibin Yang, Qian Yu, Qian Tu, Pengrong Xie, Peipei Wang, Peidian Li, Minkun Guo, Mingchen Shao, Luohan Gao, Lijie Wang, Liang Shi, Kaiqi Chen, Kaiming Liu, Kaifei Wang, Kai Yang, Jinlong Xue, Jiechen Zhang, Jiaxuan Liu, Hongxu An, Hao Peng, Hanglong Lü, Guonan Wang, Feiyu Yang, Fanyu Cao, Fangyue Liu, Fan Cui, Cong Wang, Chun Chen, Chenxu Bai, Chengxuan Zhu, Chenghua Wang, Boyi Zeng
Some source content is omitted. Continue reading on the original site.