每次激活皆增强：将通用推理器扩展到1万亿开放语言基础
计算与语言
2025-11-10 v2 人工智能
摘要
我们介绍了Ling 2.0，一个面向推理的语言基础系列，其构建原则是每次激活都能增强推理能力。Ling 2.0旨在统一的混合专家范式下，将参数从数百亿扩展到一万亿，强调高稀疏性、跨尺度一致性以及由经验缩放定律指导的效率。该系列包括三个非思考（指令）模型——Ling-mini-2.0、Ling-flash-2.0和Ling-1T，总参数范围从16B到1T，与稠密对应模型相比，实现了高达7倍的有效计算效率。Ling 2.0在模型架构、预训练、后训练和基础设施方面整合了协同创新：用于高效推理的高稀疏性混合专家与多令牌预测、面向推理的数据和中间训练思维链激活、基于强化学习的微调（DFT, Evo-CoT），以及全规模FP8训练与细粒度异构流水线。在万亿规模上，Ling-1T建立了推理准确性与计算效率之间新的帕累托前沿，表明当稀疏激活与推理目标正确对齐时，能够实现可扩展且高效的智能。总的来说，Ling 2.0为推进未来的推理和思考模型（包括基于相同基础构建的Ring系列）提供了一个连贯、开放且高效的基础。
引用
@article{arxiv.2510.22115,
title = {Every Activation Boosted: Scaling General Reasoner to 1 Trillion Open Language Foundation},
author = {Ling Team and Ang Li and Ben Liu and Binbin Hu and Bing Li and Bingwei Zeng and Borui Ye and Caizhi Tang and Changxin Tian and Chao Huang and Chao Zhang and Chen Qian and Chenchen Ju and Chenchen Li and Chengfu Tang and Chilin Fu and Chunshao Ren and Chunwei Wu and Cong Zhang and Cunyin Peng and Dafeng Xu and Daixin Wang and Dalong Zhang and Dingnan Jin and Dingyuan Zhu and Dongke Hu and Fangzheng Zhao and Feifan Wu and Feng Zhu and Gangshan Wang and Haitao Zhang and Hailin Zhao and Hanxiao Zhang and Hanzi Wang and Hao Qian and Haoyi Yu and Heng Zhang and Hongliang Zhang and Hongzhi Luan and Huirong Dong and Huizhong Li and Jia Li and Jia Liu and Jialong Zhu and Jian Sha and Jianping Wei and Jiaolong Yang and Jieyue Ma and Jiewei Wu and Jinjing Huang and Jingyun Tian and Jingyuan Zhang and Jinquan Sun and Juanhui Tu and Jun Liu and Jun Xu and Jun Zhou and Junjie Ou and Junpeng Fang and Kaihong Zhang and Kaiqin Hu and Ke Shi and Kun Tang and Kunlong Chen and Lanyin Mei and Lei Liang and Lei Xu and Libo Zhang and Lin Ju and Lin Yuan and Ling Zhong and Lintao Ma and Lu Liu and Lu Yu and Lun Cai and Meiqi Zhu and Mengying Li and Min Chen and Minghao Xue and Minghong Cai and Mingming Yin and Peijie Jiang and Peilong Zhao and Pingping Liu and Qian Zhao and Qing Cui and Qingxiang Huang and Qingyuan Yang and Quankun Yu and Shaowei Wei and Shijie Lian and Shoujian Zheng and Shun Song and Shungen Zhang and Shuo Zhang and Siyuan Li and Song Liu and Ting Guo and Tong Zhao and Wanli Gu and Weichang Wu and Weiguang Han and Wenjing Fang and Wubin Wang and Xiang Shu and Xiao Shi and Xiaoshun Lan and Xiaolu Zhang and Xiaqing Sun and Xin Zhao and Xingyu Lu and Xiong Xu and Xudong Wang and Xudong Wang and Xuemin Yang and Yajie Yang and Yang Xiang and Yanzhe Li and Yi Zhang and Yilong Wang and Yingxue Li and Yongzhen Guo and Yuzhuo Fu and Yuanyuan Wang and Yue Yang and Yue Yu and Yufeng Deng and Yun Zhang and Yunfei Yu and Yuqi Zhang and Yuxiao He and Zengke Gui and Zhaoxin Huan and Zhaoyang Wang and Zhibo Zhu and Zhihao Wang and Zhiqiang Zhang and Zhoufei Wang and Zihang Zeng and Ziqi Liu and Zitao Xuan and Zuoli Tang},
journal= {arXiv preprint arXiv:2510.22115},
year = {2025}
}
备注
Ling 2.0 Technical Report