Kimi K2：开源智能代理
机器学习
2026-02-04 v2 人工智能
计算与语言
摘要
我们介绍 Kimi K2，这是一个拥有 320 亿激活参数、总计 1 万亿参数的混合专家 (Mixture-of-Experts, MoE) 大语言模型。我们提出了 MuonClip 优化器，该优化器在 Muon 基础上引入了新颖的 QK-clip 技术，以解决训练不稳定问题，同时保持 Muon 的先进标记效率。基于 MuonClip，K2 在 15.5 万亿标记上进行预训练，实现了零损失峰值。在后训练阶段，K2 经过多阶段后训练过程，包括大规模智能体数据合成管道和联合强化学习 (RL) 阶段，通过与真实和合成环境的交互提升模型能力。Kimi K2 在开源非思考模型中实现了最先进的性能，尤其在智能体能力方面表现突出。K2 在 Tau2-Bench 上获得 66.1 分，在 ACEBench (英文) 上获得 76.5 分，在 SWE-Bench Verified 上获得 65.8 分，在 SWE-Bench Multilingual 上获得 47.3 分，超过了大多数开源和闭源基准。在编码、数学和推理任务方面也表现强劲，LiveCodeBench v6 上得分 53.7，AIME 2025 上得分 49.5，GPQA-Diamond 上得分 75.1，OJBench 上得分 27.1，均无需扩展思考。这些结果将 Kimi K2 定位为目前最具能力的开源大语言模型之一，尤其在软件工程和智能体任务方面。我们发布了基础模型和后训练模型检查点，以促进智能体智能的未来研究和应用。
引用
@article{arxiv.2507.20534,
title = {Kimi K2: Open Agentic Intelligence},
author = {Kimi Team and Yifan Bai and Yiping Bao and Y. Charles and Cheng Chen and Guanduo Chen and Haiting Chen and Huarong Chen and Jiahao Chen and Ningxin Chen and Ruijue Chen and Yanru Chen and Yuankun Chen and Yutian Chen and Zhuofu Chen and Jialei Cui and Hao Ding and Mengnan Dong and Angang Du and Chenzhuang Du and Dikang Du and Yulun Du and Yu Fan and Yichen Feng and Kelin Fu and Bofei Gao and Chenxiao Gao and Hongcheng Gao and Peizhong Gao and Tong Gao and Yuyao Ge and Shangyi Geng and Qizheng Gu and Xinran Gu and Longyu Guan and Haiqing Guo and Jianhang Guo and Xiaoru Hao and Tianhong He and Weiran He and Wenyang He and Yunjia He and Chao Hong and Hao Hu and Yangyang Hu and Zhenxing Hu and Weixiao Huang and Zhiqi Huang and Zihao Huang and Tao Jiang and Zhejun Jiang and Xinyi Jin and Yongsheng Kang and Guokun Lai and Cheng Li and Fang Li and Haoyang Li and Ming Li and Wentao Li and Yang Li and Yanhao Li and Yiwei Li and Zhaowei Li and Zheming Li and Hongzhan Lin and Xiaohan Lin and Zongyu Lin and Chengyin Liu and Chenyu Liu and Hongzhang Liu and Jingyuan Liu and Junqi Liu and Liang Liu and Shaowei Liu and T. Y. Liu and Tianwei Liu and Weizhou Liu and Yangyang Liu and Yibo Liu and Yiping Liu and Yue Liu and Zhengying Liu and Enzhe Lu and Haoyu Lu and Lijun Lu and Yashuo Luo and Shengling Ma and Xinyu Ma and Yingwei Ma and Shaoguang Mao and Jie Mei and Xin Men and Yibo Miao and Siyuan Pan and Yebo Peng and Ruoyu Qin and Zeyu Qin and Bowen Qu and Zeyu Shang and Lidong Shi and Shengyuan Shi and Feifan Song and Jianlin Su and Zhengyuan Su and Lin Sui and Xinjie Sun and Flood Sung and Yunpeng Tai and Heyi Tang and Jiawen Tao and Qifeng Teng and Chaoran Tian and Chensi Wang and Dinglu Wang and Feng Wang and Hailong Wang and Haiming Wang and Jianzhou Wang and Jiaxing Wang and Jinhong Wang and Shengjie Wang and Shuyi Wang and Si Wang and Xinyuan Wang and Yao Wang and Yejie Wang and Yiqin Wang and Yuxin Wang and Yuzhi Wang and Zhaoji Wang and Zhengtao Wang and Zhengtao Wang and Zhexu Wang and Chu Wei and Qianqian Wei and Haoning Wu and Wenhao Wu and Xingzhe Wu and Yuxin Wu and Chenjun Xiao and Jin Xie and Xiaotong Xie and Weimin Xiong and Boyu Xu and Jinjing Xu and L. H. Xu and Lin Xu and Suting Xu and Weixin Xu and Xinran Xu and Yangchuan Xu and Ziyao Xu and Jing Xu and Jing Xu and Junjie Yan and Yuzi Yan and Hao Yang and Xiaofei Yang and Yi Yang and Ying Yang and Zhen Yang and Zhilin Yang and Zonghan Yang and Haotian Yao and Xingcheng Yao and Wenjie Ye and Zhuorui Ye and Bohong Yin and Longhui Yu and Enming Yuan and Hongbang Yuan and Mengjie Yuan and Siyu Yuan and Haobing Zhan and Dehao Zhang and Hao Zhang and Wanlu Zhang and Xiaobin Zhang and Yadong Zhang and Yangkun Zhang and Yichi Zhang and Yizhi Zhang and Yongting Zhang and Yu Zhang and Yutao Zhang and Yutong Zhang and Zheng Zhang and Haotian Zhao and Yikai Zhao and Zijia Zhao and Huabin Zheng and Shaojie Zheng and Longguang Zhong and Jianren Zhou and Xinyu Zhou and Zaida Zhou and Jinguo Zhu and Zhen Zhu and Weiyu Zhuang and Xinxing Zu},
journal= {arXiv preprint arXiv:2507.20534},
year = {2026}
}
备注
tech report of Kimi K2, with minor updates