K2-Think:一种参数高效的推理系统
机器学习
2025-09-16 v3
摘要
K2-Think是一个推理系统,它利用一个32B参数的模型实现了最先进的性能,匹敌甚至超越了像GPT-OSS 120B和DeepSeek v3.1这样的大得多的模型。我们的系统基于Qwen2.5基础模型构建,表明通过结合先进的后训练和测试时计算技术,较小的模型也能在最高水平上竞争。该方法基于六大关键技术支柱:长链思维监督微调、基于可验证奖励的强化学习(RLVR)、推理前的智能体规划、测试时扩展、推测性解码以及推理优化硬件,所有这些都使用了公开可用的开源数据集。K2-Think在数学推理方面表现出色,在开源模型的公开基准测试中取得了最先进的分数,同时在代码和科学等其他领域也表现强劲。我们的结果证实,像K2-Think 32B这样参数效率更高的模型,通过包含长链思维训练和战略性推理时增强的集成后训练方案,能够与最先进的系统竞争,使开源推理系统更易获取且成本更低。K2-Think可在k2think.ai免费获取,通过Cerebras晶圆级引擎提供每请求每秒超过2,000个token的一流推理速度。
引用
@article{arxiv.2509.07604,
title = {K2-Think: A Parameter-Efficient Reasoning System},
author = {Zhoujun Cheng and Richard Fan and Shibo Hao and Taylor W. Killian and Haonan Li and Suqi Sun and Hector Ren and Alexander Moreno and Daqian Zhang and Tianjun Zhong and Yuxin Xiong and Yuanzhe Hu and Yutao Xie and Xudong Han and Yuqi Wang and Varad Pimpalkhute and Yonghao Zhuang and Aaryamonvikram Singh and Xuezhi Liang and Anze Xie and Jianshu She and Desai Fan and Chengqian Gao and Liqun Ma and Mikhail Yurochkin and John Maggs and Xuezhe Ma and Guowei He and Zhiting Hu and Zhengzhong Liu and Eric P. Xing},
journal= {arXiv preprint arXiv:2509.07604},
year = {2025}
}
备注
To access the K2-Think reasoning system, please visit www.k2think.ai