Intern-S1:面向科学多模态的基础模型
机器学习
2025-08-26 v2 计算与语言
计算机视觉与模式识别
摘要
近年来,众多开源基础模型涌现,在一些广受关注的领域取得了显著进展,性能与闭源模型不相上下。然而在高价值但更具挑战性的科学专业领域,要么仍依赖专家模型,要么通用基础模型的进展与热门领域有显著差距,远远不足以改变科学研究格局,在这些科学领域中,开源模型与闭源模型之间仍存在显著鸿沟。为弥合这一差距并进一步迈向人工通用智能(AGI),我们介绍了Intern-S1,这是一个具备通用理解与推理能力、专注于分析多模态科学数据的专业化通用模型。Intern-S1是一种具有280亿激活参数、总计2410亿参数的多模态混合专家(Mixture-of-Experts, MoE)模型,持续预训练了5万亿个标记,其中包括超过2.5万亿个来自科学领域的标记。在后训练阶段,Intern-S1在InternBootCamp中进行离线后线上强化学习(RL)训练,我们提出了Mixture-of-Rewards(MoR)以协同在超过1000个任务上的RL训练。通过在算法、数据和训练系统方面的集成创新,Intern-S1在线RL训练中实现了顶级性能。在全面的评估基准测试中,Intern-S1在通用推理任务上表现与开源模型相当,在科学领域显著超越开源模型,在诸如分子合成规划、反应条件预测、预测晶体热力学稳定性等专业任务中超过闭源最先进模型。我们的模型已在https://huggingface.co/internlm/Intern-S1 上提供。
引用
@article{arxiv.2508.15763,
title = {Intern-S1: A Scientific Multimodal Foundation Model},
author = {Lei Bai and Zhongrui Cai and Yuhang Cao and Maosong Cao and Weihan Cao and Chiyu Chen and Haojiong Chen and Kai Chen and Pengcheng Chen and Ying Chen and Yongkang Chen and Yu Cheng and Pei Chu and Tao Chu and Erfei Cui and Ganqu Cui and Long Cui and Ziyun Cui and Nianchen Deng and Ning Ding and Nanqing Dong and Peijie Dong and Shihan Dou and Sinan Du and Haodong Duan and Caihua Fan and Ben Gao and Changjiang Gao and Jianfei Gao and Songyang Gao and Yang Gao and Zhangwei Gao and Jiaye Ge and Qiming Ge and Lixin Gu and Yuzhe Gu and Aijia Guo and Qipeng Guo and Xu Guo and Conghui He and Junjun He and Yili Hong and Siyuan Hou and Caiyu Hu and Hanglei Hu and Jucheng Hu and Ming Hu and Zhouqi Hua and Haian Huang and Junhao Huang and Xu Huang and Zixian Huang and Zhe Jiang and Lingkai Kong and Linyang Li and Peiji Li and Pengze Li and Shuaibin Li and Tianbin Li and Wei Li and Yuqiang Li and Dahua Lin and Junyao Lin and Tianyi Lin and Zhishan Lin and Hongwei Liu and Jiangning Liu and Jiyao Liu and Junnan Liu and Kai Liu and Kaiwen Liu and Kuikun Liu and Shichun Liu and Shudong Liu and Wei Liu and Xinyao Liu and Yuhong Liu and Zhan Liu and Yinquan Lu and Haijun Lv and Hongxia Lv and Huijie Lv and Qitan Lv and Ying Lv and Chengqi Lyu and Chenglong Ma and Jianpeng Ma and Ren Ma and Runmin Ma and Runyuan Ma and Xinzhu Ma and Yichuan Ma and Zihan Ma and Sixuan Mi and Junzhi Ning and Wenchang Ning and Xinle Pang and Jiahui Peng and Runyu Peng and Yu Qiao and Jiantao Qiu and Xiaoye Qu and Yuan Qu and Yuchen Ren and Fukai Shang and Wenqi Shao and Junhao Shen and Shuaike Shen and Chunfeng Song and Demin Song and Diping Song and Chenlin Su and Weijie Su and Weigao Sun and Yu Sun and Qian Tan and Cheng Tang and Huanze Tang and Kexian Tang and Shixiang Tang and Jian Tong and Aoran Wang and Bin Wang and Dong Wang and Lintao Wang and Rui Wang and Weiyun Wang and Wenhai Wang and Jiaqi Wang and Yi Wang and Ziyi Wang and Ling-I Wu and Wen Wu and Yue Wu and Zijian Wu and Linchen Xiao and Shuhao Xing and Chao Xu and Huihui Xu and Jun Xu and Ruiliang Xu and Wanghan Xu and GanLin Yang and Yuming Yang and Haochen Ye and Jin Ye and Shenglong Ye and Jia Yu and Jiashuo Yu and Jing Yu and Fei Yuan and Yuhang Zang and Bo Zhang and Chao Zhang and Chen Zhang and Hongjie Zhang and Jin Zhang and Qiaosheng Zhang and Qiuyinzhe Zhang and Songyang Zhang and Taolin Zhang and Wenlong Zhang and Wenwei Zhang and Yechen Zhang and Ziyang Zhang and Haiteng Zhao and Qian Zhao and Xiangyu Zhao and Xiangyu Zhao and Bowen Zhou and Dongzhan Zhou and Peiheng Zhou and Yuhao Zhou and Yunhua Zhou and Dongsheng Zhu and Lin Zhu and Yicheng Zou},
journal= {arXiv preprint arXiv:2508.15763},
year = {2025}
}