InternLM2 技术报告
计算与语言
2024-03-27 v1 人工智能
摘要
ChatGPT 和 GPT-4 等大型语言模型（LLMs）的演进引发了关于通用人工智能（AGI）到来的讨论。然而，在开源模型中复制这些进展一直具有挑战性。本文介绍了 InternLM2，这是一个开源 LLM，通过创新的预训练和优化技术，在涵盖 6 个维度和 30 个基准的综合评估、长上下文建模以及开放式主观评估中，均优于其前身。InternLM2 的预训练过程被细致地详述，重点介绍了包括文本、代码和长上下文数据在内的多种数据类型的准备。InternLM2 能高效捕获长期依赖关系，最初在 4k token 上进行训练，随后在预训练和微调阶段推进到 32k token，在 200k “大海捞针”测试中表现出卓越性能。InternLM2 进一步通过监督微调（SFT）和一种新颖的条件在线人类反馈强化学习（COOL RLHF）策略进行对齐，该策略解决了冲突的人类偏好和奖励黑客问题。通过发布不同训练阶段和模型大小的 InternLM2 模型，我们为社区提供了对该模型演进的见解。
引用
@article{arxiv.2403.17297,
title = {InternLM2 Technical Report},
author = {Zheng Cai and Maosong Cao and Haojiong Chen and Kai Chen and Keyu Chen and Xin Chen and Xun Chen and Zehui Chen and Zhi Chen and Pei Chu and Xiaoyi Dong and Haodong Duan and Qi Fan and Zhaoye Fei and Yang Gao and Jiaye Ge and Chenya Gu and Yuzhe Gu and Tao Gui and Aijia Guo and Qipeng Guo and Conghui He and Yingfan Hu and Ting Huang and Tao Jiang and Penglong Jiao and Zhenjiang Jin and Zhikai Lei and Jiaxing Li and Jingwen Li and Linyang Li and Shuaibin Li and Wei Li and Yining Li and Hongwei Liu and Jiangning Liu and Jiawei Hong and Kaiwen Liu and Kuikun Liu and Xiaoran Liu and Chengqi Lv and Haijun Lv and Kai Lv and Li Ma and Runyuan Ma and Zerun Ma and Wenchang Ning and Linke Ouyang and Jiantao Qiu and Yuan Qu and Fukai Shang and Yunfan Shao and Demin Song and Zifan Song and Zhihao Sui and Peng Sun and Yu Sun and Huanze Tang and Bin Wang and Guoteng Wang and Jiaqi Wang and Jiayu Wang and Rui Wang and Yudong Wang and Ziyi Wang and Xingjian Wei and Qizhen Weng and Fan Wu and Yingtong Xiong and Chao Xu and Ruiliang Xu and Hang Yan and Yirong Yan and Xiaogui Yang and Haochen Ye and Huaiyuan Ying and Jia Yu and Jing Yu and Yuhang Zang and Chuyu Zhang and Li Zhang and Pan Zhang and Peng Zhang and Ruijie Zhang and Shuo Zhang and Songyang Zhang and Wenjian Zhang and Wenwei Zhang and Xingcheng Zhang and Xinyue Zhang and Hui Zhao and Qian Zhao and Xiaomeng Zhao and Fengzhe Zhou and Zaida Zhou and Jingming Zhuo and Yicheng Zou and Xipeng Qiu and Yu Qiao and Dahua Lin},
journal= {arXiv preprint arXiv:2403.17297},
year = {2024}
}