RakutenAI-7B：面向日语的大语言模型扩展
计算与语言
2024-03-26 v1 机器学习
摘要
我们介绍了RakutenAI-7B，一套面向日语的大语言模型，在日语LM Harness基准测试中，在开放的7B模型中取得了最佳性能。除了基础模型，我们还发布了指令微调和聊天微调模型，分别是RakutenAI-7B-instruct和RakutenAI-7B-chat，均采用Apache 2.0许可证。
关键词
引用
@article{arxiv.2403.15484,
title = {RakutenAI-7B: Extending Large Language Models for Japanese},
author = {Rakuten Group and Aaron Levine and Connie Huang and Chenguang Wang and Eduardo Batista and Ewa Szymanska and Hongyi Ding and Hou Wei Chou and Jean-François Pessiot and Johanes Effendi and Justin Chiu and Kai Torben Ohlhus and Karan Chopra and Keiji Shinzato and Koji Murakami and Lee Xiong and Lei Chen and Maki Kubota and Maksim Tkachenko and Miroku Lee and Naoki Takahashi and Prathyusha Jwalapuram and Ryutaro Tatsushima and Saurabh Jain and Sunil Kumar Yadav and Ting Cai and Wei-Te Chen and Yandi Xia and Yuki Nakayama and Yutaka Higashiyama},
journal= {arXiv preprint arXiv:2403.15484},
year = {2024}
}