HyperCLOVA X Technical Report
Computation and Language
2024-04-16 v2 Artificial Intelligence
Abstract
We introduce HyperCLOVA X, a family of large language models (LLMs) tailored to the Korean language and culture, along with competitive capabilities in English, math, and coding. HyperCLOVA X was trained on a balanced mix of Korean, English, and code data, followed by instruction-tuning with high-quality human-annotated datasets while abiding by strict safety guidelines reflecting our commitment to responsible AI. The model is evaluated across various benchmarks, including comprehensive reasoning, knowledge, commonsense, factuality, coding, math, chatting, instruction-following, and harmlessness, in both Korean and English. HyperCLOVA X exhibits strong reasoning capabilities in Korean backed by a deep understanding of the language and cultural nuances. Further analysis of the inherent bilingual nature and its extension to multilingualism highlights the model's cross-lingual proficiency and strong generalization ability to untargeted languages, including machine translation between several language pairs and cross-lingual inference tasks. We believe that HyperCLOVA X can provide helpful guidance for regions or countries in developing their sovereign LLMs.
Cite
@article{arxiv.2404.01954,
title = {HyperCLOVA X Technical Report},
author = {Kang Min Yoo and Jaegeun Han and Sookyo In and Heewon Jeon and Jisu Jeong and Jaewook Kang and Hyunwook Kim and Kyung-Min Kim and Munhyong Kim and Sungju Kim and Donghyun Kwak and Hanock Kwak and Se Jung Kwon and Bado Lee and Dongsoo Lee and Gichang Lee and Jooho Lee and Baeseong Park and Seongjin Shin and Joonsang Yu and Seolki Baek and Sumin Byeon and Eungsup Cho and Dooseok Choe and Jeesung Han and Youngkyun Jin and Hyein Jun and Jaeseung Jung and Chanwoong Kim and Jinhong Kim and Jinuk Kim and Dokyeong Lee and Dongwook Park and Jeong Min Sohn and Sujung Han and Jiae Heo and Sungju Hong and Mina Jeon and Hyunhoon Jung and Jungeun Jung and Wangkyo Jung and Chungjoon Kim and Hyeri Kim and Jonghyun Kim and Min Young Kim and Soeun Lee and Joonhee Park and Jieun Shin and Sojin Yang and Jungsoon Yoon and Hwaran Lee and Sanghwan Bae and Jeehwan Cha and Karl Gylleus and Donghoon Ham and Mihak Hong and Youngki Hong and Yunki Hong and Dahyun Jang and Hyojun Jeon and Yujin Jeon and Yeji Jeong and Myunggeun Ji and Yeguk Jin and Chansong Jo and Shinyoung Joo and Seunghwan Jung and Adrian Jungmyung Kim and Byoung Hoon Kim and Hyomin Kim and Jungwhan Kim and Minkyoung Kim and Minseung Kim and Sungdong Kim and Yonghee Kim and Youngjun Kim and Youngkwan Kim and Donghyeon Ko and Dughyun Lee and Ha Young Lee and Jaehong Lee and Jieun Lee and Jonghyun Lee and Jongjin Lee and Min Young Lee and Yehbin Lee and Taehong Min and Yuri Min and Kiyoon Moon and Hyangnam Oh and Jaesun Park and Kyuyon Park and Younghun Park and Hanbae Seo and Seunghyun Seo and Mihyun Sim and Gyubin Son and Matt Yeo and Kyung Hoon Yeom and Wonjoon Yoo and Myungin You and Doheon Ahn and Homin Ahn and Joohee Ahn and Seongmin Ahn and Chanwoo An and Hyeryun An and Junho An and Sang-Min An and Boram Byun and Eunbin Byun and Jongho Cha and Minji Chang and Seunggyu Chang and Haesong Cho and Youngdo Cho and Dalnim Choi and Daseul Choi and Hyoseok Choi and Minseong Choi and Sangho Choi and Seongjae Choi and Wooyong Choi and Sewhan Chun and Dong Young Go and Chiheon Ham and Danbi Han and Jaemin Han and Moonyoung Hong and Sung Bum Hong and Dong-Hyun Hwang and Seongchan Hwang and Jinbae Im and Hyuk Jin Jang and Jaehyung Jang and Jaeni Jang and Sihyeon Jang and Sungwon Jang and Joonha Jeon and Daun Jeong and Joonhyun Jeong and Kyeongseok Jeong and Mini Jeong and Sol Jin and Hanbyeol Jo and Hanju Jo and Minjung Jo and Chaeyoon Jung and Hyungsik Jung and Jaeuk Jung and Ju Hwan Jung and Kwangsun Jung and Seungjae Jung and Soonwon Ka and Donghan Kang and Soyoung Kang and Taeho Kil and Areum Kim and Beomyoung Kim and Byeongwook Kim and Daehee Kim and Dong-Gyun Kim and Donggook Kim and Donghyun Kim and Euna Kim and Eunchul Kim and Geewook Kim and Gyu Ri Kim and Hanbyul Kim and Heesu Kim and Isaac Kim and Jeonghoon Kim and Jihye Kim and Joonghoon Kim and Minjae Kim and Minsub Kim and Pil Hwan Kim and Sammy Kim and Seokhun Kim and Seonghyeon Kim and Soojin Kim and Soong Kim and Soyoon Kim and Sunyoung Kim and Taeho Kim and Wonho Kim and Yoonsik Kim and You Jin Kim and Yuri Kim and Beomseok Kwon and Ohsung Kwon and Yoo-Hwan Kwon and Anna Lee and Byungwook Lee and Changho Lee and Daun Lee and Dongjae Lee and Ha-Ram Lee and Hodong Lee and Hwiyeong Lee and Hyunmi Lee and Injae Lee and Jaeung Lee and Jeongsang Lee and Jisoo Lee and Jongsoo Lee and Joongjae Lee and Juhan Lee and Jung Hyun Lee and Junghoon Lee and Junwoo Lee and Se Yun Lee and Sujin Lee and Sungjae Lee and Sungwoo Lee and Wonjae Lee and Zoo Hyun Lee and Jong Kun Lim and Kun Lim and Taemin Lim and Nuri Na and Jeongyeon Nam and Kyeong-Min Nam and Yeonseog Noh and Biro Oh and Jung-Sik Oh and Solgil Oh and Yeontaek Oh and Boyoun Park and Cheonbok Park and Dongju Park and Hyeonjin Park and Hyun Tae Park and Hyunjung Park and Jihye Park and Jooseok Park and Junghwan Park and Jungsoo Park and Miru Park and Sang Hee Park and Seunghyun Park and Soyoung Park and Taerim Park and Wonkyeong Park and Hyunjoon Ryu and Jeonghun Ryu and Nahyeon Ryu and Soonshin Seo and Suk Min Seo and Yoonjeong Shim and Kyuyong Shin and Wonkwang Shin and Hyun Sim and Woongseob Sim and Hyejin Soh and Bokyong Son and Hyunjun Son and Seulah Son and Chi-Yun Song and Chiyoung Song and Ka Yeon Song and Minchul Song and Seungmin Song and Jisung Wang and Yonggoo Yeo and Myeong Yeon Yi and Moon Bin Yim and Taehwan Yoo and Youngjoon Yoo and Sungmin Yoon and Young Jin Yoon and Hangyeol Yu and Ui Seon Yu and Xingdong Zuo and Jeongin Bae and Joungeun Bae and Hyunsoo Cho and Seonghyun Cho and Yongjin Cho and Taekyoon Choi and Yera Choi and Jiwan Chung and Zhenghui Han and Byeongho Heo and Euisuk Hong and Taebaek Hwang and Seonyeol Im and Sumin Jegal and Sumin Jeon and Yelim Jeong and Yonghyun Jeong and Can Jiang and Juyong Jiang and Jiho Jin and Ara Jo and Younghyun Jo and Hoyoun Jung and Juyoung Jung and Seunghyeong Kang and Dae Hee Kim and Ginam Kim and Hangyeol Kim and Heeseung Kim and Hyojin Kim and Hyojun Kim and Hyun-Ah Kim and Jeehye Kim and Jin-Hwa Kim and Jiseon Kim and Jonghak Kim and Jung Yoon Kim and Rak Yeong Kim and Seongjin Kim and Seoyoon Kim and Sewon Kim and Sooyoung Kim and Sukyoung Kim and Taeyong Kim and Naeun Ko and Bonseung Koo and Heeyoung Kwak and Haena Kwon and Youngjin Kwon and Boram Lee and Bruce W. Lee and Dagyeong Lee and Erin Lee and Euijin Lee and Ha Gyeong Lee and Hyojin Lee and Hyunjeong Lee and Jeeyoon Lee and Jeonghyun Lee and Jongheok Lee and Joonhyung Lee and Junhyuk Lee and Mingu Lee and Nayeon Lee and Sangkyu Lee and Se Young Lee and Seulgi Lee and Seung Jin Lee and Suhyeon Lee and Yeonjae Lee and Yesol Lee and Youngbeom Lee and Yujin Lee and Shaodong Li and Tianyu Liu and Seong-Eun Moon and Taehong Moon and Max-Lasse Nihlenramstroem and Wonseok Oh and Yuri Oh and Hongbeen Park and Hyekyung Park and Jaeho Park and Nohil Park and Sangjin Park and Jiwon Ryu and Miru Ryu and Simo Ryu and Ahreum Seo and Hee Seo and Kangdeok Seo and Jamin Shin and Seungyoun Shin and Heetae Sin and Jiangping Wang and Lei Wang and Ning Xiang and Longxiang Xiao and Jing Xu and Seonyeong Yi and Haanju Yoo and Haneul Yoo and Hwanhee Yoo and Liang Yu and Youngjae Yu and Weijie Yuan and Bo Zeng and Qian Zhou and Kyunghyun Cho and Jung-Woo Ha and Joonsuk Park and Jihyun Hwang and Hyoung Jo Kwon and Soonyong Kwon and Jungyeon Lee and Seungho Lee and Seonghyeon Lim and Hyunkyung Noh and Seungho Choi and Sang-Woo Lee and Jung Hwa Lim and Nako Sung},
journal= {arXiv preprint arXiv:2404.01954},
year = {2024}
}
Comments
44 pages; updated authors list and fixed author names