English
Related papers

Related papers: LLM-Assisted Cheating Detection in Korean Language…

200 papers

Detecting cognitive biases in large language models (LLMs) is a fascinating task that aims to probe the existing cognitive biases within these models. Current methods for detecting cognitive biases in language models generally suffer from…

Computation and Language · Computer Science 2024-10-08 Zhentao Xie , Jiabao Zhao , Yilei Wang , Jinxin Shi , Yanhong Bai , Xingjiao Wu , Liang He

Large Language Models (LLMs) are increasingly deployed as autonomous agents capable of reasoning, planning, and acting within interactive environments. Despite their growing capability to perform multi-step reasoning and decision-making…

Large language models (LLMs) solve complex problems yet fail on simpler variants, suggesting they achieve correct outputs through mechanisms fundamentally different from human reasoning. To understand this gap, we synthesize cognitive…

Although negation is known to challenge large language models (LLMs), benchmarks for evaluating negation understanding, especially in Korean, are scarce. We conduct a corpus-based analysis of Korean negation and show that LLM performance…

Computation and Language · Computer Science 2026-01-09 Sungmok Jung , Yeonkyoung So , Joonhak Lee , Sangho Kim , Yelim Ahn , Jaejin Lee

While Long Chain-of-Thought (CoT) reasoning significantly improves Large Language Models (LLMs) performance on complex reasoning tasks, the substantial computational and memory costs of generating long CoT sequences limit their efficiency…

Artificial Intelligence · Computer Science 2026-02-03 Liang Zhang , Yu Zhao , Longyue Wang , Tianqi Shi , Weihua Luo , Kaifu Zhang , Jinsong Su

Large Language Models (LLMs) are increasingly relied upon to evaluate text outputs of other LLMs, thereby influencing leaderboards and development decisions. However, concerns persist over the accuracy of these assessments and the potential…

Computation and Language · Computer Science 2024-11-27 Sumanth Doddapaneni , Mohammed Safi Ur Rahman Khan , Sshubam Verma , Mitesh M. Khapra

Chain-of-thought explanations are widely used to inspect the decision process of large language models (LLMs) and to evaluate the trustworthiness of model outputs, making them important for effective collaboration between LLMs and humans.…

Computation and Language · Computer Science 2025-07-16 Pedro Ferreira , Wilker Aziz , Ivan Titov

The purpose of this study is to assess how large language models (LLMs) can be used for fact-checking and contribute to the broader debate on the use of automated means for veracity identification. To achieve this purpose, we use AI…

Computation and Language · Computer Science 2025-03-12 Elizaveta Kuznetsova , Ilaria Vitulano , Mykola Makhortykh , Martha Stolze , Tomas Nagy , Victoria Vziatysheva

While large language models (LLMs) such as ChatGPT and PaLM have demonstrated remarkable performance in various language understanding and generation tasks, their capabilities in complex reasoning and intricate knowledge utilization still…

Computation and Language · Computer Science 2023-10-11 Haodi Zhang , Min Cai , Xinhe Zhang , Chen Jason Zhang , Rui Mao , Kaishun Wu

We show that large language models (LLMs) exhibit an $\textit{internal chain-of-thought}$: they sequentially decompose and execute composite tasks layer-by-layer. Two claims ground our study: (i) distinct subtasks are learned at different…

Computation and Language · Computer Science 2025-09-30 Zhipeng Yang , Junzhuo Li , Siyu Xia , Xuming Hu

This paper presents a temporal expression language for monitoring AI agent behavior, enabling systematic error-detection of LLM-based agentic systems that exhibit variable outputs due to stochastic generation processes. Drawing from…

Artificial Intelligence · Computer Science 2025-09-26 Thomas J Sheffler

We present Raon-Speech, a top-performing 9B-parameter speech language model (SpeechLM) for English and Korean speech understanding, answering, and generation, and Raon-SpeechChat, a high-performing full-duplex extension for natural…

Large Language Models (LLMs) have achieved remarkable success in Natural Language Processing (NLP), yet their cross-lingual performance consistency remains a significant challenge. This paper introduces a novel methodology for efficiently…

Computation and Language · Computer Science 2025-05-27 Zixiang Xu , Yanbo Wang , Yue Huang , Xiuying Chen , Jieyu Zhao , Meng Jiang , Xiangliang Zhang

Understanding a program's runtime reasoning behavior, meaning how intermediate states and control flows lead to final execution results, is essential for reliable code generation, debugging, and automated reasoning. Although large language…

Software Engineering · Computer Science 2025-12-02 Mohammad Abdollahi , Khandaker Rifah Tasnia , Soumit Kanti Saha , Jinqiu Yang , Song Wang , Hadi Hemmati

Most of the post-processing methods for character recognition rely on contextual information of character and word-fragment levels. However, due to linguistic characteristics of Korean, such low-level information alone is not sufficient for…

cmp-lg · Computer Science 2008-02-03 Geunbae Lee , Jong-Hyeok Lee , JinHee Yoo

Large language models (LLMs) can generate chains of thought (CoTs) that are not always causally responsible for their final outputs. When such a mismatch occurs, the CoT no longer faithfully reflects the actual reasons (i.e.,…

Artificial Intelligence · Computer Science 2026-04-03 Han Wang , Yifan Sun , Brian Ko , Mann Talati , Jiawen Gong , Zimeng Li , Naicheng Yu , Xucheng Yu , Wei Shen , Vedant Jolly , Huan Zhang

This work introduces approaches to assessing phrase breaks in ESL learners' speech using pre-trained language models (PLMs) and large language models (LLMs). There are two tasks: overall assessment of phrase break for a speech clip and…

Computation and Language · Computer Science 2023-06-09 Zhiyi Wang , Shaoguang Mao , Wenshan Wu , Yan Xia , Yan Deng , Jonathan Tien

While Large language model (LLM)-based programming assistants such as CoPilot and ChatGPT can help improve the productivity of professional software developers, they can also facilitate cheating in introductory computer programming courses.…

Computation and Language · Computer Science 2024-10-16 Saiful Islam Salim , Rubin Yuchan Yang , Alexander Cooper , Suryashree Ray , Saumya Debray , Sazzadur Rahaman

We introduce HyperCLOVA X, a family of large language models (LLMs) tailored to the Korean language and culture, along with competitive capabilities in English, math, and coding. HyperCLOVA X was trained on a balanced mix of Korean,…

Computation and Language · Computer Science 2024-04-16 Kang Min Yoo , Jaegeun Han , Sookyo In , Heewon Jeon , Jisu Jeong , Jaewook Kang , Hyunwook Kim , Kyung-Min Kim , Munhyong Kim , Sungju Kim , Donghyun Kwak , Hanock Kwak , Se Jung Kwon , Bado Lee , Dongsoo Lee , Gichang Lee , Jooho Lee , Baeseong Park , Seongjin Shin , Joonsang Yu , Seolki Baek , Sumin Byeon , Eungsup Cho , Dooseok Choe , Jeesung Han , Youngkyun Jin , Hyein Jun , Jaeseung Jung , Chanwoong Kim , Jinhong Kim , Jinuk Kim , Dokyeong Lee , Dongwook Park , Jeong Min Sohn , Sujung Han , Jiae Heo , Sungju Hong , Mina Jeon , Hyunhoon Jung , Jungeun Jung , Wangkyo Jung , Chungjoon Kim , Hyeri Kim , Jonghyun Kim , Min Young Kim , Soeun Lee , Joonhee Park , Jieun Shin , Sojin Yang , Jungsoon Yoon , Hwaran Lee , Sanghwan Bae , Jeehwan Cha , Karl Gylleus , Donghoon Ham , Mihak Hong , Youngki Hong , Yunki Hong , Dahyun Jang , Hyojun Jeon , Yujin Jeon , Yeji Jeong , Myunggeun Ji , Yeguk Jin , Chansong Jo , Shinyoung Joo , Seunghwan Jung , Adrian Jungmyung Kim , Byoung Hoon Kim , Hyomin Kim , Jungwhan Kim , Minkyoung Kim , Minseung Kim , Sungdong Kim , Yonghee Kim , Youngjun Kim , Youngkwan Kim , Donghyeon Ko , Dughyun Lee , Ha Young Lee , Jaehong Lee , Jieun Lee , Jonghyun Lee , Jongjin Lee , Min Young Lee , Yehbin Lee , Taehong Min , Yuri Min , Kiyoon Moon , Hyangnam Oh , Jaesun Park , Kyuyon Park , Younghun Park , Hanbae Seo , Seunghyun Seo , Mihyun Sim , Gyubin Son , Matt Yeo , Kyung Hoon Yeom , Wonjoon Yoo , Myungin You , Doheon Ahn , Homin Ahn , Joohee Ahn , Seongmin Ahn , Chanwoo An , Hyeryun An , Junho An , Sang-Min An , Boram Byun , Eunbin Byun , Jongho Cha , Minji Chang , Seunggyu Chang , Haesong Cho , Youngdo Cho , Dalnim Choi , Daseul Choi , Hyoseok Choi , Minseong Choi , Sangho Choi , Seongjae Choi , Wooyong Choi , Sewhan Chun , Dong Young Go , Chiheon Ham , Danbi Han , Jaemin Han , Moonyoung Hong , Sung Bum Hong , Dong-Hyun Hwang , Seongchan Hwang , Jinbae Im , Hyuk Jin Jang , Jaehyung Jang , Jaeni Jang , Sihyeon Jang , Sungwon Jang , Joonha Jeon , Daun Jeong , Joonhyun Jeong , Kyeongseok Jeong , Mini Jeong , Sol Jin , Hanbyeol Jo , Hanju Jo , Minjung Jo , Chaeyoon Jung , Hyungsik Jung , Jaeuk Jung , Ju Hwan Jung , Kwangsun Jung , Seungjae Jung , Soonwon Ka , Donghan Kang , Soyoung Kang , Taeho Kil , Areum Kim , Beomyoung Kim , Byeongwook Kim , Daehee Kim , Dong-Gyun Kim , Donggook Kim , Donghyun Kim , Euna Kim , Eunchul Kim , Geewook Kim , Gyu Ri Kim , Hanbyul Kim , Heesu Kim , Isaac Kim , Jeonghoon Kim , Jihye Kim , Joonghoon Kim , Minjae Kim , Minsub Kim , Pil Hwan Kim , Sammy Kim , Seokhun Kim , Seonghyeon Kim , Soojin Kim , Soong Kim , Soyoon Kim , Sunyoung Kim , Taeho Kim , Wonho Kim , Yoonsik Kim , You Jin Kim , Yuri Kim , Beomseok Kwon , Ohsung Kwon , Yoo-Hwan Kwon , Anna Lee , Byungwook Lee , Changho Lee , Daun Lee , Dongjae Lee , Ha-Ram Lee , Hodong Lee , Hwiyeong Lee , Hyunmi Lee , Injae Lee , Jaeung Lee , Jeongsang Lee , Jisoo Lee , Jongsoo Lee , Joongjae Lee , Juhan Lee , Jung Hyun Lee , Junghoon Lee , Junwoo Lee , Se Yun Lee , Sujin Lee , Sungjae Lee , Sungwoo Lee , Wonjae Lee , Zoo Hyun Lee , Jong Kun Lim , Kun Lim , Taemin Lim , Nuri Na , Jeongyeon Nam , Kyeong-Min Nam , Yeonseog Noh , Biro Oh , Jung-Sik Oh , Solgil Oh , Yeontaek Oh , Boyoun Park , Cheonbok Park , Dongju Park , Hyeonjin Park , Hyun Tae Park , Hyunjung Park , Jihye Park , Jooseok Park , Junghwan Park , Jungsoo Park , Miru Park , Sang Hee Park , Seunghyun Park , Soyoung Park , Taerim Park , Wonkyeong Park , Hyunjoon Ryu , Jeonghun Ryu , Nahyeon Ryu , Soonshin Seo , Suk Min Seo , Yoonjeong Shim , Kyuyong Shin , Wonkwang Shin , Hyun Sim , Woongseob Sim , Hyejin Soh , Bokyong Son , Hyunjun Son , Seulah Son , Chi-Yun Song , Chiyoung Song , Ka Yeon Song , Minchul Song , Seungmin Song , Jisung Wang , Yonggoo Yeo , Myeong Yeon Yi , Moon Bin Yim , Taehwan Yoo , Youngjoon Yoo , Sungmin Yoon , Young Jin Yoon , Hangyeol Yu , Ui Seon Yu , Xingdong Zuo , Jeongin Bae , Joungeun Bae , Hyunsoo Cho , Seonghyun Cho , Yongjin Cho , Taekyoon Choi , Yera Choi , Jiwan Chung , Zhenghui Han , Byeongho Heo , Euisuk Hong , Taebaek Hwang , Seonyeol Im , Sumin Jegal , Sumin Jeon , Yelim Jeong , Yonghyun Jeong , Can Jiang , Juyong Jiang , Jiho Jin , Ara Jo , Younghyun Jo , Hoyoun Jung , Juyoung Jung , Seunghyeong Kang , Dae Hee Kim , Ginam Kim , Hangyeol Kim , Heeseung Kim , Hyojin Kim , Hyojun Kim , Hyun-Ah Kim , Jeehye Kim , Jin-Hwa Kim , Jiseon Kim , Jonghak Kim , Jung Yoon Kim , Rak Yeong Kim , Seongjin Kim , Seoyoon Kim , Sewon Kim , Sooyoung Kim , Sukyoung Kim , Taeyong Kim , Naeun Ko , Bonseung Koo , Heeyoung Kwak , Haena Kwon , Youngjin Kwon , Boram Lee , Bruce W. Lee , Dagyeong Lee , Erin Lee , Euijin Lee , Ha Gyeong Lee , Hyojin Lee , Hyunjeong Lee , Jeeyoon Lee , Jeonghyun Lee , Jongheok Lee , Joonhyung Lee , Junhyuk Lee , Mingu Lee , Nayeon Lee , Sangkyu Lee , Se Young Lee , Seulgi Lee , Seung Jin Lee , Suhyeon Lee , Yeonjae Lee , Yesol Lee , Youngbeom Lee , Yujin Lee , Shaodong Li , Tianyu Liu , Seong-Eun Moon , Taehong Moon , Max-Lasse Nihlenramstroem , Wonseok Oh , Yuri Oh , Hongbeen Park , Hyekyung Park , Jaeho Park , Nohil Park , Sangjin Park , Jiwon Ryu , Miru Ryu , Simo Ryu , Ahreum Seo , Hee Seo , Kangdeok Seo , Jamin Shin , Seungyoun Shin , Heetae Sin , Jiangping Wang , Lei Wang , Ning Xiang , Longxiang Xiao , Jing Xu , Seonyeong Yi , Haanju Yoo , Haneul Yoo , Hwanhee Yoo , Liang Yu , Youngjae Yu , Weijie Yuan , Bo Zeng , Qian Zhou , Kyunghyun Cho , Jung-Woo Ha , Joonsuk Park , Jihyun Hwang , Hyoung Jo Kwon , Soonyong Kwon , Jungyeon Lee , Seungho Lee , Seonghyeon Lim , Hyunkyung Noh , Seungho Choi , Sang-Woo Lee , Jung Hwa Lim , Nako Sung

We introduce Llama-3-Motif, a language model consisting of 102 billion parameters, specifically designed to enhance Korean capabilities while retaining strong performance in English. Developed on the Llama 3 architecture, Llama-3-Motif…