English
Related papers

Related papers: LLM-Assisted Cheating Detection in Korean Language…

200 papers

Social engineering scams increasingly employ personalized, multi-turn deception, exposing the limits of traditional detection methods. While Large Language Models (LLMs) show promise in identifying deception, their cognitive assistance…

Artificial Intelligence · Computer Science 2026-01-21 Heedou Kim , Changsik Kim , Sanghwa Shin , Jaewoo Kang

We introduce KoBALT (Korean Benchmark for Advanced Linguistic Tasks), a comprehensive linguistically-motivated benchmark comprising 700 multiple-choice questions spanning 24 phenomena across five linguistic domains: syntax, semantics,…

Computation and Language · Computer Science 2025-05-23 Hyopil Shin , Sangah Lee , Dongjun Jang , Wooseok Song , Jaeyoon Kim , Chaeyoung Oh , Hyemi Jo , Youngchae Ahn , Sihyun Oh , Hyohyeong Chang , Sunkyoung Kim , Jinsik Lee

We present Ko-MuSR, the first benchmark to comprehensively evaluate multistep, soft reasoning in long Korean narratives while minimizing data contamination. Built following MuSR, Ko-MuSR features fully Korean narratives, reasoning chains,…

Computation and Language · Computer Science 2025-10-29 Chanwoo Park , Suyoung Park , JiA Kang , Jongyeon Park , Sangho Kim , Hyunji M. Park , Sumin Bae , Mingyu Kang , Jaejin Lee

Although LLMs have made significant progress in various languages, there are still concerns about their effectiveness with low-resource agglutinative languages compared to languages such as English. In this study, we focused on Korean, a…

Computation and Language · Computer Science 2025-07-08 Seunguk Yu , Kyeonghyun Kim , Jungmin Yun , Youngbin Kim

Large language models (LLMs) demonstrate exceptional performance on complex reasoning tasks. However, despite their strong reasoning capabilities in high-resource languages (e.g., English and Chinese), a significant performance gap persists…

Computation and Language · Computer Science 2025-02-03 Hyunwoo Ko , Guijin Son , Dasol Choi

Due to the fact that Korean is a highly agglutinative, character-rich language, previous work on Korean morphological analysis typically employs the use of sub-character features known as graphemes or otherwise utilizes comprehensive prior…

Computation and Language · Computer Science 2018-06-29 Andrew Matteson , Chanhee Lee , Young-Bum Kim , Heuiseok Lim

Large language models (LLMs) use pretraining to predict the subsequent word; however, their expansion requires significant computing resources. Numerous big tech companies and research institutes have developed multilingual LLMs (MLLMs) to…

Translating knowledge-intensive and entity-rich text between English and Korean requires transcreation to preserve language-specific and cultural nuances beyond literal, phonetic or word-for-word conversion. We evaluate 13 models (LLMs and…

Computation and Language · Computer Science 2025-04-30 Daniel Lee , Harsh Sharma , Jieun Han , Sunny Jeong , Alice Oh , Vered Shwartz

Cognitive distortion refers to negative thinking patterns that can lead to mental health issues like depression and anxiety in adolescents. Previous studies using natural language processing (NLP) have focused mainly on small-scale adult…

Computation and Language · Computer Science 2025-09-23 JunSeo Kim , HyeHyeon Kim

Pre-trained language models (LMs) have shown remarkable reasoning performance using explanations or chain-of-thoughts (CoT)) for in-context learning. On the other hand, these reasoning tasks are usually presumed to be more approachable for…

Computation and Language · Computer Science 2024-03-29 Yi-Fan Zhang , Hanlin Zhang , Li Erran Li , Eric Xing

What if large language models could not only infer human mindsets but also expose every blind spot in team dialogue such as discrepancies in the team members' joint understanding? We present a novel, two-step framework that leverages large…

Computation and Language · Computer Science 2025-09-03 Katharine Kowalyshyn , Matthias Scheutz

As large language models (LLMs) increasingly assist in evaluating student writing, researchers have begun questioning whether these models can be cognitively grounded, that is, whether they can attend not just to the final product, but to…

Human-Computer Interaction · Computer Science 2025-08-20 Samra Zafar , Shifa Yousaf , Muhammad Shaheer Minhas

Large language models (LLMs) demonstrate superior reasoning capabilities compared to small language models (SLMs), but incur substantially higher costs. We propose COllaborative REAsoner (COREA), a system that cascades an SLM with an LLM to…

Computation and Language · Computer Science 2026-03-05 Chuang Zhang , Zizhen Zhu , Yihao Wei , Bing Tian , Junyi Liu , Henan Wang , Xavier Wang , Yaxiao Liu

A well-formulated benchmark plays a critical role in spurring advancements in the natural language processing (NLP) field, as it allows objective and precise evaluation of diverse models. As modern language models (LMs) have become more…

Computation and Language · Computer Science 2022-04-12 Dohyeong Kim , Myeongjun Jang , Deuk Sin Kwon , Eric Davis

We introduce Korean Language Understanding Evaluation (KLUE) benchmark. KLUE is a collection of 8 Korean natural language understanding (NLU) tasks, including Topic Classification, SemanticTextual Similarity, Natural Language Inference,…

This work presents the first large-scale investigation into constructing a fully open bilingual large language model (LLM) for a non-English language, specifically Korean, trained predominantly on synthetic data. We introduce KORMo-10B, a…

Computation and Language · Computer Science 2025-10-13 Minjun Kim , Hyeonseok Lim , Hangyeol Yoo , Inho Won , Seungwoo Song , Minkyung Cho , Junhun Yuk , Changsu Choi , Dongjae Shin , Huige Lee , Hoyun Song , Alice Oh , Kyungtae Lim

The necessity of language-specific tokenizers intuitively appears crucial for effective natural language processing, yet empirical analyses on their significance and underlying reasons are lacking. This study explores how language-specific…

Computation and Language · Computer Science 2025-02-24 Jean Seo , Jaeyoon Kim , SungJoo Byun , Hyopil Shin

Lexical gaps are words that do not exist in certain languages. They pose challenges for building multilingual lexical resources, for machine translation, and for cross-lingual transfer. Existing lexical gap detection relies on human…

Computation and Language · Computer Science 2026-05-26 Yoonwon Jung , Aaron S. Cohen , Benjamin K. Bergen

Large language models like GPT have proven widely successful on natural language understanding tasks based on written text documents. In this paper, we investigate an LLM's performance on recordings of a group oral communication task in…

Computation and Language · Computer Science 2024-06-18 Zhuoxu Duan , Zhengye Yang , Samuel Westby , Christoph Riedl , Brooke Foucault Welles , Richard J. Radke