English

Thunder-KoNUBench: A Corpus-Aligned Benchmark for Korean Negation Understanding

Computation and Language 2026-01-09 v1

Abstract

Although negation is known to challenge large language models (LLMs), benchmarks for evaluating negation understanding, especially in Korean, are scarce. We conduct a corpus-based analysis of Korean negation and show that LLM performance degrades under negation. We then introduce Thunder-KoNUBench, a sentence-level benchmark that reflects the empirical distribution of Korean negation phenomena. Evaluating 47 LLMs, we analyze the effects of model size and instruction tuning, and show that fine-tuning on Thunder-KoNUBench improves negation understanding and broader contextual comprehension in Korean.

Cite

@article{arxiv.2601.04693,
  title  = {Thunder-KoNUBench: A Corpus-Aligned Benchmark for Korean Negation Understanding},
  author = {Sungmok Jung and Yeonkyoung So and Joonhak Lee and Sangho Kim and Yelim Ahn and Jaejin Lee},
  journal= {arXiv preprint arXiv:2601.04693},
  year   = {2026}
}
R2 v1 2026-07-01T08:55:42.152Z