English
Related papers

Related papers: Dimension-Level Intent Fidelity Evaluation for Lar…

200 papers

Large language models trained predominantly on high-resource languages exhibit systematic biases toward dominant typological patterns, leading to structural non-conformance when translating into typologically divergent low-resource…

Computation and Language · Computer Science 2026-02-03 Nipuna Abeykoon , Ashen Weerathunga , Pubudu Wijesinghe , Parameswari Krishnamurthy

Large Language Models (LLMs) have achieved remarkable success across a wide spectrum of natural language processing tasks. However, their ever-growing scale introduces significant barriers to real-world deployment, including substantial…

Computation and Language · Computer Science 2026-01-07 Guangxin Wu , Hao Zhang , Zhang Zhibin , Jiafeng Guo , Xueqi Cheng

We introduce a two-dimensional (2D) early exit strategy that coordinates layer-wise and sentence-wise exiting for classification tasks in large language models. By processing input incrementally sentence-by-sentence while progressively…

Computation and Language · Computer Science 2026-04-22 Jan Hůla , David Adamczyk , Tomáš Filip , Martin Pavlíček , Petr Sosík

Large language models (LLMs) show promise for extracting clinically meaningful information from unstructured health records, yet their translation into real-world settings is constrained by the lack of scalable and trustworthy validation…

Large language models (LLMs) generate fluent text across a wide range of tasks, but the fabrication of non-existent academic citations remains a critical and well-documented failure mode. Building on prior work that frames hallucination and…

Computation and Language · Computer Science 2026-05-06 Junichiro Niimi

Multilingual reasoning remains a significant challenge for large language models (LLMs), with performance disproportionately favoring high-resource languages. Drawing inspiration from cognitive neuroscience, which suggests that human…

Computation and Language · Computer Science 2025-12-12 Weixiang Zhao , Jiahe Guo , Yang Deng , Tongtong Wu , Wenxuan Zhang , Yulin Hu , Xingyu Sui , Yanyan Zhao , Wanxiang Che , Bing Qin , Tat-Seng Chua , Ting Liu

One of the key strengths of Large Language Models (LLMs) is their ability to interact with humans by generating appropriate responses to given instructions. This ability, known as instruction-following capability, has established a…

Artificial Intelligence · Computer Science 2025-01-24 Hyeonseok Moon , Jaehyung Seo , Seungyoon Lee , Chanjun Park , Heuiseok Lim

Multilingual large language models (LLMs) are expected to recall factual knowledge consistently across languages. However, the factors that give rise to such crosslingual consistency -- and its frequent failure -- remain poorly understood.…

Computation and Language · Computer Science 2025-10-14 Yihong Liu , Mingyang Wang , François Yvon , Hinrich Schütze

Speech Language Models (SLMs) exhibit strong semantic understanding, yet their generated speech often sounds flat and fails to convey expressive intent, undermining user engagement. We term this mismatch the semantic understanding-acoustic…

Computation and Language · Computer Science 2026-04-14 Kuang Wang , Lai Wei , Qibing Bai , Ping Lin , Wenkai Fang , Feng Jiang , Zhongjie Jiang , Jun Huang , Yannan Wang , Haizhou Li

This paper investigates whether Large Language Models (LLMs), fine-tuned on synthetic but domain-representative data, can perform the twofold task of (i) slot and intent detection and (ii) natural language response generation for a smart…

Computation and Language · Computer Science 2025-03-24 Rune Birkmose , Nathan Mørkeberg Reece , Esben Hofstedt Norvin , Johannes Bjerva , Mike Zhang

Large language models (LLMs) trained on massive multilingual datasets hint at the formation of interlingual constructs--a shared subspace in the representation space. However, evidence regarding this phenomenon is mixed, leaving it unclear…

Computation and Language · Computer Science 2025-08-19 Bryan Wilie , Samuel Cahyawijaya , Junxian He , Pascale Fung

We present a methodology for improving the accuracy of faithfulness evaluation in Large Language Models (LLMs). The proposed methodology is based on the combination of elementary faithfulness metrics into a combined (fused) metric, for the…

Computation and Language · Computer Science 2025-12-08 Ben Malin , Tatiana Kalganova , Nikolaos Boulgouris

Large Language Models (LLMs) display striking surface fluency yet systematically fail at tasks requiring symbolic reasoning, arithmetic accuracy, and logical consistency. This paper offers a structural diagnosis of such failures, revealing…

Artificial Intelligence · Computer Science 2025-11-17 Zheng Zhang

Large language models (LLMs) offer transformative potential for clinical decision support in spine surgery but pose significant risks through hallucinations, which are factually inconsistent or contextually misaligned outputs that may…

Machine Learning · Computer Science 2025-11-21 Dong Chen , Yanzhe Wei , Zonglin He , Guan-Ming Kuang , Canhua Ye , Meiru An , Huili Peng , Yong Hu , Huiren Tao , Kenneth MC Cheung

Large language models (LLMs) are increasingly deployed in domains where errors carry high social, scientific, or safety costs. Yet standard confidence estimators, such as token likelihood, semantic similarity and multi-sample consistency,…

Computation and Language · Computer Science 2026-02-03 Pengyue Yang , Jiawen Wen , Haolin Jin , Linghan Huang , Huaming Chen , Ling Chen

LLMs enable qualitative coding at large scale, but assessing reliability remains challenging where human experts seldom agree. We investigate confidence-diversity calibration as a quality assessment framework for accessible coding tasks…

Machine Learning · Computer Science 2025-08-19 Zhilong Zhao , Yindi Liu

Recent advances in large language models (LLMs) have enabled impressive performance in various tasks. However, standard prompting often struggles to produce structurally valid and accurate outputs, especially in dependency parsing. We…

Computation and Language · Computer Science 2025-06-17 Hiroshi Matsuda , Chunpeng Ma , Masayuki Asahara

Large language models(LLMs) have garnered significant attention and demonstrated impressive capabilities in a wide range of applications. However, due to their enormous computational costs, the deployment and application of LLMs are often…

Machine Learning · Computer Science 2025-05-30 Jialong Guo , Xinghao Chen , Yehui Tang , Yunhe Wang

Cognitive distortions have been closely linked to mental health disorders, yet their automatic detection remains challenging due to contextual ambiguity, co-occurrence, and semantic overlap. We propose a novel framework that combines Large…

Computation and Language · Computer Science 2026-04-20 Jun Seo Kim , Hyemi Kim , Woo Joo Oh , Hongjin Cho , Hochul Lee , Hye Hyeon Kim

Language interpretation is a compositional process, in which the meaning of more complex linguistic structures is inferred from the meaning of their parts. Large language models possess remarkable language interpretation capabilities and…

Artificial Intelligence · Computer Science 2025-10-31 David Maria Schmidt , Raoul Schubert , Philipp Cimiano