English
Related papers

Related papers: CURE: Confidence-driven Unified Reasoning Ensemble…

200 papers

Knowledge augmentation has significantly enhanced the performance of Large Language Models (LLMs) in knowledge-intensive tasks. However, existing methods typically operate on the simplistic premise that model performance equates with…

Computation and Language · Computer Science 2026-02-16 Hao Chen , Ye He , Yuchun Fan , Yukun Yan , Zhenghao Liu , Qingfu Zhu , Maosong Sun , Wanxiang Che

As large language models (LLMs) become increasingly integrated into clinical decision-making, ensuring transparent and trustworthy reasoning is essential. However, existing evaluation strategies of LLMs' medical reasoning capability either…

Large language models (LLMs) are increasingly deployed in domains where errors carry high social, scientific, or safety costs. Yet standard confidence estimators, such as token likelihood, semantic similarity and multi-sample consistency,…

Computation and Language · Computer Science 2026-02-03 Pengyue Yang , Jiawen Wen , Haolin Jin , Linghan Huang , Huaming Chen , Ling Chen

Large Language Models (LLMs) have revolutionized inference across diverse natural language tasks, with larger models performing better but at higher computational costs. We propose a confidence-driven strategy that dynamically selects the…

Computation and Language · Computer Science 2026-02-26 Bo-Wei Chen , Chung-Chi Chen , An-Zi Yen

Large language models (LLMs) demonstrate advanced reasoning abilities, enabling robots to understand natural language instructions and generate high-level plans with appropriate grounding. However, LLM hallucinations present a significant…

Robotics · Computer Science 2025-10-10 Shiyuan Yin , Chenjia Bai , Zihao Zhang , Junwei Jin , Xinxin Zhang , Chi Zhang , Xuelong Li

Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, but the quality bar for medical and clinical applications is high. Today, attempts to assess models' clinical knowledge…

Large language models (LLMs) have achieved significant success in interacting with human. However, recent studies have revealed that these models often suffer from hallucinations, leading to overly confident but incorrect judgments. This…

Computation and Language · Computer Science 2023-09-06 Yusheng Liao , Yutong Meng , Hongcheng Liu , Yanfeng Wang , Yu Wang

Deployed language models must decide not only what to answer but also when not to answer. We present UniCR, a unified framework that turns heterogeneous uncertainty evidence including sequence likelihoods, self-consistency dispersion,…

Computation and Language · Computer Science 2025-12-30 Markus Oehri , Giulia Conti , Kaviraj Pather , Alexandre Rossi , Laia Serra , Adrian Parody , Rogvi Johannesen , Aviaja Petersen , Arben Krasniqi

Large Language Models (LLMs) have demonstrated impressive performance across various tasks, with different models excelling in distinct domains and specific abilities. Effectively combining the predictions of multiple LLMs is crucial for…

Computation and Language · Computer Science 2025-08-01 Jizhou Guo

Despite the wide adoption of Large Language Models (LLM)s, clinical decision support systems face a critical challenge: achieving high predictive accuracy while generating explanations aligned with the predictions. Current approaches suffer…

Artificial Intelligence · Computer Science 2026-05-07 H M Quamran Hasan , Housam Khalifa Bashier , Jiayi Dai , Mi-Young Kim , Randy Goebel

Large language models (LLMs) are increasingly adopted in medical question-answering (QA) scenarios. However, LLMs can generate hallucinations and nonfactual information, undermining their trustworthiness in high-stakes medical tasks.…

Computation and Language · Computer Science 2025-05-09 Yusong Ke , Hongru Lin , Yuting Ruan , Junya Tang , Li Li

Large language models (LLMs) with Chain-of-Thought (CoT) prompting achieve strong reasoning but often produce unnecessarily long explanations, increasing cost and sometimes reducing accuracy. Fair comparison of efficiency-oriented…

Computation and Language · Computer Science 2025-11-14 Junquan Huang , Haotian Wu , Yubo Gao , Yibo Yan , Junyan Zhang , Yonghua Hei , Song Dai , Jie Zhang , Puay Siew Tan , Xuming Hu

Ensuring the reliability of Large Language Models (LLMs) in complex reasoning tasks remains a formidable challenge, particularly in scenarios that demand precise mathematical calculations and knowledge-intensive open-domain generation. In…

Machine Learning · Computer Science 2025-05-27 Ali Razghandi , Seyed Mohammad Hadi Hosseini , Mahdieh Soleymani Baghshah

With the proliferation of large language models (LLMs) in the medical domain, there is increasing demand for improved evaluation techniques to assess their capabilities. However, traditional metrics like F1 and ROUGE, which rely on token…

Computation and Language · Computer Science 2025-05-20 Xiechi Zhang , Zetian Ouyang , Linlin Wang , Gerard de Melo , Zhu Cao , Xiaoling Wang , Ya Zhang , Yanfeng Wang , Liang He

Recent advances in large language models (LLMs), such as OpenAI-o1 and DeepSeek-R1, have demonstrated the effectiveness of test-time scaling, where extended reasoning processes substantially enhance model performance. Despite this, current…

Computation and Language · Computer Science 2025-03-26 Xiaoyu Tian , Sitong Zhao , Haotian Wang , Shuaiting Chen , Yunjie Ji , Yiping Peng , Han Zhao , Xiangang Li

The use of Large Language Models (LLMs) to support patients in addressing medical questions is becoming increasingly prevalent. However, most of the measures currently used to evaluate the performance of these models in this context only…

Human-Computer Interaction · Computer Science 2026-04-22 Abu Noman Md Sakib , Md. Main Oddin Chisty , Zijie Zhang

The emergence of Large Language Models (LLMs) has revealed a growing need for human-AI collaboration, especially in creative decision-making scenarios where trust and reliance are paramount. Through human studies and model evaluations on…

Computation and Language · Computer Science 2024-10-07 Manasi Sharma , Ho Chit Siu , Rohan Paleja , Jaime D. Peña

Patient-trial matching requires reasoning over long, heterogeneous electronic health records (EHRs) and complex eligibility criteria, posing significant challenges for scalability, generalization, and computational efficiency. Existing…

Computation and Language · Computer Science 2026-04-27 Xiaodi Li , Yang Xiao , Munhwan Lee , Konstantinos Leventakos , Young J. Juhn , David Jones , Terence T. Sio , Wei Liu , Maria Vassilaki , Nansu Zong

Large Language Models (LLMs) have made significant progress in various fields. However, challenges remain in Multi-Disciplinary Team (MDT) medical consultations. Current research enhances reasoning through role assignment, task…

Artificial Intelligence · Computer Science 2025-03-19 Kai Chen , Xinfeng Li , Tianpei Yang , Hewei Wang , Wei Dong , Yang Gao

Large Language Models (LLMs) have the potential of facilitating the development of Artificial Intelligence technology to assist medical experts for interactive decision support, which has been demonstrated by their competitive performances…

Computation and Language · Computer Science 2024-11-12 Iñigo Alonso , Maite Oronoz , Rodrigo Agerri