English
Related papers

Related papers: Systematic Evaluation of Uncertainty Estimation Me…

200 papers

Modern Large Language Models (LLMs) often require external tools, such as machine learning classifiers or knowledge retrieval systems, to provide accurate answers in domains where their pre-trained knowledge is insufficient. This…

Machine Learning · Computer Science 2025-05-23 Panagiotis Lymperopoulos , Vasanth Sarathy

Large language models (LLMs) are increasingly used in applications requiring factual accuracy, yet their outputs often contain hallucinated responses. While fact-checking can mitigate these errors, existing methods typically retrieve…

Computation and Language · Computer Science 2026-01-07 Haoran Wang , Maryam Khalid , Qiong Wu , Jian Gao , Cheng Cao

Pretrained Large Language Models (LLMs) are prone to generating fluent yet factually incorrect text-a phenomenon known as hallucinations, undermining their reliability and utility in downstream tasks. We hypothesize that a generated text…

Computation and Language · Computer Science 2026-03-10 Koduvayur Subbalakshmi , Sabbir Hossain Ujjal , Venkata Krishna Teja Mangichetty , Nastaran Jamalipour Soofi

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks due to large training datasets and powerful transformer architecture. However, the reliability of responses from LLMs remains a question.…

Computation and Language · Computer Science 2025-02-26 Tiejin Chen , Xiaoou Liu , Longchao Da , Jia Chen , Vagelis Papalexakis , Hua Wei

We posit that large language models (LLMs) should be capable of expressing their intrinsic uncertainty in natural language. For example, if the LLM is equally likely to output two contradicting answers to the same question, then its…

Computation and Language · Computer Science 2024-09-27 Gal Yona , Roee Aharoni , Mor Geva

Large Language Models have difficulty communicating uncertainty, which is a significant obstacle to applying LLMs to complex medical tasks. This study evaluates methods to measure LLM confidence when suggesting a diagnosis for challenging…

Computation and Language · Computer Science 2023-12-11 Maia Kotelanski , Robert Gallo , Ashwin Nayak , Thomas Savage

As large language models (LLMs) are increasingly used for factual question-answering, it becomes more important for LLMs to have the capability to communicate the likelihood that their answer is correct. For these verbalized expressions of…

Computation and Language · Computer Science 2025-12-15 Sophia Hager , David Mueller , Kevin Duh , Nicholas Andrews

Can large language models (LLMs) express their uncertainty in situations where they lack sufficient parametric knowledge to generate reasonable responses? This work aims to systematically investigate LLMs' behaviors in such situations,…

Computation and Language · Computer Science 2024-02-19 Genglin Liu , Xingyao Wang , Lifan Yuan , Yangyi Chen , Hao Peng

Large Language Models (LLMs) have exploded a new heatwave of AI for their ability to engage end-users in human-level conversations with detailed and articulate answers across many knowledge domains. In response to their fast adoption in…

Accurately quantifying uncertainty in large language models (LLMs) is crucial for their reliable deployment, especially in high-stakes applications. Current state-of-the-art methods for measuring semantic uncertainty in LLMs rely on strict…

Machine Learning · Computer Science 2024-10-31 Yashvir S. Grewal , Edwin V. Bonilla , Thang D. Bui

We introduce BSDetector, a method for detecting bad and speculative answers from a pretrained Large Language Model by estimating a numeric confidence score for any output it generated. Our uncertainty quantification technique works for any…

Computation and Language · Computer Science 2023-10-05 Jiuhai Chen , Jonas Mueller

Large Multimodal Models (LMMs), harnessing the complementarity among diverse modalities, are often considered more robust than pure Language Large Models (LLMs); yet do LMMs know what they do not know? There are three key open questions…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Ruiyang Zhang , Hu Zhang , Hao Fei , Zhedong Zheng

The widespread adoption of web applications has made their security a critical concern and has increased the need for systematic ways to assess whether they can be considered trustworthy. However, "trust" assessment remains an open problem…

Cryptography and Security · Computer Science 2026-03-26 Oleksandr Yarotskyi , José D'Abruzzo Pereira , João R. Campos

Large Language Models (LLMs) have shown remarkable progress in multiple-choice question answering (MCQA), but their inherent unreliability, such as hallucination and overconfidence, limits their application in high-risk domains. To address…

Computation and Language · Computer Science 2025-08-08 Guang Yang , Xinyang Liu

Prediction sets provide a theoretically grounded framework for quantifying uncertainty in machine learning models. Adapting them to structured generation tasks, in particular, large language model (LLM) based code generation, remains a…

Software Engineering · Computer Science 2026-05-13 Senrong Xu , Yuhao Tan , Yanke Zhou , Guangyuan Wu , Zenan Li , Yuan Yao , Taolue Chen , Feng Xu , Xiaoxing Ma

Large Language Models have emerged as prime candidates to tackle misinformation mitigation. However, existing approaches struggle with hallucinations and overconfident predictions. We propose an uncertainty quantification framework that…

Computation and Language · Computer Science 2024-02-01 Mauricio Rivera , Jean-François Godbout , Reihaneh Rabbany , Kellin Pelrine

This study investigates semantic uncertainty in large language model (LLM) outputs across different decoding methods, focusing on emerging techniques like speculative sampling and chain-of-thought (CoT) decoding. Through experiments on…

Computation and Language · Computer Science 2025-06-24 Darius Foodeei , Simin Fan , Martin Jaggi

Multilingual Large Language Models (LLMs) develop cross-lingual abilities despite being trained on limited parallel data. However, they often struggle to generate responses in the intended language, favoring high-resource languages such as…

Computation and Language · Computer Science 2025-06-02 Elnaz Rahmati , Alireza S. Ziabari , Morteza Dehghani

This paper investigates Large Language Models (LLMs) ability to assess the economic soundness and theoretical consistency of empirical findings in spatial econometrics. We created original and deliberately altered "counterfactual" summaries…

Computers and Society · Computer Science 2025-06-10 Giuseppe Arbia , Luca Morandini , Vincenzo Nardelli

Large language models (LLMs) are increasingly deployed in domains where errors carry high social, scientific, or safety costs. Yet standard confidence estimators, such as token likelihood, semantic similarity and multi-sample consistency,…

Computation and Language · Computer Science 2026-02-03 Pengyue Yang , Jiawen Wen , Haolin Jin , Linghan Huang , Huaming Chen , Ling Chen