English
Related papers

Related papers: Black-box Uncertainty Quantification Method for LL…

200 papers

To facilitate healthcare delivery, language models (LMs) have significant potential for clinical prediction tasks using electronic health records (EHRs). However, in these high-stakes applications, unreliable decisions can result in high…

Computation and Language · Computer Science 2024-11-07 Zizhang Chen , Peizhao Li , Xiaomeng Dong , Pengyu Hong

We introduce BSDetector, a method for detecting bad and speculative answers from a pretrained Large Language Model by estimating a numeric confidence score for any output it generated. Our uncertainty quantification technique works for any…

Computation and Language · Computer Science 2023-10-05 Jiuhai Chen , Jonas Mueller

As LLM-as-a-Judge emerges as a new paradigm for assessing large language models (LLMs), concerns have been raised regarding the alignment, bias, and stability of LLM evaluators. While substantial work has focused on alignment and bias,…

Computation and Language · Computer Science 2025-03-04 Qiujie Xie , Qingqiu Li , Zhuohao Yu , Yuejie Zhang , Yue Zhang , Linyi Yang

Quantifying uncertainty in black-box LLMs is vital for reliable responses and scalable oversight. Existing methods, which gauge a model's uncertainty through evaluating self-consistency in responses to the target query, can be misleading:…

Computation and Language · Computer Science 2025-10-22 Yu Feng , Phu Mon Htut , Zheng Qi , Wei Xiao , Manuel Mager , Nikolaos Pappas , Kishaloy Halder , Yang Li , Yassine Benajiba , Dan Roth

Uncertainty quantification (UQ) methods for Large Language Models (LLMs) encompass a variety of approaches, with two major types being particularly prominent: information-based, which focus on model confidence expressed as token…

Computation and Language · Computer Science 2025-12-10 Roman Vashurin , Maiya Goloburda , Albina Ilina , Aleksandr Rubashevskii , Preslav Nakov , Artem Shelmanov , Maxim Panov

In-context learning has emerged as a groundbreaking ability of Large Language Models (LLMs) and revolutionized various fields by providing a few task-relevant demonstrations in the prompt. However, trustworthy issues with LLM's response,…

Computation and Language · Computer Science 2024-04-01 Chen Ling , Xujiang Zhao , Xuchao Zhang , Wei Cheng , Yanchi Liu , Yiyou Sun , Mika Oishi , Takao Osaki , Katsushi Matsuda , Jie Ji , Guangji Bai , Liang Zhao , Haifeng Chen

Uncertainty Quantification (UQ) is a promising approach to improve model reliability, yet quantifying the uncertainty of Large Language Models (LLMs) is non-trivial. In this work, we establish a connection between the uncertainty of LLMs…

Computation and Language · Computer Science 2025-10-16 Mingda Li , Xinyu Li , Weinan Zhang , Longxuan Ma

Ensuring that large language models (LLMs) reflect diverse user values and preferences is crucial as their user bases expand globally. It is therefore encouraging to see the growing interest in LLM personalization within the research…

Computation and Language · Computer Science 2024-06-18 Yijiang River Dong , Tiancheng Hu , Nigel Collier

This paper explores generalised probabilistic modelling and uncertainty estimation in comparative LLM-as-a-judge frameworks. We show that existing Product-of-Experts methods are specific cases of a broader framework, enabling diverse…

Artificial Intelligence · Computer Science 2025-05-22 Yassir Fathullah , Mark J. F. Gales

Large language models (LLMs) are stochastic, and not all models give deterministic answers, even when setting temperature to zero with a fixed random seed. However, few benchmark studies attempt to quantify uncertainty, partly due to the…

Computation and Language · Computer Science 2025-06-30 Robert E. Blackwell , Jon Barry , Anthony G. Cohn

Despite the widespread adoption of large language models (LLMs) for recommendation, we demonstrate that LLMs often exhibit uncertainty in their recommendations. To ensure the trustworthy use of LLMs in generating recommendations, we…

Information Retrieval · Computer Science 2025-02-13 Wonbin Kweon , Sanghwan Jang , SeongKu Kang , Hwanjo Yu

The rise of large language models (LLMs) and their tight integration into our daily life make it essential to dedicate efforts towards their trustworthiness. Uncertainty quantification for LLMs can establish more human trust into their…

Computation and Language · Computer Science 2026-05-06 Daniel Yang , Yao-Hung Hubert Tsai , Makoto Yamada

In this paper, we study the problem of uncertainty estimation and calibration for LLMs. We begin by formulating the uncertainty estimation problem, a relevant yet underexplored area in existing literature. We then propose a supervised…

Machine Learning · Computer Science 2024-10-24 Linyu Liu , Yu Pan , Xiaocheng Li , Guanting Chen

Research in uncertainty quantification (UQ) for large language models (LLMs) is increasingly important towards guaranteeing the reliability of this groundbreaking technology. We explore the integration of LLM UQ methods in argumentative…

Computation and Language · Computer Science 2026-05-08 Kevin Zhou , Adam Dejl , Gabriel Freedman , Lihu Chen , Antonio Rago , Francesca Toni

Step-by-step decision planning with large language models (LLMs) is gaining attention in AI agent development. This paper focuses on decision planning with uncertainty estimation to address the hallucination problem in language models.…

Machine Learning · Computer Science 2024-02-02 Yao-Hung Hubert Tsai , Walter Talbott , Jian Zhang

Uncertainty quantification has emerged as an effective approach to closed-book hallucination detection for LLMs, but existing methods are largely designed for short-form outputs and do not generalize well to long-form generation. We…

Computation and Language · Computer Science 2026-02-20 Dylan Bouchard , Mohit Singh Chauhan , Viren Bajaj , David Skarbrevik

Large Language Models (LLMs) are widely used as automated judges, where practical value depends on both accuracy and trustworthy, risk-aware judgments. Existing approaches predominantly focus on accuracy, overlooking the necessity of…

Artificial Intelligence · Computer Science 2025-08-19 Zailong Tian , Zhuoheng Han , Yanzhe Chen , Haozhe Xu , Xi Yang , Richeng Xuan , Houfeng Wang , Lizi Liao

Language Models (LMs) have shown promising performance in natural language generation. However, as LMs often generate incorrect or hallucinated responses, it is crucial to correctly quantify their uncertainty in responding to given inputs.…

Computation and Language · Computer Science 2024-09-17 Xinmeng Huang , Shuo Li , Mengxin Yu , Matteo Sesia , Hamed Hassani , Insup Lee , Osbert Bastani , Edgar Dobriban

LLM-as-a-judge has become a promising paradigm for using large language models (LLMs) to evaluate natural language generation (NLG), but the uncertainty of its evaluation remains underexplored. This lack of reliability may limit its…

Computation and Language · Computer Science 2025-09-24 Huanxin Sheng , Xinyi Liu , Hangfeng He , Jieyu Zhao , Jian Kang

Large language models (LLMs) have shown strong capabilities, enabling concise, context-aware answers in question answering (QA) tasks. The lack of transparency in complex LLMs has inspired extensive research aimed at developing methods to…

Computation and Language · Computer Science 2025-09-22 Yangyi Li , Mengdi Huai