English
Related papers

Related papers: Uncertainty Quantification of Large Language Model…

200 papers

We introduce BSDetector, a method for detecting bad and speculative answers from a pretrained Large Language Model by estimating a numeric confidence score for any output it generated. Our uncertainty quantification technique works for any…

Computation and Language · Computer Science 2023-10-05 Jiuhai Chen , Jonas Mueller

Uncertainties from model parameters and model discrepancy from small-scale models impact the accuracy and reliability of predictions of large-scale systems. Inadequate representation of these uncertainties may result in inaccurate and…

Methodology · Statistics 2014-12-18 K. Sham Bhat , David S. Mebane , Curtis B. Storlie , Priyadarshi Mahapatra

Scientific Machine Learning is a new class of approaches that integrate physical knowledge and mechanistic models with data-driven techniques for uncovering governing equations of complex processes. Among the available approaches, Universal…

Machine Learning · Statistics 2024-06-14 Nina Schmid , David Fernandes del Pozo , Willem Waegeman , Jan Hasenauer

LLM-as-a-Judge is a widely used method for evaluating the performance of Large Language Models (LLMs) across various tasks. We address the challenge of quantifying the uncertainty of LLM-as-a-Judge evaluations. While uncertainty…

Uncertainty quantification (UQ) is important for reliability assessment and enhancement of machine learning models. In deep learning, uncertainties arise not only from data, but also from the training procedure that often injects…

Machine Learning · Statistics 2023-11-13 Ziyi Huang , Henry Lam , Haofeng Zhang

We propose a rigorous framework for Uncertainty Quantification (UQ) in which the UQ objectives and the assumptions/information set are brought to the forefront. This framework, which we call \emph{Optimal Uncertainty Quantification} (OUQ),…

Probability · Mathematics 2016-05-20 Houman Owhadi , Clint Scovel , Timothy John Sullivan , Mike McKerns , Michael Ortiz

Large language models (LLMs) are increasingly deployed and democratized on edge devices. To improve the efficiency of on-device deployment, small language models (SLMs) are often adopted due to their efficient decoding latency and reduced…

Computation and Language · Computer Science 2025-02-10 Yu-Neng Chuang , Leisheng Yu , Guanchu Wang , Lizhe Zhang , Zirui Liu , Xuanting Cai , Yang Sui , Vladimir Braverman , Xia Hu

Large language models (LLMs) have emerged as strong contenders in machine translation.Yet, they still struggle to adequately handle discourse phenomena, such as pronoun resolution and lexical cohesion at the document level. In this study,…

Computation and Language · Computer Science 2025-10-09 Wafaa Mohammed , Vlad Niculae , Chrysoula Zerva

Large Language Models (LLMs) are increasingly used in clinical settings, where sensitivity to linguistic uncertainty can influence diagnostic interpretation and decision-making. Yet little is known about where such epistemic cues are…

Computation and Language · Computer Science 2025-12-01 Srivarshinee Sridhar , Raghav Kaushik Ravi , Kripabandhu Ghosh

Large molecular representation models pre-trained on massive unlabeled data have shown great success in predicting molecular properties. However, these models may tend to overfit the fine-tuning data, resulting in over-confident predictions…

Chemical Physics · Physics 2024-04-18 Yinghao Li , Lingkai Kong , Yuanqi Du , Yue Yu , Yuchen Zhuang , Wenhao Mu , Chao Zhang

Understanding the uncertainty in large language model (LLM) explanations is important for evaluating their faithfulness and reasoning consistency, and thus provides insights into the reliability of LLM's output regarding a question. In this…

Computation and Language · Computer Science 2025-09-16 Longchao Da , Xiaoou Liu , Jiaxin Dai , Lu Cheng , Yaqing Wang , Hua Wei

Quantifying uncertainties for machine learning models is a critical step to reduce human verification effort by detecting predictions with low confidence. This paper proposes a method for uncertainty quantification (UQ) of table structure…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Kehinde Ajayi , Leizhen Zhang , Yi He , Jian Wu

Recently, Knowledge Graphs (KGs) have been successfully coupled with Large Language Models (LLMs) to mitigate their hallucinations and enhance their reasoning capability, such as in KG-based retrieval-augmented frameworks. However, current…

Artificial Intelligence · Computer Science 2024-10-22 Bo Ni , Yu Wang , Lu Cheng , Erik Blasch , Tyler Derr

Large language models (LLMs) have been shown to possess impressive capabilities, while also raising crucial concerns about the faithfulness of their responses. A primary issue arising in this context is the management of (un)answerable…

Computation and Language · Computer Science 2023-11-14 Aviv Slobodkin , Omer Goldman , Avi Caciularu , Ido Dagan , Shauli Ravfogel

Although large language models (LLMs) are highly interactive and extendable, current approaches to ensure reliability in deployments remain mostly limited to rejecting outputs with high uncertainty in order to avoid misinformation. This…

Machine Learning · Computer Science 2025-06-10 T. Duy Nguyen-Hien , Desi R. Ivanova , Yee Whye Teh , Wee Sun Lee

Multilingual pre-trained Large Language Models (LLMs) are incredibly effective at Question Answering (QA), a core task in Natural Language Understanding, achieving high accuracies on several multilingual benchmarks. However, little is known…

Computation and Language · Computer Science 2024-04-16 Yahan Yang , Soham Dan , Dan Roth , Insup Lee

Although AI agents have demonstrated impressive capabilities in long-horizon reasoning, their reliability is severely hampered by the ``Spiral of Hallucination,'' where early epistemic errors propagate irreversibly. Existing methods face a…

Artificial Intelligence · Computer Science 2026-01-23 Jiaxin Zhang , Prafulla Kumar Choubey , Kung-Hsiang Huang , Caiming Xiong , Chien-Sheng Wu

How can we quantize large language models while preserving accuracy? Quantization is essential for deploying large language models (LLMs) efficiently. Binary-coding quantization (BCQ) and uniform quantization (UQ) are promising quantization…

Computation and Language · Computer Science 2025-06-17 Seungcheol Park , Jeongin Bae , Beomseok Kwon , Minjun Kim , Byeongwook Kim , Se Jung Kwon , U Kang , Dongsoo Lee

Semantic consistency of a language model is broadly defined as the model's ability to produce semantically-equivalent outputs, given semantically-equivalent inputs. We address the task of assessing question-answering (QA) semantic…

Computation and Language · Computer Science 2023-11-03 Ella Rabinovich , Samuel Ackerman , Orna Raz , Eitan Farchi , Ateret Anaby-Tavor

While past works have shown how uncertainty quantification can be applied to large language model (LLM) outputs, the question of whether resulting uncertainty guarantees still hold within sub-groupings of data remains open. In our work,…

Computation and Language · Computer Science 2025-06-13 Terrance Liu , Zhiwei Steven Wu