English
Related papers

Related papers: Reverse Probing: Supervised Token-level Uncertaint…

200 papers

In inverse problems, uncertainty quantification (UQ) deals with a probabilistic description of the solution nonuniqueness and data noise sensitivity. Setting seismic imaging into a Bayesian framework allows for a principled way of studying…

Geophysics · Physics 2020-04-16 Ali Siahkoohi , Gabrio Rizzuti , Felix J. Herrmann

In the early stages of drug discovery, decisions regarding which experiments to pursue can be influenced by computational models. These decisions are critical due to the time-consuming and expensive nature of the experiments. Therefore, it…

Machine Learning · Computer Science 2024-09-09 Emma Svensson , Hannah Rosa Friesacher , Susanne Winiwarter , Lewis Mervin , Adam Arany , Ola Engkvist

Large Language Models (LLMs) have become powerful, but hallucinations remain a vital obstacle to their trustworthy use. Previous works improved the capability of hallucination detection by measuring uncertainty. But they can not explain the…

Computation and Language · Computer Science 2026-02-03 Yiming Huang , Junyan Zhang , Zihao Wang , Biquan Bie , Yunzhong Qiu , Xuming Hu , Yi R. Fung , Xinlei He

This paper provides a tutorial about uncertainty quantification (UQ) for those who have no background but are interested in learning more in this area. It exploits many very simple examples, which are understandable to undergraduates, to…

Dynamical Systems · Mathematics 2025-10-07 Nan Chen , Stephen Wiggins , Marios Andreou

Uncertainty quantification is one of the most crucial tasks to obtain trustworthy and reliable machine learning models for decision making. However, most research in this domain has only focused on problems with small label spaces and…

Machine Learning · Computer Science 2022-10-20 Jyun-Yu Jiang , Wei-Cheng Chang , Jiong Zhong , Cho-Jui Hsieh , Hsiang-Fu Yu

Despite the increasing demand for safer machine learning practices, the use of Uncertainty Quantification (UQ) methods in production remains limited. This limitation is exacerbated by the challenge of validating UQ methods in absence of UQ…

Machine Learning · Computer Science 2025-03-03 Arthur Pignet , Chiara Regniez , John Klein

In-context learning has emerged as a groundbreaking ability of Large Language Models (LLMs) and revolutionized various fields by providing a few task-relevant demonstrations in the prompt. However, trustworthy issues with LLM's response,…

Computation and Language · Computer Science 2024-04-01 Chen Ling , Xujiang Zhao , Xuchao Zhang , Wei Cheng , Yanchi Liu , Yiyou Sun , Mika Oishi , Takao Osaki , Katsushi Matsuda , Jie Ji , Guangji Bai , Liang Zhao , Haifeng Chen

While Large Language Models (LLMs) show remarkable capabilities, their unreliability remains a critical barrier to deployment in high-stakes domains. This survey charts a functional evolution in addressing this challenge: the evolution of…

Artificial Intelligence · Computer Science 2026-04-21 Jiaxin Zhang , Wendi Cui , Zhuohang Li , Lifu Huang , Bradley Malin , Caiming Xiong , Chien-Sheng Wu

The field of Quantum Machine Learning (QML) has emerged recently in the hopes of finding new machine learning protocols or exponential speedups for classical ones. Apart from problems with vanishing gradients and efficient encoding methods,…

Machine Learning · Computer Science 2023-10-17 Hannah Helgesen , Michael Felsberg , Jan-Åke Larsson

Uncertainty Quantification (UQ) is a key discipline for computational modeling of complex systems, enhancing reliability of engineering simulations. In crashworthiness, having an accurate assessment of the behavior of the model uncertainty…

Methodology · Statistics 2021-09-17 Marc Rocas , Alberto García-González , Sergio Zlotnik , Xabier Larráyoz , Pedro Díez

This paper introduces a novel uncertainty quantification framework for regression models where the response takes values in a separable metric space, and the predictors are in a Euclidean space. The proposed algorithms can efficiently…

Statistics Theory · Mathematics 2024-05-09 Gábor Lugosi , Marcos Matabuena

Deep learning models for semantic segmentation are prone to poor performance in real-world applications due to the highly challenging nature of the task. Model uncertainty quantification (UQ) is one way to address this issue of lack of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Rishabh Singh , Jose C. Principe

Inverse problems are ubiquitous in modern scientific studies and involve recovering an underlying signal from noisy observations often transformed by a measurement operator. These problems are frequently ill-posed, particularly in imaging,…

Methodology · Statistics 2026-05-19 Henry J. Aldridge , Tobías I. Liaudat , Marcelo Pereyra , Jason D. McEwen

Activity recognition in wearable computing faces two key challenges: i) activity characteristics may be context-dependent and change under different contexts or situations; ii) unknown contexts and activities may occur from time to time,…

Machine Learning · Computer Science 2020-03-05 Zepeng Huo , Arash PakBin , Xiaohan Chen , Nathan Hurley , Ye Yuan , Xiaoning Qian , Zhangyang Wang , Shuai Huang , Bobak Mortazavi

Unlike nature image classification where groundtruth label is explicit and of no doubt, physicians commonly interpret medical image conditioned on certainty like using phrase "probable" or "likely". Existing medical image datasets either…

Machine Learning · Computer Science 2025-11-21 Kunyu Zhang , Fukang Ge , Binyang Wang , Yingke Chen , Kazuma Kobayashi , Lin Gu , Jinhao Bi , Yingying Zhu

In imaging inverse problems, one seeks to recover an image from missing/corrupted measurements. Because such problems are ill-posed, there is great motivation to quantify the uncertainty induced by the measurement-and-recovery process.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Jeffrey Wen , Rizwan Ahmad , Philip Schniter

The ability to replicate predictions by machine learning (ML) or artificial intelligence (AI) models and results in scientific workflows that incorporate such ML/AI predictions is driven by numerous factors. An uncertainty-aware metric that…

Machine Learning · Computer Science 2023-08-28 Line Pouchard , Kristofer G. Reyes , Francis J. Alexander , Byung-Jun Yoon

Large Language Models (LLMs) display formidable capabilities in generative tasks but also pose potential risks due to their tendency to generate hallucinatory responses. Uncertainty Quantification (UQ), the evaluation of model output…

Computation and Language · Computer Science 2024-12-11 Qinhong Lin , Linna Zhou , Zhongliang Yang , Yuang Cai

It is important for Large Language Models (LLMs) to be aware of the boundary of their knowledge, distinguishing queries they can confidently answer from those that lie beyond their capabilities. Such awareness enables models to perform…

Computation and Language · Computer Science 2026-03-05 Lihu Chen , Gerard de Melo , Fabian M. Suchanek , Gaël Varoquaux

Deep learning-based surrogate models have demonstrated remarkable advantages over classical solvers in terms of speed, often achieving speedups of 10 to 1000 times over traditional partial differential equation (PDE) solvers. However, a…

Machine Learning · Computer Science 2024-02-14 Tailin Wu , Willie Neiswanger , Hongtao Zheng , Stefano Ermon , Jure Leskovec