English
Related papers

Related papers: Uncertainty Estimation in Autoregressive Structure…

200 papers

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

Quantifying uncertainties for machine learning (ML) models is a foundational challenge in modern data analysis. This challenge is compounded by at least two key aspects of the field: (a) inconsistent terminology surrounding uncertainty and…

Machine Learning · Computer Science 2025-06-04 Shubhendu Trivedi , Brian D. Nord

Uncertainty quantification by ensemble learning is explored in terms of an application from computational optical form measurements. The application requires to solve a large-scale, nonlinear inverse problem. Ensemble learning is used to…

Machine Learning · Computer Science 2021-03-03 Lara Hoffmann , Ines Fortmeier , Clemens Elster

Trainable evaluation metrics for machine translation (MT) exhibit strong correlation with human judgements, but they are often hard to interpret and might produce unreliable scores under noisy or out-of-domain data. Recent work has…

Computation and Language · Computer Science 2022-12-01 Chrysoula Zerva , Taisiya Glushkova , Ricardo Rei , André F. T. Martins

3D bounding boxes are a widespread intermediate representation in many computer vision applications. However, predicting them is a challenging task, largely due to partial observability, which motivates the need for a strong sense of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 YuXuan Liu , Nikhil Mishra , Maximilian Sieb , Yide Shentu , Pieter Abbeel , Xi Chen

Uncertainty estimation is pivotal in machine learning, especially for classification tasks, as it improves the robustness and reliability of models. We introduce a novel `Epistemic Wrapping' methodology aimed at improving uncertainty…

Learning, whether natural or artificial, is a process of selection. It starts with a set of candidate options and selects the more successful ones. In the case of machine learning the selection is done based on empirical estimates of…

Machine Learning · Computer Science 2026-01-30 Yevgeny Seldin

The inability to correctly resolve rumours circulating online can have harmful real-world consequences. We present a method for incorporating model and data uncertainty estimates into natural language processing models for automatic rumour…

Computation and Language · Computer Science 2020-05-15 Elena Kochkina , Maria Liakata

Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI. In regression tasks, uncertainty is typically quantified using prediction intervals calibrated to an ad-hoc operating point,…

Machine Learning · Computer Science 2023-10-06 Jiri Navratil , Benjamin Elder , Matthew Arnold , Soumya Ghosh , Prasanna Sattigeri

In this work we focus on confidence modeling for neural semantic parsers which are built upon sequence-to-sequence models. We outline three major causes of uncertainty, and design various metrics to quantify these factors. These metrics are…

Computation and Language · Computer Science 2018-05-15 Li Dong , Chris Quirk , Mirella Lapata

Uncertainty quantification (UQ) is essential for assessing the reliability of Earth observation (EO) products. However, the extensive use of machine learning models in EO introduces an additional layer of complexity, as those models…

Machine Learning · Computer Science 2024-12-10 Yuanyuan Wang , Qian Song , Dawood Wasif , Muhammad Shahzad , Christoph Koller , Jonathan Bamber , Xiao Xiang Zhu

We propose a network architecture capable of reliably estimating uncertainty of regression based predictions without sacrificing accuracy. The current state-of-the-art uncertainty algorithms either fall short of achieving prediction…

Machine Learning · Computer Science 2022-02-22 Kinjal Patel , Steven Waslander

Modern autonomous systems with machine learning components often use uncertainty quantification to help produce assurances about system operation. However, there is a lack of consensus in the community on what uncertainty is and how to…

Systems and Control · Electrical Eng. & Systems 2026-01-27 Sampada Deglurkar , Haotian Shen , Anish Muthali , Marco Pavone , Dragos Margineantu , Peter Karkus , Boris Ivanovic , Claire J. Tomlin

Any data annotation for subjective tasks shows potential variations between individuals. This is particularly true for annotations of emotional responses to musical stimuli. While older approaches to music emotion recognition systems…

Sound · Computer Science 2025-01-22 Karn N. Watcharasupat , Yiwei Ding , T. Aleksandra Ma , Pavan Seshadri , Alexander Lerch

Uncertainty estimation is critical for deploying reasoning language models, yet remains poorly understood under extended chain-of-thought reasoning. We study parallel sampling as a fully black-box approach using verbalized confidence and…

Artificial Intelligence · Computer Science 2026-03-20 Maksym Del , Markus Kängsepp , Marharyta Domnich , Ardi Tampuu , Lisa Yankovskaya , Meelis Kull , Mark Fishel

Uncertainty quantification is one of the most crucial tasks to obtain trustworthy and reliable machine learning models for decision making. However, most research in this domain has only focused on problems with small label spaces and…

Machine Learning · Computer Science 2022-10-20 Jyun-Yu Jiang , Wei-Cheng Chang , Jiong Zhong , Cho-Jui Hsieh , Hsiang-Fu Yu

While recent computer vision algorithms achieve impressive performance on many benchmarks, they lack robustness - presented with an image from a different distribution, (e.g. weather or lighting conditions not considered during training),…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Sebastian Cygert , Bartłomiej Wróblewski , Karol Woźniak , Radosław Słowiński , Andrzej Czyżewski

Uncertainty quantification is an important and challenging problem in deep learning. Previous methods rely on dropout layers which are not present in modern deep architectures or batch normalization which is sensitive to batch sizes. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Lukasz Wandzik , Raul Vicente Garcia , Jörg Krüger

Identifying and disentangling sources of predictive uncertainty is essential for trustworthy supervised learning. We argue that widely used second-order methods that disentangle aleatoric and epistemic uncertainty are fundamentally…

Machine Learning · Computer Science 2026-02-09 Sebastián Jiménez , Mira Jürgens , Willem Waegeman

The ability to acknowledge the inevitable uncertainty in their knowledge and reasoning is a prerequisite for AI systems to be truly truthful and reliable. In this paper, we present a taxonomy of uncertainty specific to vision-language AI…

Artificial Intelligence · Computer Science 2024-07-03 Khyathi Raghavi Chandu , Linjie Li , Anas Awadalla , Ximing Lu , Jae Sung Park , Jack Hessel , Lijuan Wang , Yejin Choi