English
Related papers

Related papers: Monotonicity and Double Descent in Uncertainty Est…

200 papers

Uncertainty Quantification (UQ) is a promising approach to improve model reliability, yet quantifying the uncertainty of Large Language Models (LLMs) is non-trivial. In this work, we establish a connection between the uncertainty of LLMs…

Computation and Language · Computer Science 2025-10-16 Mingda Li , Xinyu Li , Weinan Zhang , Longxuan Ma

The advent of fabrication techniques such as additive manufacturing has focused attention on the considerable variability of material response due to defects and other microstructural aspects. This variability motivates the development of…

Data Analysis, Statistics and Probability · Physics 2019-06-26 Francesco Rizzi , Mohammad Khalil , Reese E. Jones , Jeremy A. Templeton , Jakob T. Ostien , Brad L. Boyce

The calibration of rheological parameters in the modeling of complex flows of non-Newtonian fluids can be a daunting task. In this paper we demonstrate how the framework of Uncertainty Quantification (UQ) can be used to improve the…

Fluid Dynamics · Physics 2023-07-11 Aricia Rinkens , Clemens V. Verhoosel , Nick O. Jaensson

In the past decades, most work in the area of data analysis and machine learning was focused on optimizing predictive models and getting better results than what was possible with existing models. To what extent the metrics with which such…

Machine Learning · Statistics 2024-05-06 Nicolas Dewolf

Inverse Uncertainty Quantification (IUQ) method has been widely used to quantify the uncertainty of Physical Model Parameters (PMPs) in nuclear Thermal Hydraulics (TH) systems. This paper introduces a novel hierarchical Bayesian model which…

Computation · Statistics 2024-03-27 Chen Wang , Xu Wu , Tomasz Kozlowski

Accurately detecting multiple change-points is critical for various applications, but determining the optimal number of change-points remains a challenge. Existing approaches based on information criteria attempt to balance goodness-of-fit…

Methodology · Statistics 2023-12-19 Hui Chen , Yinxu Jia , Guanghui Wang , Changliang Zou

We present a novel approach for training deep neural networks in a Bayesian way. Classical, i.e. non-Bayesian, deep learning has two major drawbacks both originating from the fact that network parameters are considered to be deterministic.…

Machine Learning · Statistics 2019-03-11 Konstantin Posch , Jan Steinbrener , Jürgen Pilz

Uncertainty quantification has received increasing attention in machine learning in the recent past. In particular, a distinction between aleatoric and epistemic uncertainty has been found useful in this regard. The latter refers to the…

Machine Learning · Computer Science 2022-10-14 Viktor Bengs , Eyke Hüllermeier , Willem Waegeman

Reliable uncertainty quantification (UQ) is essential for ensuring trustworthy downstream use of large language models, especially when they are deployed in decision-support and other knowledge-intensive applications. Model certainty can be…

Computation and Language · Computer Science 2025-11-04 Autumn Toney-Wails , Ryan Wails

We analyze an ensemble-based approach for uncertainty quantification (UQ) in atomistic neural networks. This method generates an epistemic uncertainty signal without requiring changes to the underlying multi-headed regression neural network…

Chemical Physics · Physics 2025-11-21 Idan Fonea , Amir Peles , Sivan Niv , Goren Gordon , Amir Natan

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

Quantum-enhanced measurements exploit quantum mechanical effects to provide ultra-precise estimates of physical variables for use in advanced technologies, such as frequency calibration of atomic clocks, gravitational waves detection, and…

Quantum Physics · Physics 2014-07-28 J. Calsamiglia , B. Gendra , R. Munoz-Tapia , E. Bagan

Due to their intuitive appeal, Bayesian methods of modeling and uncertainty quantification have become popular in modern machine and deep learning. When providing a prior distribution over the parameter space, it is straightforward to…

Machine Learning · Statistics 2025-06-05 Ivan Melev , Goeran Kauermann

Uncertainty quantification (UQ) helps to make trustworthy predictions based on collected observations and uncertain domain knowledge. With increased usage of deep learning in various applications, the need for efficient UQ methods that can…

Machine Learning · Computer Science 2021-11-09 Olga Graf , Pablo Flores , Pavlos Protopapas , Karim Pichara

Recent work has sought to quantify large language model uncertainty to facilitate model control and modulate user trust. Previous works focus on measures of uncertainty that are theoretically grounded or reflect the average overt behavior…

Computation and Language · Computer Science 2025-03-18 Kyle Moore , Jesse Roberts , Daryl Watson , Pamela Wisniewski

Existing methods for quantifying predictive uncertainty in neural networks are either computationally intractable for large language models or require access to training data that is typically unavailable. We derive a lightweight…

Machine Learning · Computer Science 2026-04-01 Nils Grünefeld , Jes Frellsen , Christian Hardmeier

Recent work by Mania et al. has proved that certainty equivalent control achieves nearly optimal regret for linear systems with quadratic costs. However, when parameter uncertainty is large, certainty equivalence cannot be relied upon to…

Optimization and Control · Mathematics 2020-01-01 Jack Umenberger , Thomas B. Schon

We propose a method to improve the efficiency and accuracy of amortized Bayesian inference by leveraging universal symmetries in the joint probabilistic model of parameters and data. In a nutshell, we invert Bayes' theorem and estimate the…

Machine Learning · Computer Science 2024-07-24 Marvin Schmitt , Desi R. Ivanova , Daniel Habermann , Ullrich Köthe , Paul-Christian Bürkner , Stefan T. Radev

In principle, deep learning models trained on medical time-series, including wearable photoplethysmography (PPG) sensor data, can provide a means to continuously monitor physiological parameters outside of clinical settings. However, there…

The use of high-dimensional regression techniques from machine learning has significantly improved the quantitative accuracy of interatomic potentials. Atomic simulations can now plausibly target quantitative predictions in a variety of…

Materials Science · Physics 2025-03-04 Danny Perez , Aparna P. A. Subramanyam , Ivan Maliyov , Thomas D. Swinburne