English
Related papers

Related papers: Quantifying Epistemic Uncertainty in Diffusion Mod…

200 papers

Classifier-guided diffusion models have emerged as a powerful approach for conditional image generation, but they suffer from overconfident predictions during early denoising steps, causing the guidance gradient to vanish. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Seyed Alireza Javid , Amirhossein Bagheri , Nuria González-Prelcic

Fitting models to data is an important part of the practice of science. Advances in machine learning have made it possible to fit more -- and more complex -- models, but have also exacerbated a problem: when multiple models fit the data…

Methodology · Statistics 2025-10-27 Alexandre René , André Longtin

The exact estimation of latent variable models with big data is known to be challenging. The latents have to be integrated out numerically, and the dimension of the latent variables increases with the sample size. This paper develops a…

Econometrics · Economics 2023-06-27 Ruben Loaiza-Maya , Didier Nibbering , Dan Zhu

Traditional approaches to ensure group fairness in algorithmic decision making aim to equalize ``total'' error rates for different subgroups in the population. In contrast, we argue that the fairness approaches should instead focus only on…

Machine Learning · Computer Science 2021-05-11 Junaid Ali , Preethi Lahoti , Krishna P. Gummadi

We present a novel approach to uncertainty quantification in classification tasks based on label-wise decomposition of uncertainty measures. This label-wise perspective allows uncertainty to be quantified at the individual class level,…

Machine Learning · Computer Science 2024-06-05 Yusuf Sale , Paul Hofman , Timo Löhr , Lisa Wimmer , Thomas Nagler , Eyke Hüllermeier

Starting with the relative entropy based on a previously proposed entropy function $S_q[p]=\int dx p(x)(-\ln p(x))^q$, we find the corresponding Fisher's information measure. After function redefinition we then maximize the Fisher…

Statistical Mechanics · Physics 2015-05-13 Marcelo R. Ubriaco

The problem of incorporating information from observations received serially in time is widespread in the field of uncertainty quantification. Within a probabilistic framework, such problems can be addressed using standard filtering…

Methodology · Statistics 2024-12-02 Chatchuea Kimchaiwong , Jeremie Houssineau , Adam M. Johansen

Representing and quantifying uncertainty in physical parameterisations is a central challenge in weather and climate modelling, and approaches are often developed separately for different timescales. Here, we introduce a unified framework…

Atmospheric and Oceanic Physics · Physics 2025-12-01 Laura A. Mansfield , Hannah M. Christensen

We consider the problems of clustering, classification, and visualization of high-dimensional data when no straightforward Euclidean representation exists. Typically, these tasks are performed by first reducing the high-dimensional data to…

Machine Learning · Statistics 2009-09-29 Kevin M. Carter , Raviv Raich , William G. Finn , Alfred O. Hero

Generative models that maximize model likelihood have gained traction in many practical settings. Among them, perturbation based approaches underpin many strong likelihood estimation models, yet they often face slow convergence and limited…

Information Theory · Computer Science 2025-10-27 Yirong Shen , Lu Gan , Cong Ling

To analyze the uncertain data frequently encountered in practice, this paper proposes novel fixed-effects models that incorporate an uncertain measure to investigate variables of interest and nuisance variables in factor designs. First, an…

Methodology · Statistics 2026-03-18 Fan Zhang , Zhiming Li

Various strategies for active learning have been proposed in the machine learning literature. In uncertainty sampling, which is among the most popular approaches, the active learner sequentially queries the label of those instances for…

Machine Learning · Computer Science 2019-09-04 Vu-Linh Nguyen , Sébastien Destercke , Eyke Hüllermeier

The treatment of both aleatory and epistemic uncertainty by recent methods often requires an high computational effort. In this abstract, we propose a numerical sampling method allowing to lighten the computational burden of treating the…

Artificial Intelligence · Computer Science 2007-12-14 Eric Chojnacki , Jean Baccou , Sébastien Destercke

We consider the problem of statistical inference for a class of partially-observed diffusion processes, with discretely-observed data and finite-dimensional parameters. We construct unbiased estimators of the score function, i.e. the…

Methodology · Statistics 2021-05-12 Jeremy Heng , Jeremie Houssineau , Ajay Jasra

We present an ``equation-free'' multiscale approach to the simulation of unsteady diffusion in a random medium. The diffusivity of the medium is modeled as a random field with short correlation length, and the governing equations are cast…

Numerical Analysis · Mathematics 2007-05-23 Dongbin Xiu , Ioannis Kevrekidis

The Fisher information matrix (FIM) has long been of interest in statistics and other areas. It is widely used to measure the amount of information and calculate the lower bound for the variance for maximum likelihood estimation (MLE). In…

Information Theory · Computer Science 2015-06-19 Shenghan Guo

This work suggests several methods of uncertainty treatment in multiscale modelling and describes their application to a system of coupled turbulent transport simulations of a tokamak plasma. We propose a method to quantify the usually…

Plasma Physics · Physics 2023-07-10 Yehor Yudin , David Coster , Udo von Toussaint , Frank Jenko

Laplace's method approximates a target density with a Gaussian distribution at its mode. It is computationally efficient and asymptotically exact for Bayesian inference due to the Bernstein-von Mises theorem, but for complex targets and…

Machine Learning · Computer Science 2026-03-12 Hanlin Yu , Marcelo Hartmann , Bernardo Williams , Mark Girolami , Arto Klami

Clinical prediction models enable healthcare professionals to estimate individual outcomes using patient characteristics. Current sample size guidelines for developing or updating models with continuous outcomes aim to minimise overfitting…

We consider 1-dimensional location estimation, where we estimate a parameter $\lambda$ from $n$ samples $\lambda + \eta_i$, with each $\eta_i$ drawn i.i.d. from a known distribution $f$. For fixed $f$ the maximum-likelihood estimate (MLE)…

Statistics Theory · Mathematics 2022-07-20 Shivam Gupta , Jasper C. H. Lee , Eric Price , Paul Valiant