English
Related papers

Related papers: Parameter estimation and uncertainty quantificatio…

200 papers

Motivated by parametric models for which the likelihood is analytically unavailable, numerically unstable, or prohibitively expensive to compute or optimize, we develop a prior- and likelihood-free framework for fully probabilistic…

Methodology · Statistics 2026-03-17 Leonardo Cella , Emily C. Hector

There are various measures of predictive uncertainty in the literature, but their relationships to each other remain unclear. This paper uses a decomposition of statistical pointwise risk into components, associated with different sources…

Machine Learning · Statistics 2025-02-18 Nikita Kotelevskii , Vladimir Kondratyev , Martin Takáč , Éric Moulines , Maxim Panov

This report concerns the problem of dimensionality reduction through information geometric methods on statistical manifolds. While there has been considerable work recently presented regarding dimensionality reduction for the purposes of…

Machine Learning · Statistics 2008-09-30 Kevin M. Carter , Raviv Raich , Alfred O. Hero

Quantifying uncertainty in neural network predictions is essential for high-stakes domains such as autonomous driving, healthcare, and manufacturing. While existing approaches often depend on costly sampling or restrictive distributional…

Machine Learning · Computer Science 2026-05-29 Eunseo Choi , Ho-Yeon Kim , Jaewon Lee , Taeyong jo , Myungjun lee , Heejin Ahn

We propose a unified theoretical framework for quantifying spatio-temporal interactions in a stochastic dynamical system based on information geometry. In the proposed framework, the degree of interactions is quantified by the divergence…

Neurons and Cognition · Quantitative Biology 2016-12-08 Masafumi Oizumi , Naotsugu Tsuchiya , Shun-ichi Amari

To what extent can we distinguish one probability distribution from another? Are there quantitative measures of distinguishability? The goal of this tutorial is to approach such questions by introducing the notion of the "distance" between…

Data Analysis, Statistics and Probability · Physics 2015-06-23 Ariel Caticha

We show that gamma distributions provide models for departures from randomness since every neighbourhood of an exponential distribution contains a neighbourhood of gamma distributions, using an information theoretic metric topology. We…

Differential Geometry · Mathematics 2007-05-23 Khadiga Arwini , C. T. J. Dodson

We study a family of parametric statistical models based on gamma distributions, which do give realistic descriptions for other stochastic porous media. Gamma distributions contain as a special case the exponential distributions, which…

Astrophysics · Physics 2016-08-30 C. T. J. Dodson

This paper lays the foundations for a unified framework for numerically and computationally applying methods drawn from a range of currently distinct geometrical approaches to statistical modelling. In so doing, it extends information…

Statistics Theory · Mathematics 2012-09-11 Karim Anaya-Izquierdo , Frank Critchley , Paul Marriott , Paul W. Vos

We present a Bayesian perspective on quantifying the uncertainty of graph signals estimated or reconstructed from imperfect observations. We show that many conventional methods of graph signal estimation, reconstruction and imputation, can…

Signal Processing · Electrical Eng. & Systems 2025-05-22 Lennard Rompelberg , Michael T. Schaub

We consider the problem of reducing the dimensions of parameters and data in non-Gaussian Bayesian inference problems. Our goal is to identify an "informed" subspace of the parameters and an "informative" subspace of the data so that a…

Computation · Statistics 2022-07-19 Ricardo Baptista , Youssef Marzouk , Olivier Zahm

We formulate the Riemannian calculus of the probability set embedded with $L^2$-Wasserstein metric. This is an initial work of transport information geometry. Our investigation starts with the probability simplex (probability manifold)…

Differential Geometry · Mathematics 2022-04-05 Wuchen Li

Artificial neural networks (ANNs) are powerful tools capable of approximating any arbitrary mathematical function, but their interpretability remains limited, rendering them as black box models. To address this issue, numerous methods have…

Machine Learning · Computer Science 2024-06-11 Abhiram Anand Thiruthummal , Eun-jin Kim , Sergiy Shelyag

The correct use and interpretation of models depends on several steps, two of which being the calibration by parameter estimation and the analysis of uncertainty. In the biological literature, these steps are seldom discussed together, but…

Quantitative Methods · Quantitative Biology 2015-08-17 André Chalom , Paulo Inácio de Knegt López de Prado

Geostatistical seismic inversion is commonly used to infer the spatial distribution of the subsurface petro-elastic properties by perturbing the model parameter space through iterative stochastic sequential simulations/co-simulations. The…

Applications · Statistics 2018-10-19 Leonardo Azevedo , Vasily Demyanov

In almost any geostatistical analysis, one of the underlying, often implicit, modelling assump- tions is that the spatial locations, where measurements are taken, are recorded without error. In this study we develop geostatistical inference…

Applications · Statistics 2017-11-02 Claudio Fronterrè , Emanuele Giorgi , Peter J. Diggle

The introduction of a metric onto the space of parameters in models in Statistical Mechanics and beyond gives an alternative perspective on their phase structure. In such a geometrization, the scalar curvature, R, plays a central role. A…

Statistical Mechanics · Physics 2009-11-10 W. Janke , D. A. Johnston , R. Kenna

We develop a novel application of hybrid information divergences to analyze uncertainty in steady-state subsurface flow problems. These hybrid information divergences are non-intrusive, goal-oriented uncertainty quantification tools that…

Probability · Mathematics 2019-07-05 Eric Joseph Hall , Markos A. Katsoulakis

Echocardiography plays a fundamental role in the extraction of important clinical parameters (e.g. left ventricular volume and ejection fraction) required to determine the presence and severity of heart-related conditions. When deploying…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Thierry Judge , Olivier Bernard , Woo-Jin Cho Kim , Alberto Gomez , Arian Beqiri , Agisilaos Chartsias , Pierre-Marc Jodoin

Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI. In regression tasks, uncertainty is typically quantified using prediction intervals calibrated to a specific operating point,…

Machine Learning · Computer Science 2021-06-03 Jiri Navratil , Benjamin Elder , Matthew Arnold , Soumya Ghosh , Prasanna Sattigeri