English
Related papers

Related papers: Information Threshold, Bayesian Inference and Deci…

200 papers

We define {\em predictive information} $I_{\rm pred} (T)$ as the mutual information between the past and the future of a time series. Three qualitatively different behaviors are found in the limit of large observation times $T$: $I_{\rm…

Data Analysis, Statistics and Probability · Physics 2011-11-10 William Bialek , Ilya Nemenman , Naftali Tishby

The overall predictive uncertainty of a trained predictor can be decomposed into separate contributions due to epistemic and aleatoric uncertainty. Under a Bayesian formulation, assuming a well-specified model, the two contributions can be…

Machine Learning · Computer Science 2021-10-22 Sharu Theresa Jose , Sangwoo Park , Osvaldo Simeone

Information theory provides a mathematical foundation to measure uncertainty in belief. Belief is represented by a probability distribution that captures our understanding of an outcome's plausibility. Information measures based on…

Information Theory · Computer Science 2020-01-17 Jed A. Duersch , Thomas A. Catanach

Experimental design is crucial for inference where limitations in the data collection procedure are present due to cost or other restrictions. Optimal experimental designs determine parameters that in some appropriate sense make the data…

Machine Learning · Statistics 2016-03-11 Panagiotis Tsilifis , Roger G. Ghanem , Paris Hajali

In the Bayesian approach to probability theory, probability quantifies a degree of belief for a single trial, without any a priori connection to limiting frequencies. In this paper we show that, despite being prescribed by a fundamental…

Quantum Physics · Physics 2009-11-07 Carlton M. Caves , Christopher A. Fuchs , Ruediger Schack

When using complex Bayesian models to combine information, the checking for consistency of the information being combined is good statistical practice. Here a new method is developed for detecting prior-data conflicts in Bayesian models…

Methodology · Statistics 2016-11-29 David J. Nott , Xueou Wang , Michael Evans , Berthold-Georg Englert

Weighted Updating generalizes Bayesian updating, allowing for biased beliefs by weighting the likelihood function and prior distribution with positive real exponents. I provide a rigorous foundation for the model by showing that…

Probability · Mathematics 2016-02-09 Jesse Aaron Zinn

Recently, several researchers have claimed that conclusions obtained from a Bayes factor (or the posterior odds) may contradict those obtained from Bayesian posterior estimation. In this short paper, we wish to point out that no such…

Statistics Theory · Mathematics 2022-10-24 Harlan Campbell , Paul Gustafson

There has a major problem in the current theory of hypothesis testing in which no unified indicator to evaluate the goodness of various test methods since the cost function or utility function usually relies on the specific application…

Statistics Theory · Mathematics 2023-06-19 Dazhuan Xu , Nan Wang

We derive a general upper bound to mutual information in terms of the Fisher information. The bound may be further used to derive a lower bound for the Bayesian quadratic cost. These two provide alternatives to other inequalities in the…

Quantum Physics · Physics 2025-05-16 Wojciech Górecki , Xi Lu , Chiara Macchiavello , Lorenzo Maccone

The inverse relation between mutual information (MI) and Bayesian error is sharpened by deriving finite sequences of upper and lower bounds on MI in terms of the minimum probability of error (MPE) and related Bayesian quantities. The well…

Information Theory · Computer Science 2014-09-24 Sudhakar Prasad

In inverse problems, one attempts to infer spatially variable functions from indirect measurements of a system. To practitioners of inverse problems, the concept of "information" is familiar when discussing key questions such as which parts…

Numerical Analysis · Mathematics 2025-02-12 Wolfgang Bangerth , Chris R. Johnson , Dennis K. Njeru , Bart van Bloemen Waanders

Progress in neuroscience has provided unprecedented opportunities to advance our understanding of brain alterations and their correspondence to phenotypic profiles. With data collected from various imaging techniques, studies have…

Methodology · Statistics 2024-08-01 Zhe Sun , Wanwan Xu , Tianxi Li , Jian Kang , Gregorio Alanis-Lobato , Yize Zhao

We introduce an information theoretic measure of statistical structure, called 'binding information', for sets of random variables, and compare it with several previously proposed measures including excess entropy, Bialek et al.'s…

Statistics Theory · Mathematics 2010-12-10 Samer A. Abdallah , Mark D. Plumbley

The main contribution of this work is to relate information complexity to "tension" [Prabhakaran and Prabhakaran, 2014] - an information-theoretic quantity defined with no reference to protocols - and to illustrate that it allows deriving…

Computational Complexity · Computer Science 2014-08-28 Manoj M. Prabhakaran , Vinod M. Prabhakaran

Bayesian parameter inference depends on a choice of prior probability distribution for the parameters in question. The prior which makes the posterior distribution maximally sensitive to data is called the Jeffreys prior, and it is…

Cosmology and Nongalactic Astrophysics · Physics 2019-02-25 Steen Hannestad , Thomas Tram

This paper presents a model of costly information acquisition where decision-makers can choose whether to elaborate information superficially or precisely. The former action is costless, while the latter entails a processing cost. Within…

General Economics · Economics 2024-11-27 Federico Vaccari

We marshall the arguments for preferring Bayesian hypothesis testing and confidence sets to frequentist ones. We define admissible solutions to inference problems, noting that Bayesian solutions are admissible. We give seven weaker…

Statistics Theory · Mathematics 2024-05-22 Roger Sewell

External information, such as prior information or expert opinions, can play an important role in the design, analysis and interpretation of clinical trials. However, little attention has been devoted thus far to incorporating external…

Applications · Statistics 2013-04-24 Minge Xie , Regina Y. Liu , C. V. Damaraju , William H. Olson

We examine the connection between training error and generalization error for arbitrary estimating procedures, working in an overparameterized linear model under general priors in a Bayesian setup. We find determining factors inherent to…

Machine Learning · Statistics 2026-02-11 Chen Cheng , Rina Foygel Barber