English
Related papers

Related papers: Information Threshold, Bayesian Inference and Deci…

200 papers

We consider the problem of aggregating pairwise comparisons to obtain a consensus ranking order over a collection of objects. We use the popular Bradley-Terry-Luce (BTL) model which allows us to probabilistically describe pairwise…

Information Theory · Computer Science 2019-01-30 Mine Alsan , Ranjitha Prasad , Vincent Y. F. Tan

We provide a novel analysis of Wald's sequential probability ratio test based on information theoretic measures for symmetric thresholds, symmetric noise, and equally likely hypotheses under the assumption that the test exactly terminates…

Information Theory · Computer Science 2017-08-24 Meik Dörpinghaus , Édgar Roldán , Izaak Neri , Heinrich Meyr , Frank Jülicher

We try to establish a unified information theoretic approach to learning and to explore some of its applications. First, we define {\em predictive information} as the mutual information between the past and the future of a time series,…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ilya Nemenman

We study belief revision when information is represented by a set of probability distributions, or general information. General information extends the standard event notion while including qualitative information (A is more likely than B),…

Theoretical Economics · Economics 2025-02-04 Adam Dominiak , Matthew Kovach , Gerelt Tserenjigmid

This paper focuses on parameter estimation and introduces a new method for lower bounding the Bayesian risk. The method allows for the use of virtually \emph{any} information measure, including R\'enyi's $\alpha$, $\varphi$-Divergences, and…

Information Theory · Computer Science 2023-03-27 Amedeo Roberto Esposito , Adrien Vandenbroucque , Michael Gastpar

Bayesian optimal experimental design (OED) provides a principled framework for selecting observations or experiments. We introduce new Bayesian design criteria based on the expected Wasserstein-$p$ distance between the prior and posterior…

Methodology · Statistics 2026-05-28 Tapio Helin , Youssef Marzouk , Jose Rodrigo Rojo-Garcia

The relationship between a screening tests' positive predictive value, $\rho$, and its target prevalence, $\phi$, is proportional - though not linear in all but a special case. In consequence, there is a point of local extrema of curvature…

Methodology · Statistics 2021-08-03 Jacques Balayla

Consider a statistical problem where a set of parameters are of interest to a researcher. Then multiple confidence intervals can be constructed to infer the set of parameters simultaneously. The constructed multiple confidence intervals are…

Methodology · Statistics 2019-12-10 Taeho Kim , Edsel A. Pena

The widely applicable information criterion (WAIC) has been used as a model selection criterion for Bayesian statistics in recent years. It is an asymptotically unbiased estimator of the Kullback-Leibler divergence between a Bayesian…

Methodology · Statistics 2022-08-09 Yoshiyuki Ninomiya

Binary classification is a task that involves the classification of data into one of two distinct classes. It is widely utilized in various fields. However, conventional classifiers tend to make overconfident predictions for data that…

Machine Learning · Computer Science 2025-03-13 Shoma Yokura , Akihisa Ichiki

Abstract In Extreme Value methodology the choice of threshold plays an important role in efficient modelling of observations exceeding the threshold. The threshold must be chosen high enough to ensure an unbiased extreme value index but…

Methodology · Statistics 2020-06-11 Andréhette Verster , Lizanne Raubenheimer

Bayesian clinical trials can benefit of available historical information through the elicitation of informative prior distributions. Concerns are however often raised about the potential for prior-data conflict and the impact of Bayes test…

Methodology · Statistics 2022-12-01 Silvia Calderazzo , Annette Kopp-Schneider

Observations on the past provide some hints about what will happen in the future, and this can be quantified using information theory. The ``predictive information'' defined in this way has connections to measures of complexity that have…

Statistical Mechanics · Physics 2007-05-23 William Bialek , Naftali Tishby

Two data-dependent information metrics are developed to quantify the information of the prior and likelihood functions within a parametric Bayesian model, one of which is closely related to the reference priors from Berger, Bernardo, and…

Machine Learning · Statistics 2017-09-08 Giri Gopalan

Bayesian evidence ratios give a very attractive way of comparing models, and being able to quote the odds on a particular model seems a very clear motivation for making a choice. Jeffreys' scale of evidence is often used in the…

Instrumentation and Methods for Astrophysics · Physics 2020-09-07 Charles Jenkins

The use of Bayesian information criterion (BIC) in the model selection procedure is under the assumption that the observations are independent and identically distributed (i.i.d.). However, in practice, we do not always have i.i.d. samples.…

Applications · Statistics 2021-05-03 Nan Shen , Bárbara González

Informally, "Information Inconsistency" is the property that has been observed in many Bayesian hypothesis testing and model selection procedures whereby the Bayesian conclusion does not become definitive when the data seems to become…

Statistics Theory · Mathematics 2017-10-27 Joris Mulder , James O. Berger , Víctor Peña , M. J. Bayarri

A/B testing is ubiquitous within the machine learning and data science operations of internet companies. Generically, the idea is to perform a statistical test of the hypothesis that a new feature is better than the existing platform---for…

Statistics Theory · Mathematics 2017-10-11 David Goldberg , James E. Johndrow

The Bayesian measure of sample information about the parameter, known as Lindley's measure, is widely used in various problems such as developing prior distributions, models for the likelihood functions and optimal designs. The predictive…

Methodology · Statistics 2011-01-06 Nader Ebrahimi , Ehsan S. Soofi , Refik Soyer

The following problem is considered: given a joint distribution $P_{XY}$ and an event $E$, bound $P_{XY}(E)$ in terms of $P_XP_Y(E)$ (where $P_XP_Y$ is the product of the marginals of $P_{XY}$) and a measure of dependence of $X$ and $Y$.…

Information Theory · Computer Science 2019-03-12 Ibrahim Issa , Amedeo Roberto Esposito , Michael Gastpar