English
Related papers

Related papers: On the Sample Information About Parameter and Pred…

200 papers

This paper develops Bayesian sample size formulae for experiments comparing two groups. We assume the experimental data will be analysed in the Bayesian framework, where pre-experimental information from multiple sources can be represented…

Methodology · Statistics 2022-03-09 Haiyan Zheng , Thomas Jaki , James M. S. Wason

Predicting when an individual will adopt a new behavior is an important problem in application domains such as marketing and public health. This paper examines the perfor- mance of a wide variety of social network based measurements…

Social and Information Networks · Computer Science 2016-07-26 Nikhil Kumar , Ruocheng Guo , Ashkan Aleali , Paulo Shakarian

Quantifying cooperation or synergy among random variables in predicting a single target random variable is an important problem in many complex systems. We review three prior information-theoretic measures of synergy and introduce a novel…

Information Theory · Computer Science 2014-04-02 Virgil Griffith , Christof Koch

Biases with respect to socially-salient attributes of individuals have been well documented in evaluation processes used in settings such as admissions and hiring. We view such an evaluation process as a transformation of a distribution of…

Computers and Society · Computer Science 2023-10-27 L. Elisa Celis , Amit Kumar , Anay Mehrotra , Nisheeth K. Vishnoi

Shannon defined the mutual information between two variables. We illustrate why the true mutual information between a variable and the predictions made by a prediction algorithm is not a suitable measure of prediction quality, but the…

Statistics Theory · Mathematics 2025-04-11 Roger Sewell

Mutual information is a well-known tool to measure the mutual dependence between variables. In this paper, a Bayesian nonparametric estimation of mutual information is established by means of the Dirichlet process and the $k$-nearest…

Methodology · Statistics 2021-08-10 Luai Al-Labadi , Forough Fazeli Asl , Zahra Saberi

Using observation data to estimate unknown parameters in computational models is broadly important. This task is often challenging because solutions are non-unique due to the complexity of the model and limited observation data. However,…

Methodology · Statistics 2018-12-18 Jiacheng Wu , Jian-Xun Wang , Shawn C. Shadden

Barlow (1985) hypothesized that the co-occurrence of two events $A$ and $B$ is "suspicious" if $P(A,B) \gg P(A) P(B)$. We first review classical measures of association for $2 \times 2$ contingency tables, including Yule's $Y$ (Yule, 1912),…

Machine Learning · Computer Science 2023-03-03 Christopher K. I. Williams

Parameter inference is a fundamental problem in data-driven modeling. Given observed data that is believed to be a realization of some parameterized model, the aim is to find parameter values that are able to explain the observed data. In…

Data Structures and Algorithms · Computer Science 2016-04-20 Carlo Albert , Simone Ulzega , Ruedi Stoop

Our paper deals with inferring simulator-based statistical models given some observed data. A simulator-based model is a parametrized mechanism which specifies how data are generated. It is thus also referred to as generative model. We…

Machine Learning · Statistics 2016-01-01 Michael U. Gutmann , Jukka Corander

Information theory is widely accepted as a powerful tool for analyzing complex systems and it has been applied in many disciplines. Recently, some central components of information theory - multivariate information measures - have found…

Information Theory · Computer Science 2012-08-30 Nicholas Timme , Wesley Alford , Benjamin Flecker , John M. Beggs

Optimal transport and Wasserstein distances are flourishing in many scientific fields as a means for comparing and connecting random structures. Here we pioneer the use of an optimal transport distance between L\'{e}vy measures to solve a…

Statistics Theory · Mathematics 2023-09-18 Marta Catalano , Hugo Lavenant , Antonio Lijoi , Igor Prünster

When random effects are correlated with sample design variables, the usual approach of employing individual survey weights (constructed to be inversely proportional to the unit survey inclusion probabilities) to form a pseudo-likelihood no…

Methodology · Statistics 2021-08-26 Terrance D. Savitsky , Matthew R. Williams

The interpretability of prediction mechanisms with respect to the underlying prediction problem is often unclear. While several studies have focused on developing prediction models with meaningful parameters, the causal relationships…

Machine Learning · Statistics 2017-09-05 Patrick Blöbaum , Shohei Shimizu

The prior distribution for the unknown model parameters plays a crucial role in the process of statistical inference based on Bayesian methods. However, specifying suitable priors is often difficult even when detailed prior knowledge is…

Methodology · Statistics 2020-03-18 Marcelo Hartmann , Georgi Agiashvili , Paul Bürkner , Arto Klami

External data borrowing in clinical trial designs has increased in recent years. This is accomplished in the Bayesian framework by specifying informative prior distributions. To mitigate the impact of potential inconsistency (bias) between…

Bayes' theorem incorporates distinct types of information through the likelihood and prior. Direct observations of state variables enter the likelihood and modify posterior probabilities through consistent updating. Information in terms of…

Methodology · Statistics 2024-07-19 Duncan K. Foley , Ellis Scharfenaker

A central challenge in statistical inference is the presence of confounding variables that may distort observed associations between treatment and outcome. Conventional "causal" methods, grounded in assumptions such as ignorability, exclude…

Methodology · Statistics 2025-09-09 Ellis Scharfenaker , Duncan K. Foley

In causal inference, sensitivity analysis is important to assess the robustness of study conclusions to key assumptions. We perform sensitivity analysis of the assumption that missing outcomes are missing completely at random. We follow a…

Statistics Theory · Mathematics 2023-05-12 Bart Eggen , Stéphanie L. van der Pas , Aad W. van der Vaart

We study a separable design for computing information measures, where the information measure is computed from learned feature representations instead of raw data. Under mild assumptions on the feature representations, we demonstrate that a…

Information Theory · Computer Science 2025-01-28 Xiangxiang Xu , Lizhong Zheng