English
Related papers

Related papers: Estimation and Confidence Intervals for Mutual Inf…

200 papers

The purpose of the present paper is to assess the efficacy of confidence intervals for Rosenthal's fail-safe number. Although Rosenthal's estimator is highly used by researchers, its statistical properties are largely unexplored. First of…

Methodology · Statistics 2015-09-07 Konstantinos C. Fragkos , Michail Tsagris , Christos C. Frangos

Several scientific fields including psychology are undergoing a replication crisis. There are many reasons for this problem, one of which is a misuse of p-values. There are several alternatives to p-values, and in this paper we describe a…

Methodology · Statistics 2020-10-05 Brian D. Segal

We review the alternative proposals introduced recently in the literature to update the standard formula to estimate the uncertainty on the mean of repeated measurements, and we compare their performances on synthetic examples with normal…

Data Analysis, Statistics and Probability · Physics 2022-09-13 Pascal Pernot , Jean-Paul Berthet

This note points out how confidence interval estimates for standard deviation transform into confidence interval estimates for the power of F-tests at fixed alternative means. An application is shown for the test of a two-sided hypothesis…

Statistics Theory · Mathematics 2014-05-13 Ali Akbar Jafari , Abdollreza Bazargan-Lari , Mingfei

In this paper we first provide a method to compute confidence intervals for the center of a piecewise normal distribution given a sample from this distribution, under certain assumptions. We then extend this method to an asymptotic setting,…

Optimization and Control · Mathematics 2022-08-08 Shu Lu , Hongsheng Liu

Sliced Mutual Information (SMI) is widely used as a scalable alternative to mutual information for measuring non-linear statistical dependence. Despite its advantages, such as faster convergence, robustness to high dimensionality, and…

Machine Learning · Computer Science 2025-12-10 Alexander Semenenko , Ivan Butakov , Alexey Frolov , Ivan Oseledets

There are over 55 different ways to construct a confidence respectively credible interval (CI) for the binomial proportion. Methods to compare them are necessary to decide which should be used in practice. The interval score has been…

Methodology · Statistics 2022-07-08 Lisa J. Hofer , Leonhard Held

In this paper, we consider the problem of constructing confidence interval for the correlation coefficient in a bivariate normal distribution. For this problem, we found fifteen approaches in literatures. Also, we have proposed a…

Methodology · Statistics 2014-10-31 Mohammad Reza Kazemi , Ali Akbar Jafari

Estimating and optimizing Mutual Information (MI) is core to many problems in machine learning; however, bounding MI in high dimensions is challenging. To establish tractable and scalable objectives, recent work has turned to variational…

Machine Learning · Computer Science 2019-05-17 Ben Poole , Sherjil Ozair , Aaron van den Oord , Alexander A. Alemi , George Tucker

Machine learning models are often evaluated using point estimates of performance metrics such as accuracy, F1 score, or mean squared error. Such summaries fail to capture the inherent variability induced by stochastic elements of the…

Machine Learning · Computer Science 2026-05-13 Christoph Lehmann , Yahor Paromau

Confidence intervals for the population mean of normally distributed data are some of the most standard statistical outputs one might want from a database. In this work we give practical differentially private algorithms for this task. We…

Methodology · Statistics 2020-01-09 Wenxin Du , Canyon Foot , Monica Moniot , Andrew Bray , Adam Groce

The pointwise mutual information profile, or simply profile, is the distribution of pointwise mutual information for a given pair of random variables. One of its important properties is that its expected value is precisely the mutual…

Machine Learning · Statistics 2024-05-30 Paweł Czyż , Frederic Grabowski , Julia E. Vogt , Niko Beerenwinkel , Alexander Marx

In this paper, we provide a general methodology to draw statistical inferences on individual signal coordinates or linear combinations of them in sparse phase retrieval. Given an initial estimator for the targeting parameter (some simple…

Methodology · Statistics 2020-09-29 Yisha Yao

Instrumental variables have been widely used to estimate the causal effect of a treatment on an outcome. Existing confidence intervals for causal effects based on instrumental variables assume that all of the putative instrumental variables…

Methodology · Statistics 2016-07-14 Hyunseung Kang , T. Tony Cai , Dylan S. Small

Confidence estimation infers a probability for whether each model output is correct or not. While predicting such binary correctness is sensible for tasks with exact answers, free-form generation tasks are often more nuanced, with output…

Computation and Language · Computer Science 2026-01-14 Chi-Yang Hsu , Alexander Braylan , Yiheng Su , Matthew Lease , Omar Alonso

The problem of quantifying uncertainty about the locations of multiple change points by means of confidence intervals is addressed. The asymptotic distribution of the change point estimators obtained as the local maximisers of moving sum…

Methodology · Statistics 2022-06-20 Haeran Cho , Claudia Kirch

Estimating mutual information (MI) between two continuous random variables $X$ and $Y$ allows to capture non-linear dependencies between them, non-parametrically. As such, MI estimation lies at the core of many data science applications.…

Information Theory · Computer Science 2022-01-19 Alexander Marx , Jonas Fischer

We consider a longitudinal data structure consisting of baseline covariates, time-varying treatment variables, intermediate time-dependent covariates, and a possibly time dependent outcome. Previous studies have shown that estimating the…

Statistics Theory · Mathematics 2018-10-09 Linh Tran , Maya Petersen , Joshua Schwab , Mark J van der Laan

Mutual information is widely used, in a descriptive way, to measure the stochastic dependence of categorical random variables. In order to address questions such as the reliability of the descriptive value, one must consider…

Machine Learning · Computer Science 2007-07-13 Marcus Hutter , Marco Zaffalon

Mutual information has many applications in image alignment and matching, mainly due to its ability to measure the statistical dependence between two images, even if the two images are from different modalities (e.g., CT and MRI). It…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Jiecheng Liao , Junhao Lu , Jeff Ji , Jiacheng He