English
Related papers

Related papers: On distinguishability of hypotheses

200 papers

We propose an approach to rapidly find the upper limit of separability between datasets that is directly applicable to HEP classification problems. The most common HEP classification task is to use $n$ values (variables) for an object…

High Energy Physics - Experiment · Physics 2017-09-01 Nicholas Carrara , Jesse A. Ernst

In the presence of weak overall correlation, it may be useful to investigate if the correlation is significantly and substantially more pronounced over a subpopulation. Two different testing procedures are compared. Both are based on the…

Machine Learning · Statistics 2015-04-22 Stephen Bamattre , Rex Hu , Joseph S. Verducci

Distinguishing causal connections from correlations is important in many scenarios. However, the presence of unobserved variables, such as the latent confounder, can introduce bias in conditional independence testing commonly employed in…

Methodology · Statistics 2024-05-03 Mingzhou Liu , Xinwei Sun , Yu Qiao , Yizhou Wang

Statistical tools have been developed to quantify the agreement between a hypothesis or a model and the observed data for probabilistic phenomena. In this work, we define statistical methods used to measure the properties of the higgs boson…

Popular Physics · Physics 2020-05-21 Abdeljalil Habjia

The maximum type-I and type-II error exponents associated with the newly introduced almost-fixed-length hypothesis testing is characterized. In this class of tests, the decision-maker declares the true hypothesis almost always after…

Information Theory · Computer Science 2016-05-18 Anusha Lalitha , Tara Javidi

In this paper we provide machine learning practitioners with tools to answer the question: is there class-conditional noise in my labels? In particular, we present hypothesis tests to check whether a given dataset of instance-label pairs…

Machine Learning · Computer Science 2021-06-02 Rafael Poyiadzi , Weisong Yang , Niall Twomey , Raul Santos-Rodriguez

Is it possible for a large sequence of measurements or observations, which support a hypothesis, to counterintuitively decrease our confidence? Can unanimous support be too good to be true? The assumption of independence is often made in…

In this note we consider the stability of posterior measures occuring in Bayesian inference w.r.t. perturbations of the prior measure and the log-likelihood function. This extends the well-posedness analysis of Bayesian inverse problems. In…

Statistics Theory · Mathematics 2020-06-24 Björn Sprungk

Consider the problem of binary hypothesis testing. Given $Z$ coming from either $\mathbb P^{\otimes m}$ or $\mathbb Q^{\otimes m}$, to decide between the two with small probability of error it is sufficient, and in many cases necessary, to…

Statistics Theory · Mathematics 2024-03-11 Patrik Róbert Gerber , Yury Polyanskiy

In this paper, we introduce and develop the concept of conditional quantization for Borel probability measures on $\mathbb{R}^k,$ considering both constrained and unconstrained frameworks. For each setting, we define the associated…

Probability · Mathematics 2025-06-06 Megha Pandey , Mrinal Kanti Roychowdhury

Many tools exist to detect dependence between random variables, a core question across a wide range of machine learning, statistical, and scientific endeavors. Although several statistical tests guarantee eventual detection of any…

Machine Learning · Statistics 2026-03-23 Nathaniel Xu , Feng Liu , Danica J. Sutherland

The search for a scientific theory of consciousness should result in theories that are falsifiable. However, here we show that falsification is especially problematic for theories of consciousness. We formally describe the standard…

Neurons and Cognition · Quantitative Biology 2021-04-29 Johannes Kleiner , Erik Hoel

We study hypothesis testing under communication constraints, where each sample is quantized before being revealed to a statistician. Without communication constraints, it is well known that the sample complexity of simple binary hypothesis…

Statistics Theory · Mathematics 2023-12-19 Ankit Pensia , Varun Jog , Po-Ling Loh

In the report the approach to estimation of quality of planned experiments is considered. This approach is based on the analysis of uncertainty, which will take place under the future hypotheses testing about the existence of a new…

Data Analysis, Statistics and Probability · Physics 2009-11-10 S. I. Bityukov , N. V. Krasnikov

The so-called density of states is a Borel probability measure on the real line associated with the solution of the Dyson equation which we set up, on any fixed $C^\ast$-probability space, for a selfadjoint offset and a $2$-positive linear…

Functional Analysis · Mathematics 2022-10-11 Tobias Mai

Previous studies have used a specific success metric within an algorithmic search framework to prove machine learning impossibility results. However, this specific success metric prevents us from applying these results on other forms of…

Machine Learning · Statistics 2020-01-06 Tyler Sam , Jake Williams , Abel Tadesse , Huey Sun , George Montanez

Statistical hypothesis testing, as formalized by 20th Century statisticians and taught in college statistics courses, has been a cornerstone of 100 years of scientific progress. Nevertheless, the methodology is increasingly questioned in…

Methodology · Statistics 2024-08-22 Brian Dennis , Mark L Taper , José M Ponciano

This paper is devoted to multi-dimensional inverse problems. In this setting, we address a goodness-of-fit testing problem. We investigate the separation rates associated to different kinds of smoothness assumptions and different degrees of…

Statistics Theory · Mathematics 2014-02-20 Yuri I. Ingster , Béatrice Laurent , Clément Marteau

We consider large-scale studies in which thousands of significance tests are performed simultaneously. In some of these studies, the multiple testing procedure can be severely biased by latent confounding factors such as batch effects and…

Methodology · Statistics 2016-06-21 Jingshu Wang , Qingyuan Zhao , Trevor Hastie , Art B. Owen

We describe certain sufficient conditions for an infinitely divisible probability measure on a class of connected Lie groups to be embeddable in a continuous one-parameter convolution semigroup of probability measures. (Theorem 1.3). This…

Probability · Mathematics 2020-06-24 S. G. Dani , Yves Guivarc'h , Riddhi Shah