English
Related papers

Related papers: Multiple Hypothesis Testing in Pattern Discovery

200 papers

The sequential multiple testing problem is considered under two generalized error metrics. Under the first one, the probability of at least $k$ mistakes, of any kind, is controlled. Under the second, the probabilities of at least $k_1$…

Statistics Theory · Mathematics 2019-02-18 Yanglei Song , Georgios Fellouris

The problem of testing mutually exclusive hypotheses with dependent test statistics is considered. Bayesian and frequentist approaches to multiplicity control are studied and compared to help gain understanding as to the effect of test…

Statistics Theory · Mathematics 2016-11-21 Sean Chang , James O. Berger

The problem of large-scale simultaneous hypothesis testing is re-visited. Bagging and subagging procedures are put forth with the purpose of improving the discovery power of the tests. The procedures are implemented in both simulated and…

Methodology · Statistics 2007-05-23 Dimitris N. Politis

In contemporary research, data scientists often test an infinite sequence of hypotheses $H_1,H_2,\ldots$ one by one, and are required to make real-time decisions without knowing the future hypotheses or data. In this paper, we consider such…

Methodology · Statistics 2025-12-16 Lasse Fischer , Aaditya Ramdas

The task of binary quantum hypothesis testing is to determine the state of a quantum system via measurements on it, given the side information that it is in one of two possible states, say $\rho$ and $\sigma$. This task is generally studied…

Quantum Physics · Physics 2021-04-21 Robert Salzmann , Nilanjana Datta

Large-scale simultaneous hypothesis testing appears in many areas such as microarray studies, genome-wide association studies, brain imaging, disease mapping and astronomical surveys. A well-known inference method is to control the false…

Methodology · Statistics 2025-07-22 Xiaoqing Niu , Pengfei Li , Yuejiao Fu

Identifying subgroups of patients with an enhanced response to a new treatment has become an area of increased interest in the last few years. When there is knowledge about possible subpopulations with an enhanced treatment effect before…

Methodology · Statistics 2018-11-27 Marius Thomas , Björn Bornkamp , Martin Posch , Franz König

We consider the problem of sequential multiple hypothesis testing with nontrivial data collection costs. This problem appears, for example, when conducting biological experiments to identify differentially expressed genes of a disease…

Machine Learning · Computer Science 2023-11-06 Thomas Cook , Harsh Vardhan Dubey , Ji Ah Lee , Guangyu Zhu , Tingting Zhao , Patrick Flaherty

Motivated by the practice of exploratory research, we formulate an approach to multiple testing that reverses the conventional roles of the user and the multiple testing procedure. Traditionally, the user chooses the error criterion, and…

Methodology · Statistics 2013-10-03 Jelle J. Goeman , Aldo Solari

Closed testing procedures are classically used for familywise error rate (FWER) control, but they can also be used to obtain simultaneous confidence bounds for the false discovery proportion (FDP) in all subsets of the hypotheses. In this…

Methodology · Statistics 2019-11-15 Jelle Goeman , Rosa Meijer , Thijmen Krebs , Aldo Solari

We introduce dataset multiplicity, a way to study how inaccuracies, uncertainty, and social bias in training datasets impact test-time predictions. The dataset multiplicity framework asks a counterfactual question of what the set of…

Machine Learning · Computer Science 2023-04-24 Anna P. Meyer , Aws Albarghouthi , Loris D'Antoni

We present a novel necessary and sufficient principle for multiple testing methods controlling an expected loss. This principle asserts that every such multiple testing method is a special case of a general closed testing procedure based on…

Methodology · Statistics 2026-01-05 Ziyu Xu , Aldo Solari , Lasse Fischer , Rianne de Heide , Aaditya Ramdas , Jelle Goeman

The multiple extension problem arises frequently in diagnostic and default inference. That is, we can often use any of a number of sets of defaults or possible hypotheses to explain observations or make Predictions. In default inference,…

Artificial Intelligence · Computer Science 2013-04-11 Eric Neufeld , David L Poole

The increased focus on misinformation has spurred development of data and systems for detecting the veracity of a claim as well as retrieving authoritative evidence. The Fact Extraction and VERification (FEVER) dataset provides such a…

Computation and Language · Computer Science 2020-04-28 Christopher Hidey , Tuhin Chakrabarty , Tariq Alhindi , Siddharth Varia , Kriste Krstovski , Mona Diab , Smaranda Muresan

We study a hypothesis testing problem in which data is compressed distributively and sent to a detector that seeks to decide between two possible distributions for the data. The aim is to characterize all achievable encoding rates and…

Information Theory · Computer Science 2011-02-01 Md. Saifur Rahman , Aaron B. Wagner

We investigate a class of methods for selective inference that condition on a selection event. Such methods follow a two-stage process. First, a data-driven (sub)collection of hypotheses is chosen from some large universe of hypotheses.…

Methodology · Statistics 2024-04-09 Jelle Goeman , Aldo Solari

This paper proposes a framework for semantic hypothesis testing tailored to imaging inverse problems. Modern imaging methods struggle to support hypothesis testing, a core component of the scientific method that is essential for the…

Machine Learning · Statistics 2025-05-29 Yiming Xi , Konstantinos Zygalakis , Marcelo Pereyra

Multiple hypothesis testing is widely used to evaluate scientific studies involving statistical tests. However, for many of these tests, p-values are not available and are thus often approximated using Monte Carlo tests such as permutation…

Applications · Statistics 2018-10-17 Axel Gandy , Georg Hahn

We present a general framework for hypothesis testing on distributions of sets of individual examples. Sets may represent many common data sources such as groups of observations in time series, collections of words in text or a batch of…

Methodology · Statistics 2021-02-03 Alexis Bellot , Mihaela van der Schaar

Gene expression and phenotype association can be affected by potential unmeasured confounders from multiple sources, leading to biased estimates of the associations. Since genetic variants largely explain gene expression variations, they…

Methodology · Statistics 2019-10-23 Jiarui Lu , Hongzhe Li