English
Related papers

Related papers: On Multiple Hypothesis Testing with Rejection Opti…

200 papers

We study hypothesis testing over a heterogeneous population of strategic agents with private information. Any single test applied uniformly across the population yields statistical error that is sub-optimal relative to the performance of an…

Computer Science and Game Theory · Computer Science 2025-10-27 Flora C. Shi , Martin J. Wainwright , Stephen Bates

The efficiency of Hamiltonian Monte Carlo (HMC) can suffer when sampling a distribution with a wide range of length scales, because the small step sizes needed for stability in high-curvature regions are inefficient elsewhere. To address…

Machine Learning · Statistics 2023-11-09 Chirag Modi , Alex Barnett , Bob Carpenter

In this paper, our interest is in the problem of simultaneous hypothesis testing when the test statistics corresponding to the individual hypotheses are possibly correlated. Specifically, we consider the case when the test statistics…

Statistics Theory · Mathematics 2019-01-14 Anupam Kundu , Subir Kumar Bhandari

Testing hypotheses of goodness-of-fit about mixture distributions on the basis of independent but not necessarily identically distributed random vectors is considered. The hypotheses are given by a specific distribution or by a family of…

Statistics Theory · Mathematics 2016-04-21 Daniel Gaigall

The two-sample hypothesis testing problem is studied for the challenging scenario of high dimensional data sets with small sample sizes. We show that the two-sample hypothesis testing problem can be posed as a one-class set classification…

Machine Learning · Statistics 2017-11-15 Hamed Masnadi-Shirazi

Consider the problem of simultaneously testing null hypotheses H_1,...,H_s. The usual approach to dealing with the multiplicity problem is to restrict attention to procedures that control the familywise error rate (FWER), the probability of…

Statistics Theory · Mathematics 2007-06-13 E. L. Lehmann , Joseph P. Romano

Mutual information (MI) is an information-theoretic measure of dependency between two random variables. Several methods to estimate MI, from samples of two random variables with unknown underlying probability distributions have been…

Machine Learning · Computer Science 2020-11-18 P Aditya Sreekar , Ujjwal Tiwari , Anoop Namboodiri

Despite the popularity of the false discovery rate (FDR) as an error control metric for large-scale multiple testing, its close Bayesian counterpart the local false discovery rate (lfdr), defined as the posterior probability that a…

Methodology · Statistics 2023-09-22 Jake A. Soloff , Daniel Xiang , William Fithian

We present an approximate inference method, based on a synergistic combination of R\'enyi $\alpha$-divergence variational inference (RDVI) and rejection sampling (RS). RDVI is based on minimization of R\'enyi $\alpha$-divergence…

Machine Learning · Computer Science 2019-10-30 Rahul Sharma , Abhishek Kumar , Piyush Rai

We consider a distributed learning setup where a network of agents sequentially access realizations of a set of random variables with unknown distributions. The network objective is to find a parametrized distribution that best describes…

Optimization and Control · Mathematics 2016-05-10 Angelia Nedić , Alex Olshevsky , César Uribe

Statistical protocols are often used for decision-making involving multiple parties, each with their own incentives, private information, and ability to influence the distributional properties of the data. We study a game-theoretic version…

Methodology · Statistics 2024-12-24 Flora C. Shi , Stephen Bates , Martin J. Wainwright

The problem of binary hypothesis testing between two probability measures is considered. New sharp bounds are derived for the best achievable error probability of such tests based on independent and identically distributed observations.…

Information Theory · Computer Science 2024-05-30 Valentinian Lungu , Ioannis Kontoyiannis

We study the problem of selecting the best heterogeneous treatment effect (HTE) estimator from a collection of candidates in settings where the treatment effect is fundamentally unobserved. We cast estimator selection as a multiple testing…

Machine Learning · Statistics 2025-11-25 Jiayi Guo , Zijun Gao

We consider the problem of decentralized sequential active hypothesis testing (DSAHT), where two transmitting agents, each possessing a private message, are actively helping a third agent--and each other--to learn the message pair over a…

Information Theory · Computer Science 2020-01-15 Achilleas Anastasopoulos , Sandeep Pradhan

Deep learning (DL)-based systems can exhibit unexpected behavior when exposed to out-of-distribution (OOD) scenarios, posing serious risks in safety-critical domains such as malware detection and autonomous driving. This underscores the…

Software Engineering · Computer Science 2026-04-28 Jingyu Zhang , Fan Wang , Jacky Keung , Yihan Liao , Yan Xiao , Lei Ma

Detection rules have traditionally been designed for rational agents that minimize the Bayes risk (average decision cost). With the advent of crowd-sensing systems, there is a need to redesign binary hypothesis testing rules for behavioral…

Artificial Intelligence · Computer Science 2016-10-07 V. Sriram Siddhardh Nadendla , Swastik Brahma , Pramod K. Varshney

For some hypothesis classes and input distributions, active agnostic learning needs exponentially fewer samples than passive learning; for other classes and distributions, it offers little to no improvement. The most popular algorithms for…

Machine Learning · Computer Science 2024-05-24 Eric Price , Yihan Zhou

We consider a multihypothesis social learning problem in which an agent has access to a set of private observations and chooses an opinion from a set of experts to incorporate into its final decision. To model individual biases, we allow…

Information Theory · Computer Science 2015-06-19 Wee Peng Tay

In multiple classification, one aims to determine whether a testing sequence is generated from the same distribution as one of the M training sequences or not. Unlike most of existing studies that focus on discrete-valued sequences with…

Machine Learning · Statistics 2024-10-30 Lina Zhu , Lin Zhou

Consider the problem of testing $s$ hypotheses simultaneously. The usual approach restricts attention to procedures that control the probability of even one false rejection, the familywise error rate (FWER). If $s$ is large, one might be…

Statistics Theory · Mathematics 2007-11-06 Joseph P. Romano , Michael Wolf