English
Related papers

Related papers: On Multiple Hypothesis Testing with Rejection Opti…

200 papers

Coding and testing schemes for binary hypothesis testing over noisy networks are proposed and their corresponding type-II error exponents are derived. When communication is over a discrete memoryless channel (DMC), our scheme combines…

Information Theory · Computer Science 2018-06-15 Sadaf Salehkalaibar , Michele Wigger

We consider a variant of sequential testing by betting where, at each time step, the statistician is presented with multiple data sources (arms) and obtains data by choosing one of the arms. We consider the composite global null hypothesis…

Methodology · Statistics 2026-03-19 Ricardo J. Sandoval , Ian Waudby-Smith , Michael I. Jordan

In this paper we revisit the binary hypothesis testing problem with one-sided compression. Specifically we assume that the distribution in the null hypothesis is a mixture distribution of iid components. The distribution under the…

Information Theory · Computer Science 2022-07-07 Minh Thanh Vu

We consider a data-driven robust hypothesis test where the optimal test will minimize the worst-case performance regarding distributions that are close to the empirical distributions with respect to the Wasserstein distance. This leads to a…

Statistics Theory · Mathematics 2021-06-01 Liyan Xie , Rui Gao , Yao Xie

Prediction with the possibility of abstention (or selective prediction) is an important problem for error-critical machine learning applications. While well-studied in the classification setup, selective approaches to regression are much…

Machine Learning · Statistics 2023-09-29 Fedor Noskov , Alexander Fishkov , Maxim Panov

An active hypothesis testing problem is formulated. In this problem, the agent can perform a fixed number of experiments and then decide on one of the hypotheses. The agent is also allowed to declare its experiments inconclusive if needed.…

Information Theory · Computer Science 2019-01-23 Dhruva Kartik , Ashutosh Nayyar , Urbashi Mitra

This work deals with a general problem of testing multiple hypotheses about the distribution of a discrete-time stochastic process. Both the Bayesian and the conditional settings are considered. The structure of optimal sequential tests is…

Statistics Theory · Mathematics 2009-12-23 Andrey Novikov

Thus far, limited research has been performed on resilient supplier selection - a problem that requires simultaneous consideration of a set of numerical and linguistic evaluation criteria, which are substantially different from traditional…

Artificial Intelligence · Computer Science 2019-04-09 Dizuo Jiang , Md Mahmudul Hassan , Tasnim Ibn Faiz , Md. Noor-E-Alam

Many supervised machine learning tasks, such as future state prediction in dynamical systems, require precise modeling of a forecast's uncertainty. The Multiple Hypotheses Prediction (MHP) approach addresses this problem by providing…

Machine Learning · Computer Science 2021-10-07 Tobias Leemann , Moritz Sackmann , Jörn Thielecke , Ulrich Hofmann

We explore the fundamental limits of heterogeneous distributed detection in an anonymous sensor network with n sensors and a single fusion center. The fusion center collects the single observation from each of the n sensors to detect a…

Information Theory · Computer Science 2018-07-31 Wei-Ning Chen , I-Hsiang Wang

Reinforcement learning can greatly benefit from the use of options as a way of encoding recurring behaviours and to foster exploration. An important open problem is how can an agent autonomously learn useful options when solving particular…

Machine Learning · Computer Science 2020-01-07 Manuel Del Verme , Bruno Castro da Silva , Gianluca Baldassarre

Consider the problem of distributed binary hypothesis testing with two terminals, where the decision is made at one of them (the "receiver"). We study the exponent of the error probability of the second type. Previously, an achievable…

Information Theory · Computer Science 2025-08-26 Yuval Kochman , Ligong Wang

In the hypothesis selection problem, we are given sample and query access to finite set of candidate distributions (hypotheses), $\mathcal{H} = \{H_1, \ldots, H_n\}$, and samples from an unknown distribution $P$, both over a domain…

Data Structures and Algorithms · Computer Science 2025-11-12 Anders Aamand , Maryam Aliakbarpour , Justin Y. Chen , Sandeep Silwal

Two-sample hypothesis testing for network comparison presents many significant challenges, including: leveraging repeated network observations and known node registration, but without requiring them to operate; relaxing strong structural…

Methodology · Statistics 2024-02-05 Meijia Shao , Dong Xia , Yuan Zhang , Qiong Wu , Shuo Chen

The severity of type II errors is frequently ignored when deriving a multiple testing procedure, even though utilizing it properly can greatly help in making correct decisions. This paper puts forward a theory behind developing a multiple…

Methodology · Statistics 2014-03-25 Li He , Sanat K. Sarkar , Zhigen Zhao

The problem of robust hypothesis testing is studied, where under the null and the alternative hypotheses, the data-generating distributions are assumed to be in some uncertainty sets, and the goal is to design a test that performs well…

Signal Processing · Electrical Eng. & Systems 2023-08-08 Zhongchang Sun , Shaofeng Zou

In distributed hypothesis testing, a central server performs hypothesis testing based on information received from distributed sensors/clients. We study a secure variant of this problem in which the central server determines the hypothesis…

Information Theory · Computer Science 2026-05-29 Gowtham R. Kurri , Varun Narayanan , Vinod M. Prabhakaran , K. R. Sahasranand

Consider the multiple testing problem of testing null hypotheses $H_1,...,H_s$. A classical approach to dealing with the multiplicity problem is to restrict attention to procedures that control the familywise error rate ($\mathit{FWER}$),…

Statistics Theory · Mathematics 2007-06-13 Joseph P. Romano , Azeem M. Shaikh

Two-sample hypothesis testing-determining whether two sets of data are drawn from the same distribution-is a fundamental problem in statistics and machine learning with broad scientific applications. In the context of nonparametric testing,…

Machine Learning · Statistics 2026-04-21 Antoine Chatalic , Marco Letizia , Nicolas Schreuder , Lorenzo Rosasco

Modern data analysis frequently involves large-scale hypothesis testing, which naturally gives rise to the problem of maintaining control of a suitable type I error rate, such as the false discovery rate (FDR). In many biomedical and…

Methodology · Statistics 2023-07-25 David S. Robertson , James M. S. Wason , Aaditya Ramdas