English
Related papers

Related papers: Finite-Length Bounds on Hypothesis Testing Subject…

200 papers

Alternative exact expressions are derived for the minimum error probability of a hypothesis test discriminating among $M$ quantum states. The first expression corresponds to the error probability of a binary hypothesis test with certain…

Quantum Physics · Physics 2016-11-15 Gonzalo Vazquez-Vilar

We consider the best-choice problem for independent (not necessarily iid) observations $X_1, \cdots, X_n$ with the aim of selecting the sample minimum. We show that in this full generality the monotone case of optimal stopping holds and the…

Probability · Mathematics 2021-10-13 Alexander Gnedin , Patryk Kozieł , Małgorzata Sulkowska

Given $n$ samples from a population of individuals belonging to different types with unknown proportions, how do we estimate the probability of discovering a new type at the $(n+1)$-th draw? This is a classical problem in statistics,…

Statistics Theory · Mathematics 2018-06-27 Fadhel Ayed , Marco Battiston , Federico Camerlenghi , Stefano Favaro

This work invokes the notion of $f$-divergence to introduce a novel upper bound on the Bayes error rate of a general classification task. We show that the proposed bound can be computed by sampling from the output of a parameterized model.…

Machine Learning · Computer Science 2025-01-15 Mohammadreza Tavasoli Naeini , Ali Bereyhi , Morteza Noshad , Ben Liang , Alfred O. Hero

This paper considers the estimation of Shannon entropy for discrete distributions with countably infinite support. While minimax rates for finite-support distributions are established, infinite-support distributions present distinct…

Statistics Theory · Mathematics 2025-12-03 Octavio César Mesner

This paper is concerned with estimating the intersection point of two densities, given a sample of both of the densities. This problem arises in classification theory. The main results provide lower bounds for the probability of the…

Statistics Theory · Mathematics 2007-12-18 Franz Merkl , Leila Mohammadi

In this paper, we study the problem of determining $k$ anomalous random variables that have different probability distributions from the rest $(n-k)$ random variables. Instead of sampling each individual random variable separately as in the…

Information Theory · Computer Science 2024-09-09 Myung Cho , Weiyu Xu , Lifeng Lai

The generalization ability of minimizers of the empirical risk in the context of binary classification has been investigated under a wide variety of complexity assumptions for the collection of classifiers over which optimization is…

Statistics Theory · Mathematics 2019-01-21 Clémençon Stephan , Patrice Bertail , Guillaume Papa

Randomization tests are based on a re-randomization of existing data to gain data-dependent critical values that lead to exact hypothesis tests under special circumstances. However, it is not always possible to re-randomize data in…

Statistics Theory · Mathematics 2021-10-20 Dennis Dobler

We investigate the nonparametric, composite hypothesis testing problem for arbitrary unknown distributions in the asymptotic regime where both the sample size and the number of hypotheses grow exponentially large. Such asymptotic analysis…

Information Theory · Computer Science 2019-01-30 Qunwei Li , Tiexing Wang , Donald J. Bucci , Yingbin Liang , Biao Chen , Pramod K. Varshney

We study the performance -- and specifically the rate at which the error probability converges to zero -- of Machine Learning (ML) classification techniques. Leveraging the theory of large deviations, we provide the mathematical conditions…

Machine Learning · Statistics 2023-01-18 Paolo Braca , Leonardo M. Millefiori , Augusto Aubry , Stefano Marano , Antonio De Maio , Peter Willett

The problem of simple $M-$ary hypothesis testing under a generic performance criterion that depends on arbitrary functions of error probabilities is considered. Using results from convex analysis, it is proved that an optimal decision rule…

Signal Processing · Electrical Eng. & Systems 2019-07-26 Berkan Dulek , Cuneyd Ozturk , Sinan Gezici

There has a major problem in the current theory of hypothesis testing in which no unified indicator to evaluate the goodness of various test methods since the cost function or utility function usually relies on the specific application…

Statistics Theory · Mathematics 2023-06-19 Dazhuan Xu , Nan Wang

The paper deals with minimax optimal statistical tests for two composite hypotheses, where each hypothesis is defined by a non-parametric uncertainty set of feasible distributions. It is shown that for every pair of uncertainty sets of the…

Statistics Theory · Mathematics 2018-04-17 Michael Fauss , Abdelhak M. Zoubir , H. Vincent Poor

The upper bounds on the coverage probabilities of the confidence regions based on blockwise empirical likelihood [Kitamura (1997)] and nonstandard expansive empirical likelihood [Nordman et al. (2013)] methods for time series data are…

Methodology · Statistics 2014-08-01 Xianyang Zhang , Xiaofeng Shao

This paper studies classification with an abstention option in the online setting. In this setting, examples arrive sequentially, the learner is given a hypothesis class $\mathcal H$, and the goal of the learner is to either predict a label…

Machine Learning · Computer Science 2016-09-29 Chicheng Zhang , Kamalika Chaudhuri

We revisit the classic problem of aggregating binary advice from conditionally independent experts, also known as the Naive Bayes setting. Our quantity of interest is the error probability of the optimal decision rule. In the case of…

Probability · Mathematics 2024-12-24 Aryeh Kontorovich , Ariel Avital

Determining the presence of a potential optical source in the interest region is important for an imaging system and can be achieved by using hypothesis testing. The previous studies assume that the potential source is completely…

Quantum Physics · Physics 2024-10-23 Jian-Dong Zhang , Kexin Zhang , Lili Hou , Shuai Wang

The trade-off between the two types of errors in binary state discrimination may be quantified in the asymptotics by various error exponents. In the case of simple i.i.d. hypotheses, each of these exponents is equal to a divergence…

Quantum Physics · Physics 2023-01-18 Milán Mosonyi , Zsombor Szilágyi , Mihály Weiner

Practical problems with missing data are common, and statistical methods have been developed concerning the validity and/or efficiency of statistical procedures. On a central focus, there have been longstanding interests on the mechanism…

Methodology · Statistics 2020-03-26 Rui Duan , C. Jason Liang , Pamela Shaw , Cheng Yong Tang , Yong Chen