English
Related papers

Related papers: A strong converse bound for multiple hypothesis te…

200 papers

We consider the problem of dictionary learning under the assumption that the observed signals can be represented as sparse linear combinations of the columns of a single large dictionary matrix. In particular, we analyze the minimax risk of…

Machine Learning · Statistics 2014-06-30 Alexander Jung , Yonina C. Eldar , Norbert Görtz

We consider the problem of inference on the signs of $n>1$ parameters. We aim to provide $1-\alpha$ post-hoc confidence bounds on the number of positive and negative (or non-positive) parameters. The guarantee is simultaneous, for all…

Methodology · Statistics 2024-03-05 Ruth Heller , Aldo Solari

We derive a universal lower bound on the Fano factors of general biochemical discriminatory networks involving irreversible catalysis steps, based on the thermodynamic uncertainty relation, and compare it to a numerically exact Pareto…

Statistical Mechanics · Physics 2024-04-18 Jonas Berx , Karel Proesmans

Testing of hypotheses is a well studied topic in mathematical statistics. Recently, this issue has also been addressed in the context of Inverse Problems, where the quantity of interest is not directly accessible but only after the…

Statistics Theory · Mathematics 2024-04-09 Remo Kretschmann , Daniel Wachsmuth , Frank Werner

In this paper, we investigate the sample complexity of recovering tensors with low symmetric rank from symmetric rank-one measurements. This setting is particularly motivated by the study of higher-order interactions and the analysis of…

Statistics Theory · Mathematics 2025-02-10 Eren C. Kızıldağ

In multi-task learning (MTL) with each task involving graph-dependent data, existing generalization analyses yield a \emph{sub-optimal} risk bound of $O(\frac{1}{\sqrt{n}})$, where $n$ is the number of training samples of each task.…

Machine Learning · Computer Science 2025-05-22 Xiao Shao , Guoqiang Wu

We develop minimax optimal risk bounds for the general learning task consisting in predicting as well as the best function in a reference set G up to the smallest possible additive term, called the convergence rate. When the reference set…

Statistics Theory · Mathematics 2008-03-04 Jean-Yves Audibert

In this paper, we study the detection boundary for minimax hypothesis testing in the context of high-dimensional, sparse binary regression models. Motivated by genetic sequencing association studies for rare variant effects, we investigate…

Statistics Theory · Mathematics 2015-03-06 Rajarshi Mukherjee , Natesh S. Pillai , Xihong Lin

We study a tight Bennett-type concentration inequality for sums of heterogeneous and independent variables, defined as a one-dimensional minimization. We show that this refinement, which outperforms the standard known bounds, remains…

Optimization and Control · Mathematics 2022-11-23 Quentin Jacquet , Riadh Zorgati

This work investigates binary hypothesis testing between $H_0\sim P_0$ and $H_1\sim P_1$ in the finite-sample regime under asymmetric error constraints. By employing the ``reverse" R\'enyi divergence, we derive novel non-asymptotic bounds…

Information Theory · Computer Science 2026-01-21 Roberto Bruno , Adrien Vandenbroucque , Amedeo Roberto Esposito

This paper gives upper and lower bounds on the minimum error probability of Bayesian $M$-ary hypothesis testing in terms of the Arimoto-R\'enyi conditional entropy of an arbitrary order $\alpha$. The improved tightness of these bounds over…

Information Theory · Computer Science 2017-12-06 Igal Sason , Sergio Verdú

We develop minimax optimal risk bounds for the general learning task consisting in predicting as well as the best function in a reference set $\mathcal{G}$ up to the smallest possible additive term, called the convergence rate. When the…

Statistics Theory · Mathematics 2009-09-09 Jean-Yves Audibert

We develop a unifying framework for information-theoretic lower bound in statistical estimation and interactive decision making. Classical lower bound techniques -- such as Fano's method, Le Cam's method, and Assouad's lemma -- are central…

Machine Learning · Computer Science 2024-12-10 Fan Chen , Dylan J. Foster , Yanjun Han , Jian Qian , Alexander Rakhlin , Yunbei Xu

Alternative exact expressions are derived for the minimum error probability of a hypothesis test discriminating among $M$ quantum states. The first expression corresponds to the error probability of a binary hypothesis test with certain…

Quantum Physics · Physics 2016-11-15 Gonzalo Vazquez-Vilar

We study adversarial binary hypothesis testing under memory constraints. The test is a time-invariant randomized finite state machine (FSM) with S states. Associated with each hypothesis is a set of distributions. Given the hypothesis, the…

Information Theory · Computer Science 2026-05-13 Malhar A. Managoli , Vinod M. Prabhakaran

A general lower bound is developed for the minimax risk when estimating an arbitrary functional. The bound is based on testing two composite hypotheses and is shown to be effective in estimating the nonsmooth functional…

Statistics Theory · Mathematics 2011-05-17 T. Tony Cai , Mark G. Low

In the study of the capacity problem for multiple access channels (MACs), a lower bound on the error probability obtained by Han plays a crucial role in the converse parts of several kinds of channel coding theorems in the…

Information Theory · Computer Science 2016-01-20 Takuya Kubo , Hiroshi Nagaoka

We propose a novel technique for analyzing adaptive sampling called the {\em Simulator}. Our approach differs from the existing methods by considering not how much information could be gathered by any fixed sampling strategy, but how…

Machine Learning · Computer Science 2023-04-25 Max Simchowitz , Kevin Jamieson , Benjamin Recht

This paper focuses on parameter estimation and introduces a new method for lower bounding the Bayesian risk. The method allows for the use of virtually \emph{any} information measure, including R\'enyi's $\alpha$, $\varphi$-Divergences, and…

Information Theory · Computer Science 2023-03-27 Amedeo Roberto Esposito , Adrien Vandenbroucque , Michael Gastpar

In this paper, two new classes of lower bounds on the probability of error for $m$-ary hypothesis testing are proposed. Computation of the minimum probability of error which is attained by the maximum a-posteriori probability (MAP)…

Information Theory · Computer Science 2015-03-17 Tirza Routtenberg , Joseph Tabrikian