English
Related papers

Related papers: Minimax fast rates for discriminant analysis with …

200 papers

Suppose that a random variable $X$ of interest is observed. This paper concerns "the least favorable noise" $\hat{Y}_{\epsilon}$, which maximizes the prediction error $E [X - E[X|X+Y]]^2 $ (or minimizes the variance of $E[X| X+Y]$) in the…

Statistics Theory · Mathematics 2023-03-17 Dongzhou Huang

In many signal detection and classification problems, we have knowledge of the distribution under each hypothesis, but not the prior probabilities. This paper is aimed at providing theory to quantify the performance of detection via…

Information Theory · Computer Science 2016-11-17 Jiantao Jiao , Lin Zhang , Robert Nowak

Recent results have proven the minimax optimality of LASSO and related algorithms for noisy linear regression. However, these results tend to rely on variance estimators that are inefficient or optimizations that are slower than LASSO…

Statistics Theory · Mathematics 2019-03-18 Christopher Kennedy , Rachel Ward

This paper presents minimax rates for density estimation when the data dimension $d$ is allowed to grow with the number of observations $n$ rather than remaining fixed as in previous analyses. We prove a non-asymptotic lower bound which…

Statistics Theory · Mathematics 2017-08-16 Daniel J. McDonald

Mitigating the disparate impact of statistical machine learning methods is crucial for ensuring fairness. While extensive research aims to reduce disparity, the effect of using a \emph{finite dataset} -- as opposed to the entire population…

Machine Learning · Statistics 2024-03-28 Xianli Zeng , Guang Cheng , Edgar Dobriban

We investigate high-dimensional sparse regression when both the noise and the design matrix exhibit heavy-tailed behavior. Standard algorithms typically fail in this regime, as heavy-tailed covariates distort the empirical risk geometry. We…

Methodology · Statistics 2026-01-12 Kaiyuan Zhou , Xiaoyu Zhang , Wenyang Zhang , Di Wang

We study the convergence rates of the EM algorithm for learning two-component mixed linear regression under all regimes of signal-to-noise ratio (SNR). We resolve a long-standing question that many recent results have attempted to tackle:…

Machine Learning · Statistics 2021-02-08 Jeongyeol Kwon , Nhat Ho , Constantine Caramanis

The problem of simple $M-$ary hypothesis testing under a generic performance criterion that depends on arbitrary functions of error probabilities is considered. Using results from convex analysis, it is proved that an optimal decision rule…

Signal Processing · Electrical Eng. & Systems 2019-07-26 Berkan Dulek , Cuneyd Ozturk , Sinan Gezici

In the pivotal variable selection problem, we derive the exact non-asymptotic minimax selector over the class of all $s$-sparse vectors, which is also the Bayes selector with respect to the uniform prior. While this optimal selector is, in…

Statistics Theory · Mathematics 2022-01-03 Cristina Butucea , Enno Mammen , Mohamed Ndaoud , Alexandre B. Tsybakov

Reliability of machine learning evaluation -- the consistency of observed evaluation scores across replicated model training runs -- is affected by several sources of nondeterminism which can be regarded as measurement noise. Current…

Machine Learning · Computer Science 2023-10-10 Michael Hagmann , Philipp Meier , Stefan Riezler

The goal of ordinal embedding is to represent items as points in a low-dimensional Euclidean space given a set of constraints in the form of distance comparisons like "item $i$ is closer to item $j$ than item $k$". Ordinal constraints like…

Machine Learning · Statistics 2016-06-24 Lalit Jain , Kevin Jamieson , Robert Nowak

The classical problem of quickest change detection is studied with an additional constraint on the cost of observations used in the detection process. The change point is modeled as an unknown constant, and minimax formulations are proposed…

Statistics Theory · Mathematics 2012-11-19 Taposh Banerjee , Venugopal V. Veeravalli

Several approximate inference algorithms have been proposed to minimize an alpha-divergence between an approximating distribution and a target distribution. Many of these algorithms introduce bias, the magnitude of which becomes problematic…

Machine Learning · Statistics 2021-10-27 Tomas Geffner , Justin Domke

We study distributed estimation of a Gaussian mean under communication constraints in a decision theoretical framework. Minimax rates of convergence, which characterize the tradeoff between the communication costs and statistical accuracy,…

Statistics Theory · Mathematics 2020-02-11 T. Tony Cai , Hongji Wei

We study minimax testing in a statistical inverse problem when the associated operator is unknown. In particular, we consider observations from an inverse Gaussian regression model where the associated operator is unknown but contained in a…

Statistics Theory · Mathematics 2025-09-03 Clément Marteau , Theofanis Sapatinas

When training an estimator such as a neural network for tasks like image denoising, it is often preferred to train one estimator and apply it to all noise levels. The de facto training protocol to achieve this goal is to train the estimator…

Machine Learning · Computer Science 2020-07-20 Abhiram Gnansambandam , Stanley H. Chan

We consider exact asymptotics of the minimax risk for global testing against sparse alternatives in the context of high dimensional linear regression. Our results characterize the leading order behavior of this minimax risk in several…

Statistics Theory · Mathematics 2020-03-03 Rajarshi Mukherjee , Subhabrata Sen

We consider the nonparametric robust estimation problem for regression models in continuous time with semi-Markov noises. An adaptive model selection procedure is proposed. Under general moment conditions on the noise distribution a sharp…

Statistics Theory · Mathematics 2017-03-28 Vlad Barbu , Slim Beltaif , Serguei Pergamenchtchikov

In this work we study the semi-supervised framework of confidence set classification with controlled expected size in minimax settings. We obtain semi-supervised minimax rates of convergence under the margin assumption and a H{\"o}lder…

Statistics Theory · Mathematics 2019-04-30 Evgenii Chzhen , Christophe Denis , Mohamed Hebiri

The article is devoted to the problem of small learning samples in machine learning. The flaws of maximum likelihood learning and minimax learning are looked into and the concept of minimax deviation learning is introduced that is free of…

Machine Learning · Computer Science 2017-07-18 Michail Schlesinger , Evgeniy Vodolazskiy