English
Related papers

Related papers: Minimax rate of testing in sparse linear regressio…

200 papers

Scaled sparse linear regression jointly estimates the regression coefficients and noise level in a linear model. It chooses an equilibrium with a sparse regression method by iteratively estimating the noise level via the mean residual…

Machine Learning · Statistics 2012-06-22 Tingni Sun , Cun-Hui Zhang

We study nonasymptotic minimax estimation of the linear functional $L(\theta)=\eta^\top \theta$ for a high-dimensional $s$-sparse mean vector with an arbitrary loading vector $\eta$. For symmetric noise with exponentially decaying tails, we…

Statistics Theory · Mathematics 2026-04-29 Jie Xie , Dongming Huang

In this paper we present a linear programming solution for sign pattern recovery of a sparse signal from noisy random projections of the signal. We consider two types of noise models, input noise, where noise enters before the random…

Information Theory · Computer Science 2015-03-13 V. Saligrama , M. Zhao

Large-scale regression problems where both the number of variables, $p$, and the number of observations, $n$, may be large and in the order of millions or more, are becoming increasingly more common. Typically the data are sparse: only a…

Statistics Theory · Mathematics 2018-02-27 Rajen D. Shah , Nicolai Meinshausen

We consider estimation of a sparse parameter vector that determines the covariance matrix of a Gaussian random vector via a sparse expansion into known "basis matrices". Using the theory of reproducing kernel Hilbert spaces, we derive lower…

Information Theory · Computer Science 2011-01-21 Alexander Jung , Sebastian Schmutzhard , Franz Hlawatsch , Alfred O. Hero

For data segmentation in high-dimensional linear regression settings, the regression parameters are often assumed to be sparse segment-wise, which enables many existing methods to estimate the parameters locally via $\ell_1$-regularised…

Methodology · Statistics 2026-05-08 Haeran Cho , Tobias Kley , Housen Li

In analyzing high-dimensional models, sparsity of the model parameter is a common but often undesirable assumption. In this paper, we study the following two-sample testing problem: given two samples generated by two high-dimensional linear…

Statistics Theory · Mathematics 2017-08-16 Yinchu Zhu , Jelena Bradic

We consider the high-dimensional linear regression model and assume that a fraction of the measurements are altered by an adversary with complete knowledge of the data and the underlying distribution. We are interested in a scenario where…

Statistics Theory · Mathematics 2023-12-11 Stanislav Minsker , Mohamed Ndaoud , Lang Wang

This note presents a unified analysis of the recovery of simple objects from random linear measurements. When the linear functionals are Gaussian, we show that an s-sparse vector in R^n can be efficiently recovered from 2s log n…

Information Theory · Computer Science 2012-03-01 Emmanuel Candes , Benjamin Recht

We consider the problem of comparing probability densities between two groups. A new probabilistic tensor product smoothing spline framework is developed to model the joint density of two variables. Under such a framework, the probability…

Methodology · Statistics 2021-01-13 Xin Xing , Zuofeng Shang , Pang Du , Ping Ma , Wenxuan Zhong , Jun S. Liu

We consider a matrix-valued Gaussian sequence model, that is, we observe a sequence of high-dimensional $M \times N$ matrices of heterogeneous Gaussian random variables $x_{ij,k}$ for $i \in\{1,...,M\}$, $j \in \{1,...,N\}$ and $k \in…

Statistics Theory · Mathematics 2013-01-22 Cristina Butucea , Ghislaine Gayraud

We investigate optimal subsampling for quantile regression. We derive the asymptotic distribution of a general subsampling estimator and then derive two versions of optimal subsampling probabilities. One version minimizes the trace of the…

Computation · Statistics 2020-01-29 HaiYing Wang , Yanyuan Ma

Estimation problems with constrained parameter spaces arise in various settings. In many of these problems, the observations available to the statistician can be modelled as arising from the noisy realization of the image of a random linear…

Statistics Theory · Mathematics 2023-03-23 Reese Pathak , Martin J. Wainwright , Lin Xiao

Motivated by multiple statistical hypothesis testing, we obtain the limit of likelihood ratio of large deviations for self-normalized random variables, specifically, the ratio of $P(\sqrt{n}(\bar X +d/n) \ge x_n V)$ to $P(\sqrt{n}\bar X \ge…

Statistics Theory · Mathematics 2008-01-30 Zhiyi Chi

We study the problem of detection of a high-dimensional signal function in the white Gaussian noise model. As well as a smoothness assumption on the signal function, we assume an additive sparse condition on the latter. The detection…

Statistics Theory · Mathematics 2012-07-24 Ghislaine Gayraud , Yuri Ingster

Compressed sensing is a new scheme which shows the ability to recover sparse signal from fewer measurements, using $l_1$ minimization. Recently, Chartrand and Staneva shown in \cite{CS1} that the $l_p$ minimization with $0<p<1$ recovers…

Functional Analysis · Mathematics 2011-03-02 Yi Shen , Song Li

We present a simple and effective algorithm for the problem of \emph{sparse robust linear regression}. In this problem, one would like to estimate a sparse vector $w^* \in \mathbb{R}^n$ from linear measurements corrupted by sparse noise…

Data Structures and Algorithms · Computer Science 2019-01-08 Sushrut Karmalkar , Eric Price

A tacit assumption in linear regression is that (response, predictor)-pairs correspond to identical observational units. A series of recent works have studied scenarios in which this assumption is violated under terms such as ``Unlabeled…

Machine Learning · Statistics 2020-06-30 Martin Slawski , Emanuel Ben-David , Ping Li

In this paper, we study random subsampling of Gaussian process regression, one of the simplest approximation baselines, from a theoretical perspective. Although subsampling discards a large part of training data, we show provable guarantees…

Machine Learning · Statistics 2019-01-29 Kohei Hayashi , Masaaki Imaizumi , Yuichi Yoshida

We study the following fundamental hypothesis testing problem, which we term Gaussian mean testing. Given i.i.d. samples from a distribution $p$ on $\mathbb{R}^d$, the task is to distinguish, with high probability, between the following…

Statistics Theory · Mathematics 2022-10-26 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia