中文
相关论文

相关论文: Minimax rate of testing in sparse linear regressio…

200 篇论文

Scaled sparse linear regression jointly estimates the regression coefficients and noise level in a linear model. It chooses an equilibrium with a sparse regression method by iteratively estimating the noise level via the mean residual…

机器学习 · 统计学 2012-06-22 Tingni Sun , Cun-Hui Zhang

We study nonasymptotic minimax estimation of the linear functional $L(\theta)=\eta^\top \theta$ for a high-dimensional $s$-sparse mean vector with an arbitrary loading vector $\eta$. For symmetric noise with exponentially decaying tails, we…

统计理论 · 数学 2026-04-29 Jie Xie , Dongming Huang

In this paper we present a linear programming solution for sign pattern recovery of a sparse signal from noisy random projections of the signal. We consider two types of noise models, input noise, where noise enters before the random…

信息论 · 计算机科学 2015-03-13 V. Saligrama , M. Zhao

Large-scale regression problems where both the number of variables, $p$, and the number of observations, $n$, may be large and in the order of millions or more, are becoming increasingly more common. Typically the data are sparse: only a…

统计理论 · 数学 2018-02-27 Rajen D. Shah , Nicolai Meinshausen

We consider estimation of a sparse parameter vector that determines the covariance matrix of a Gaussian random vector via a sparse expansion into known "basis matrices". Using the theory of reproducing kernel Hilbert spaces, we derive lower…

信息论 · 计算机科学 2011-01-21 Alexander Jung , Sebastian Schmutzhard , Franz Hlawatsch , Alfred O. Hero

For data segmentation in high-dimensional linear regression settings, the regression parameters are often assumed to be sparse segment-wise, which enables many existing methods to estimate the parameters locally via $\ell_1$-regularised…

统计方法学 · 统计学 2026-05-08 Haeran Cho , Tobias Kley , Housen Li

In analyzing high-dimensional models, sparsity of the model parameter is a common but often undesirable assumption. In this paper, we study the following two-sample testing problem: given two samples generated by two high-dimensional linear…

统计理论 · 数学 2017-08-16 Yinchu Zhu , Jelena Bradic

We consider the high-dimensional linear regression model and assume that a fraction of the measurements are altered by an adversary with complete knowledge of the data and the underlying distribution. We are interested in a scenario where…

统计理论 · 数学 2023-12-11 Stanislav Minsker , Mohamed Ndaoud , Lang Wang

This note presents a unified analysis of the recovery of simple objects from random linear measurements. When the linear functionals are Gaussian, we show that an s-sparse vector in R^n can be efficiently recovered from 2s log n…

信息论 · 计算机科学 2012-03-01 Emmanuel Candes , Benjamin Recht

We consider the problem of comparing probability densities between two groups. A new probabilistic tensor product smoothing spline framework is developed to model the joint density of two variables. Under such a framework, the probability…

统计方法学 · 统计学 2021-01-13 Xin Xing , Zuofeng Shang , Pang Du , Ping Ma , Wenxuan Zhong , Jun S. Liu

We consider a matrix-valued Gaussian sequence model, that is, we observe a sequence of high-dimensional $M \times N$ matrices of heterogeneous Gaussian random variables $x_{ij,k}$ for $i \in\{1,...,M\}$, $j \in \{1,...,N\}$ and $k \in…

统计理论 · 数学 2013-01-22 Cristina Butucea , Ghislaine Gayraud

We investigate optimal subsampling for quantile regression. We derive the asymptotic distribution of a general subsampling estimator and then derive two versions of optimal subsampling probabilities. One version minimizes the trace of the…

统计计算 · 统计学 2020-01-29 HaiYing Wang , Yanyuan Ma

Estimation problems with constrained parameter spaces arise in various settings. In many of these problems, the observations available to the statistician can be modelled as arising from the noisy realization of the image of a random linear…

统计理论 · 数学 2023-03-23 Reese Pathak , Martin J. Wainwright , Lin Xiao

Motivated by multiple statistical hypothesis testing, we obtain the limit of likelihood ratio of large deviations for self-normalized random variables, specifically, the ratio of $P(\sqrt{n}(\bar X +d/n) \ge x_n V)$ to $P(\sqrt{n}\bar X \ge…

统计理论 · 数学 2008-01-30 Zhiyi Chi

We study the problem of detection of a high-dimensional signal function in the white Gaussian noise model. As well as a smoothness assumption on the signal function, we assume an additive sparse condition on the latter. The detection…

统计理论 · 数学 2012-07-24 Ghislaine Gayraud , Yuri Ingster

Compressed sensing is a new scheme which shows the ability to recover sparse signal from fewer measurements, using $l_1$ minimization. Recently, Chartrand and Staneva shown in \cite{CS1} that the $l_p$ minimization with $0<p<1$ recovers…

泛函分析 · 数学 2011-03-02 Yi Shen , Song Li

We present a simple and effective algorithm for the problem of \emph{sparse robust linear regression}. In this problem, one would like to estimate a sparse vector $w^* \in \mathbb{R}^n$ from linear measurements corrupted by sparse noise…

数据结构与算法 · 计算机科学 2019-01-08 Sushrut Karmalkar , Eric Price

A tacit assumption in linear regression is that (response, predictor)-pairs correspond to identical observational units. A series of recent works have studied scenarios in which this assumption is violated under terms such as ``Unlabeled…

机器学习 · 统计学 2020-06-30 Martin Slawski , Emanuel Ben-David , Ping Li

In this paper, we study random subsampling of Gaussian process regression, one of the simplest approximation baselines, from a theoretical perspective. Although subsampling discards a large part of training data, we show provable guarantees…

机器学习 · 统计学 2019-01-29 Kohei Hayashi , Masaaki Imaizumi , Yuichi Yoshida

We study the following fundamental hypothesis testing problem, which we term Gaussian mean testing. Given i.i.d. samples from a distribution $p$ on $\mathbb{R}^d$, the task is to distinguish, with high probability, between the following…

统计理论 · 数学 2022-10-26 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia