中文
相关论文

相关论文: Minimax rate of testing in sparse linear regressio…

200 篇论文

In this paper, we consider a statistical problem of learning a linear model from noisy samples. Existing work has focused on approximating the least squares solution by using leverage-based scores as an importance sampling distribution.…

机器学习 · 统计学 2016-02-11 Siheng Chen , Rohan Varma , Aarti Singh , Jelena Kovačević

We determine the exact minimax rate of a Gaussian sequence model under bounded convex constraints, purely in terms of the local geometry of the given constraint set $K$. Our main result shows that the minimax risk (up to constant factors)…

统计理论 · 数学 2022-11-08 Matey Neykov

We study parameter estimation in linear Gaussian covariance models, which are $p$-dimensional Gaussian models with linear constraints on the covariance matrix. Maximum likelihood estimation for this class of models leads to a non-convex…

统计理论 · 数学 2016-04-19 Piotr Zwiernik , Caroline Uhler , Donald Richards

Extending the results of Bellec, Lecu\'e and Tsybakov to the setting of sparse high-dimensional linear regression with unknown variance, we show that two estimators, the Square-Root Lasso and the Square-Root Slope can achieve the optimal…

统计理论 · 数学 2017-12-12 Alexis Derumigny

Given a linear system in a real or complex domain, linear regression aims to recover the model parameters from a set of observations. Recent studies in compressive sensing have successfully shown that under certain conditions, a linear…

统计理论 · 数学 2016-11-15 Henrik Ohlsson , Allen Y. Yang , Roy Dong , S. Shankar Sastry

Linear Least Squares is a very well known technique for parameter estimation, which is used even when sub-optimal, because of its very low computational requirements and the fact that exact knowledge of the noise statistics is not required.…

统计理论 · 数学 2018-10-16 Michael Krikheli , Amir Leshem

The problem tackled in this paper is the determination of sample size for a given level and power in the context of a simple linear regression model. At a technical level, the simple linear regression model is a five-parameter model. It is…

统计方法学 · 统计学 2019-07-25 Tianyuan Guan , M. Khorshed Alam , M. Bhaskara Rao

We consider composite-composite testing problems for the expectation in the Gaussian sequence model where the null hypothesis corresponds to a convex subset $\mathcal{C}$ of $\mathbb{R}^d$. We adopt a minimax point of view and our primary…

统计理论 · 数学 2018-08-24 Gilles Blanchard , Alexandra Carpentier , Maurilio Gutzeit

This paper provides an alternative to penalized estimators for estimation and vari- able selection in high dimensional linear regression models with measurement error or missing covariates. We propose estimation via bias corrected least…

统计方法学 · 统计学 2016-05-11 Abhishek Kaul , Hira L. Koul , Akshita Chawla , Soumendra N. Lahiri

The main contribution of this paper is a mathematical definition of statistical sparsity, which is expressed as a limiting property of a sequence of probability distributions. The limit is characterized by an exceedance measure~$H$ and a…

统计方法学 · 统计学 2018-05-24 Peter McCullagh , Nicholas Polson

We investigate minimax testing for detecting local signals or linear combinations of such signals when only indirect data is available. Naturally, in the presence of noise, signals that are too small cannot be reliably detected. In a…

统计理论 · 数学 2023-02-21 Markus Pohlmann , Frank Werner , Axel Munk

We study computational-statistical gaps for improper learning in sparse linear regression. More specifically, given $n$ samples from a $k$-sparse linear model in dimension $d$, we ask what is the minimum sample complexity to efficiently (in…

机器学习 · 计算机科学 2024-06-26 Rares-Darius Buhai , Jingqiu Ding , Stefan Tiegel

In this paper, we show that, under the assumption that $\|\e\|_2\leq \epsilon$, every $k-$sparse signal $\x\in \mathbb{R}^n$ can be stably ($\epsilon\neq0$) or exactly recovered ($\epsilon=0$) from $\y=\A\x+\e$ via $l_p-$mnimization with…

信息论 · 计算机科学 2014-06-18 Jinming Wen , Dongfang Li , Fumin Zhu

Assume that we observe a sample of size n composed of p-dimensional signals, each signal having independent entries drawn from a scaled Poisson distribution with an unknown intensity. We are interested in estimating the sum of the n unknown…

统计理论 · 数学 2018-01-19 Olivier Collier , Arnak Dalalyan

This work is concern with testing the low-dimensional parameters of interest with divergent dimensional data and variable selection for the rest under the sparse case. A consistent test via the partial penalized likelihood approach, called…

统计方法学 · 统计学 2014-11-20 Shanshan Wang , Hengjian Cui

The linear regression models are widely used statistical techniques in numerous practical applications. The standard regression model requires several assumptions about the regres- sors and the error term. The regression parameters are…

统计方法学 · 统计学 2016-10-23 P. Vellaisamy

We consider the observations of an unknown $s$-sparse vector ${\boldsymbol \theta}$ corrupted by Gaussian noise with zero mean and unknown covariance matrix ${\boldsymbol \Sigma}$. We propose minimax optimal methods of estimating the…

统计理论 · 数学 2026-03-17 Yuhao Wang , Pengkun Yang , Alexandre B. Tsybakov

The effect of measurement errors in discriminant analysis is investigated. Given observations $Z=X+\epsilon$, where $\epsilon$ denotes a random noise, the goal is to predict the density of $X$ among two possible candidates $f$ and $g$. We…

统计理论 · 数学 2015-05-13 Sébastien Loustau , Clément Marteau

Sparse linear regression (SLR) is a well-studied problem in statistics where one is given a design matrix $X\in\mathbb{R}^{m\times n}$ and a response vector $y=X\theta^*+w$ for a $k$-sparse vector $\theta^*$ (that is, $\|\theta^*\|_0\leq…

机器学习 · 计算机科学 2025-02-06 Aparna Gupte , Neekon Vafa , Vinod Vaikuntanathan

Sparse additive models are an attractive choice in circumstances calling for modelling flexibility in the face of high dimensionality. We study the signal detection problem and establish the minimax separation rate for the detection of a…

统计理论 · 数学 2024-10-03 Subhodh Kotekal , Chao Gao