中文
相关论文

相关论文: The Squared-Error of Generalized LASSO: A Precise …

200 篇论文

We study the estimation capacity of the generalized Lasso, i.e., least squares minimization combined with a (convex) structural constraint. While Lasso-type estimators were originally designed for noisy linear regression problems, it has…

统计理论 · 数学 2019-09-12 Martin Genzel , Gitta Kutyniok

This paper investigates the minimum mean square error (MMSE) estimation of x, given the observation y = Hx+n, when x and n are independent and Gaussian Mixture (GM) distributed. The introduction of GM distributions, represents a…

统计理论 · 数学 2011-08-18 John T. Flam , Saikat Chatterjee , Kimmo Kansanen , Torbjorn Ekman

This paper studies the minimum mean squared error (MMSE) of estimating $\mathbf{X} \in \mathbb{R}^d$ from the noisy observation $\mathbf{Y} \in \mathbb{R}^k$, under the assumption that the noise (i.e., $\mathbf{Y}|\mathbf{X}$) is a member…

信息论 · 计算机科学 2022-05-13 Ian Zieder , Alex Dytso , Martina Cardone

This paper proposes a highly accurate algorithm to estimate the signal-to-noise ratio (SNR) for a linear system from a single realization of the received signal. We assume that the linear system has a Gaussian matrix with one sided left…

信息论 · 计算机科学 2017-10-10 Mohamed A. Suliman , Ayed M. Alrashdi , Tarig Ballal , Tareq Y. Al-Naffouri

The least absolute shrinkage and selection operator (LASSO) is a popular technique for simultaneous estimation and model selection. There have been a lot of studies on the large sample asymptotic distributional properties of the LASSO…

统计理论 · 数学 2016-07-05 Rakshith Jagannath , Neelesh S Upadhye

We address the problem of estimating a random vector X from two sets of measurements Y and Z, such that the estimator is linear in Y. We show that the partially linear minimum mean squared error (PLMMSE) estimator does not require knowing…

信息论 · 计算机科学 2015-05-27 Tomer Michaeli , Daniel Sigalov , Yonina C. Eldar

The least-squares estimator has achieved considerable success in learning linear dynamical systems from a single trajectory of length $T$. While it attains an optimal error of $\mathcal{O}(1/\sqrt{T})$ under independent zero-mean noise, it…

最优化与控制 · 数学 2026-02-23 Jihun Kim , Javad Lavaei

We consider the problem of pointwise estimation of multi-dimensional signals $s$, from noisy observations $(y_\tau)$ on the regular grid $\bZd$. Our focus is on the adaptive estimation in the case when the signal can be well recovered using…

统计理论 · 数学 2008-09-05 Anatoli Juditsky , Arkadii S. Nemirovski

Broadband signal transmission over frequency-selective fading channel often requires accurate channel state information at receiver. One of the most attracting adaptive channel estimation methods is least mean square (LMS) algorithm.…

信息论 · 计算机科学 2013-04-16 Guan Gui , Abolfazl Mehbodniya , Fumiyuki Adachi

Consider the problem of estimating the mean of a Gaussian random vector when the mean vector is assumed to be in a given convex set. The most natural solution is to take the Euclidean projection of the data vector on to this convex set; in…

统计理论 · 数学 2014-11-21 Sourav Chatterjee

Suppose that we observe $y \in \mathbb{R}^f$ and $X \in \mathbb{R}^{f \times m}$ in the following errors-in-variables model: \begin{eqnarray*} y & = & X_0 \beta^* + \epsilon \\ X & = & X_0 + W \end{eqnarray*} where $X_0$ is a $f \times m$…

统计理论 · 数学 2015-12-21 Mark Rudelson , Shuheng Zhou

A continuous-time average consensus system is a linear dynamical system defined over a graph, where each node has its own state value that evolves according to a simultaneous linear differential equation. A node is allowed to interact with…

最优化与控制 · 数学 2023-03-31 Tadashi Wadayama , Ayano Nakai-Kasai

We consider the framework of penalized estimation where the penalty term is given by a real-valued polyhedral gauge, which encompasses methods such as LASSO, generalized LASSO, SLOPE, OSCAR, PACS and others. Each of these estimators is…

统计理论 · 数学 2025-11-11 Piotr Graczyk , Ulrike Schneider , Tomasz Skalski , Patrick Tardivel

We propose a pivotal method for estimating high-dimensional sparse linear regression models, where the overall number of regressors $p$ is large, possibly much larger than $n$, but only $s$ regressors are significant. The method is a…

统计方法学 · 统计学 2015-03-17 Alexandre Belloni , Victor Chernozhukov , Lie Wang

Usually, hearing impaired people use hearing aids which are implemented with speech enhancement algorithms. Estimation of speech and estimation of nose are the components in single channel speech enhancement system. The main objective of…

声音 · 计算机科学 2014-11-10 M. Ravichandra Kumar , B. Ravi Teja

This paper develops a new mathematical framework for denoising in blind two-dimensional (2D) super-resolution upon using the atomic norm. The framework denoises a signal that consists of a weighted sum of an unknown number of time-delayed…

信息论 · 计算机科学 2023-07-19 Mohamed A. Suliman , Wei Dai

It is well known that the minimum $\ell_2$-norm solution of the convex LASSO model, say $\mathbf{x}_{\star}$, is a continuous piecewise linear function of the regularization parameter $\lambda$, and its signed sparsity pattern is constant…

最优化与控制 · 数学 2024-11-13 Yi Zhang , Isao Yamada

We study a seemingly unexpected and relatively less understood overfitting aspect of a fundamental tool in sparse linear modeling - best subset selection, which minimizes the residual sum of squares subject to a constraint on the number of…

统计方法学 · 统计学 2022-01-11 Rahul Mazumder , Peter Radchenko , Antoine Dedieu

In this paper, we study the problem of signal estimation from noisy non-linear measurements when the unknown $n$-dimensional signal is in the range of an $L$-Lipschitz continuous generative model with bounded $k$-dimensional inputs. We make…

机器学习 · 统计学 2020-10-09 Zhaoqiang Liu , Jonathan Scarlett

Motivated by recent work on atomic norms in inverse problems, we propose a new approach to line spectral estimation that provides theoretical guarantees for the mean-squared-error (MSE) performance in the presence of noise and without…

信息论 · 计算机科学 2013-02-19 Badri Narayan Bhaskar , Gongguo Tang , Benjamin Recht