中文
相关论文

相关论文: Support recovery and sup-norm convergence rates fo…

200 篇论文

In this paper, we propose new methods to efficiently solve convex optimization problems encountered in sparse estimation, which include a new quasi-Newton method that avoids computing the Hessian matrix and improves efficiency, and we prove…

最优化与控制 · 数学 2023-09-06 Ryosuke Shimmura , Joe Suzuki

Sparse linear regression is one of the classic problems in the field of statistics, which has deep connections and high intersections with optimization, computation, and machine learning. To address the effective handling of…

统计方法学 · 统计学 2025-08-04 Peili Li , Zhuomei Li , Yunhai Xiao , Chao Ying , Zhou Yu

Estimation problems with constrained parameter spaces arise in various settings. In many of these problems, the observations available to the statistician can be modelled as arising from the noisy realization of the image of a random linear…

统计理论 · 数学 2023-03-23 Reese Pathak , Martin J. Wainwright , Lin Xiao

In this paper, we consider a compressed sensing problem of reconstructing a sparse signal from an undersampled set of noisy linear measurements. The regularized least squares or least absolute shrinkage and selection operator (LASSO)…

信息论 · 计算机科学 2014-10-30 Chao-Kai Wen , Jun Zhang , Kai-Kit Wong , Jung-Chieh Chen , Chau Yuen

Conventional algorithms for sparse signal recovery and sparse representation rely on $l_1$-norm regularized variational methods. However, when applied to the reconstruction of $\textit{sparse images}$, i.e., images where only a few pixels…

计算机视觉与模式识别 · 计算机科学 2016-05-09 Sohil Shah , Tom Goldstein , Christoph Studer

We study the estimation of the covariance matrix $\Sigma$ of a $p$-dimensional normal random vector based on $n$ independent observations corrupted by additive noise. Only a general nonparametric assumption is imposed on the distribution of…

统计理论 · 数学 2018-03-28 Denis Belomestny , Mathias Trabs , Alexandre B. Tsybakov

The Lasso has become a benchmark data analysis procedure, and numerous variants have been proposed in the literature. Although the Lasso formulations are stated so that overall prediction error is optimized, no full control over the…

This paper proposes a Lasso-type estimator for a high-dimensional sparse parameter identified by a single index conditional moment restriction (CMR). In addition to this parameter, the moment function can also depend on a nuisance function,…

统计理论 · 数学 2021-09-14 Denis Nekipelov , Vira Semenova , Vasilis Syrgkanis

We show that two polynomial time methods, a Lasso estimator with adaptively chosen tuning parameter and a Slope estimator, adaptively achieve the exact minimax prediction and $\ell_2$ estimation rate $(s/n)\log (p/s)$ in high-dimensional…

统计理论 · 数学 2017-05-26 Pierre C. Bellec , Guillaume Lecué , Alexandre B. Tsybakov

We present a framework for smooth optimization of explicitly regularized objectives for (structured) sparsity. These non-smooth and possibly non-convex problems typically rely on solvers tailored to specific models and regularizers. In…

机器学习 · 计算机科学 2026-04-09 Chris Kolb , Christian L. Müller , Bernd Bischl , David Rügamer

We examine the rate of convergence of the Lasso estimator of lower dimensional components of the high-dimensional parameter. Under bounds on the $\ell_1$-norm on the worst possible sub-direction these rates are of order $\sqrt {|J| \log p /…

统计理论 · 数学 2014-03-28 Sara van de Geer

We consider estimation in a sparse additive regression model with the design points on a regular lattice. We establish the minimax convergence rates over Sobolev classes and propose a Fourier-based rate-optimal estimator which is adaptive…

统计理论 · 数学 2014-04-02 Felix Abramovich , Tal Lahav

In this paper, we establish explicit convergence rates for the stochastic smooth approximations of infimal convolutions introduced and developed in \cite{MR4581306,MR4923371}. In particular, we quantify the convergence of the associated…

最优化与控制 · 数学 2026-02-23 Diego Morales , Pedro Pérez-Aros , Emilio Vilches

The goal of this paper is to achieve a computational model and corresponding efficient algorithm for obtaining a sparse representation of the fitting surface to the given scattered data. The basic idea of the model is to utilize the…

数值分析 · 数学 2017-04-27 Yong-Xia Hao , Chong-Jun Li , Ren-Hong Wang

This paper is concerned with noisy matrix completion--the problem of recovering a low-rank matrix from partial and noisy entries. Under uniform sampling and incoherence assumptions, we prove that a tuning-free square-root matrix completion…

统计理论 · 数学 2024-02-13 Yuepeng Yang , Cong Ma

In this paper we discuss the variable selection method from \ell0-norm constrained regression, which is equivalent to the problem of finding the best subset of a fixed size. Our study focuses on two aspects, consistency and computation. We…

统计方法学 · 统计学 2013-03-20 Shifeng Xiong

We consider the problem of non-parametric regression with a potentially large number of covariates. We propose a convex, penalized estimation framework that is particularly well-suited for high-dimensional sparse additive models. The…

统计方法学 · 统计学 2019-06-19 Asad Haris , Ali Shojaie , Noah Simon

We consider support recovery in the quadratic logistic regression setting - where the target depends on both p linear terms $x_i$ and up to $p^2$ quadratic terms $x_i x_j$. Quadratic terms enable prediction/modeling of higher-order effects…

机器学习 · 统计学 2017-03-09 Karthikeyan Shanmugam , Murat Kocaoglu , Alexandros G. Dimakis , Sujay Sanghavi

We study a sample complexity vs. conditioning tradeoff in modern signal recovery problems (including sparse recovery, low-rank matrix sensing, covariance estimation, and abstract phase retrieval), where convex optimization problems are…

最优化与控制 · 数学 2024-07-19 Lijun Ding , Alex L. Wang

Recovering the support of sparse vectors in underdetermined linear regression models, \textit{aka}, compressive sensing is important in many signal processing applications. High SNR consistency (HSC), i.e., the ability of a support recovery…

信号处理 · 电气工程与系统科学 2018-11-20 Sreejith Kallummil , Sheetal Kalyani