中文
相关论文

相关论文: Sparse recovery in convex hulls via entropy penali…

200 篇论文

We consider the problem of learning the underlying graph of a sparse Ising model with $p$ nodes from $n$ i.i.d. samples. The most recent and best performing approaches combine an empirical loss (the logistic regression loss or the…

机器学习 · 统计学 2021-09-17 Antoine Dedieu , Miguel Lázaro-Gredilla , Dileep George

This manuscript goes through the fundamental connections between statistical mechanics and estimation theory by focusing on the particular problem of compressive sensing. We first show that the asymptotic analysis of a sparse recovery…

信息论 · 计算机科学 2022-12-21 Ali Bereyhi , Ralf R. Müller , Hermann Schulz-Baldes

Recent research has studied the role of sparsity in high dimensional regression and signal reconstruction, establishing theoretical limits for recovering sparse models from sparse data. This line of work shows that $\ell_1$-regularized…

机器学习 · 统计学 2012-01-11 Shuheng Zhou , John Lafferty , Larry Wasserman

The recovery of unknown signals from quadratic measurements finds extensive applications in fields such as phase retrieval, power system state estimation, and unlabeled distance geometry. This paper investigates the finite sample properties…

统计理论 · 数学 2026-04-15 Jun Fan , Jingyu Yang , Xinyu Zhang , Liqun Wang

We consider the problem of recovering a partially sparse solution of an underdetermined system of linear equations by minimizing the $\ell_1$-norm of the part of the solution vector which is known to be sparse. Such a problem is closely…

信息论 · 计算机科学 2013-04-11 Afonso S. Bandeira , Katya Scheinberg , Luis Nunes Vicente

We propose a convex formulation of the fused lasso signal approximation problem consisting of non-convex penalty functions. The fused lasso signal model aims to estimate a sparse piecewise constant signal from a noisy observation.…

最优化与控制 · 数学 2015-12-08 Ankit Parekh , Ivan W. Selesnick

Signal estimation problems with smoothness and sparsity priors can be naturally modeled as quadratic optimization with $\ell_0$-"norm" constraints. Since such problems are non-convex and hard-to-solve, the standard approach is, instead, to…

机器学习 · 统计学 2020-10-20 Alper Atamturk , Andres Gomez , Shaoning Han

We consider a general class of constrained optimization problems with an additional $\ell_0$- sparsity term in the objective function. Based on a recent reformulation of this difficult $\ell_0$-term, we consider a nonsmooth penalty approach…

最优化与控制 · 数学 2025-09-04 Christian Kanzow , Felix Weiß

This paper studies the problem of recovering a non-negative sparse signal $\x \in \Re^n$ from highly corrupted linear measurements $\y = A\x + \e \in \Re^m$, where $\e$ is an unknown error vector whose nonzero entries may be unbounded.…

信息论 · 计算机科学 2008-09-02 John Wright , Yi Ma

Penalty functions or regularization terms that promote structured solutions to optimization problems are of great interest in many fields. Proposed in this work is a nonconvex structured sparsity penalty that promotes one-sparsity within…

最优化与控制 · 数学 2020-06-19 Charles Saunders , Vivek K Goyal

This work studies the problem of sparse signal recovery with automatic grouping of variables. To this end, we investigate sorted nonsmooth penalties as a regularization approach for generalized linear models. We focus on a family of sorted…

最优化与控制 · 数学 2025-06-19 Anne Gagneux , Mathurin Massias , Emmanuel Soubies

We study the problem of learning a sparse linear regression vector under additional conditions on the structure of its sparsity pattern. This problem is relevant in machine learning, statistics and signal processing. It is well known that a…

机器学习 · 统计学 2015-03-17 Charles A. Micchelli , Jean M. Morales , Massimiliano Pontil

In this paper, we propose an unifying view of several recently proposed structured sparsity-inducing norms. We consider the situation of a model simultaneously (a) penalized by a set- function de ned on the support of the unknown parameter…

机器学习 · 统计学 2012-05-08 Guillaume Obozinski , Francis Bach

Our work is focused on the joint sparsity recovery problem where the common sparsity pattern is corrupted by Poisson noise. We formulate the confidence-constrained optimization problem in both least squares (LS) and maximum likelihood (ML)…

机器学习 · 统计学 2013-10-10 E. Chunikhina , R. Raich , T. Nguyen

We consider a linear inverse problem whose solution is expressed as a sum of two components: one smooth and the other sparse. This problem is addressed by minimizing an objective function with a least squares data-fidelity term and a…

信号处理 · 电气工程与系统科学 2024-06-18 Adrian Jarret , Valérie Costa , Julien Fageot

Compressed sensing deals with the recovery of sparse signals from linear measurements. Without any additional information, it is possible to recover an $s$-sparse signal using $m \gtrsim s \log(d/s)$ measurements in a robust and stable way.…

泛函分析 · 数学 2016-05-25 Axel Flinth

In this paper we study nonconvex penalization using Bernstein functions whose first-order derivatives are completely monotone. The Bernstein function can induce a class of nonconvex penalty functions for high-dimensional sparse estimation…

机器学习 · 统计学 2015-10-30 Zhihua Zhang

In this paper, we analyze the generalization performance of the Iterative Hard Thresholding (IHT) algorithm widely used for sparse recovery problems. The parameter estimation and sparsity recovery consistency of IHT has long been known in…

机器学习 · 统计学 2022-03-18 Xiao-Tong Yuan , Ping Li

In this paper we continue to develop the following general approach. We study asymptotic behavior of the errors of sampling recovery not for an individual smoothness class, how it is usually done, but for the collection of classes, which…

数值分析 · 数学 2026-01-14 V. Temlyakov

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. While naturally cast as a combinatorial optimization problem, variable or feature selection admits a convex relaxation through the…

机器学习 · 计算机科学 2012-04-23 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski