English
Related papers

Related papers: A Unified Framework for Constructing Nonconvex Reg…

200 papers

We solve the problem of sparse signal deconvolution in the context of seismic reflectivity inversion, which pertains to high-resolution recovery of the subsurface reflection coefficients. Our formulation employs a nonuniform, non-convex…

We consider the problem of recovering elements of a low-dimensional model from under-determined linear measurements. To perform recovery, we consider the minimization of a convex regularizer subject to a data fit constraint. Given a model,…

Signal Processing · Electrical Eng. & Systems 2024-04-22 Yann Traonmilin , Rémi Gribonval , Samuel Vaiter

In this paper we present a general convex optimization approach for solving high-dimensional multiple response tensor regression problems under low-dimensional structural assumptions. We consider using convex and weakly decomposable…

Statistics Theory · Mathematics 2017-04-17 Garvesh Raskutti , Ming Yuan , Han Chen

Regularization is a central tool for addressing ill-posedness in inverse problems and statistical estimation, with the choice of a suitable penalty often determining the reliability and interpretability of downstream solutions. While recent…

Optimization and Control · Mathematics 2025-10-07 Oscar Leong , Eliza O'Reilly , Yong Sheng Soh

The 1-norm was proven to be a good convex regularizer for the recovery of sparse vectors from under-determined linear measurements. It has been shown that with an appropriate measurement operator, a number of measurements of the order of…

Information Theory · Computer Science 2018-12-05 Yann Traonmilin , Samuel Vaiter

This article proposes diffusion LMS strategies for distributed estimation over adaptive networks that are able to exploit sparsity in the underlying system model. The approach relies on convex regularization, common in compressive sensing,…

Machine Learning · Computer Science 2015-06-05 Paolo Di Lorenzo , Ali H. Sayed

We study the problem of reconstructing a block-sparse signal from compressively sampled measurements. In certain applications, in addition to the inherent block-sparse structure of the signal, some prior information about the block support,…

Information Theory · Computer Science 2019-02-25 Sajad Daei , Farzan Haddadi , Arash Amini

This paper proposes a general framework to estimate coefficients of generalized polynomial chaos (gPC) used in uncertainty quantification via rotational sparse approximation. In particular, we aim to identify a rotation matrix such that the…

Computation · Statistics 2021-09-20 Mengqi Hu , Yifei Lou , Xiu Yang

The 1-norm is a good convex regularization for the recovery of sparse vectors from under-determined linear measurements. No other convex regularization seems to surpass its sparse recovery performance. How can this be explained? To answer…

Information Theory · Computer Science 2018-06-25 Yann Traonmilin , Samuel Vaiter , Rémi Gribonval

The popular Lasso approach for sparse estimation can be derived via marginalization of a joint density associated with a particular stochastic model. A different marginalization of the same probabilistic model leads to a different…

Machine Learning · Statistics 2013-02-28 Aleksandr Y. Aravkin , James V. Burke , Alessandro Chiuso , Gianluigi Pillonetto

In this paper, we consider smooth convex optimization problems with simple constraints and inexactness in the oracle information such as value, partial or directional derivatives of the objective function. We introduce a unifying framework,…

Optimization and Control · Mathematics 2020-12-17 Pavel Dvurechensky , Alexander Gasnikov , Alexander Tiurin , Vladimir Zholobov

Novel sparse reconstruction algorithms are proposed for beamspace channel estimation in massive multiple-input multiple-output systems. The proposed algorithms minimize a least-squares objective having a nonconvex regularizer. This…

Information Theory · Computer Science 2021-12-02 Pengxia Wu , Julian Cheng

We consider a non-convex constrained Lagrangian formulation of a fundamental bi-criteria optimization problem for variable selection in statistical learning; the two criteria are a smooth (possibly) nonconvex loss function, measuring the…

Optimization and Control · Mathematics 2016-11-22 Ying Sun , Gesualdo Scutari

We consider the nonconvex regularized method for low-rank matrix recovery. Under the assumption on the singular values of the parameter matrix, we provide the recovery bound for any stationary point of the nonconvex method by virtue of…

Optimization and Control · Mathematics 2024-12-24 Xin Li , Dongya Wu

We introduce and study a mathematical framework for a broad class of regularization functionals for ill-posed inverse problems: Regularization Graphs. Regularization graphs allow to construct functionals using as building blocks linear…

Optimization and Control · Mathematics 2022-09-28 Kristian Bredies , Marcello Carioni , Martin Holler

This paper considers the problem of signal denoising using a sparse tight-frame analysis prior. The L1 norm has been extensively used as a regularizer to promote sparsity; however, it tends to under-estimate non-zero values of the…

Computer Vision and Pattern Recognition · Computer Science 2015-09-11 Ankit Parekh , Ivan W. Selesnick

Compared with digital methods, sparse recovery based on spiking neural networks has great advantages like high computational efficiency and low power-consumption. However, current spiking algorithms cannot guarantee more accurate estimates…

Signal Processing · Electrical Eng. & Systems 2020-09-22 Xiang Zhang , Lei Yu , Gang Zheng

Non-probabilistic convex model utilizes a convex set to quantify the uncertainty domain of uncertain-but-bounded parameters, which is very effective for structural uncertainty analysis with limited or poor-quality experimental data. To…

Other Statistics · Statistics 2018-01-18 Ni Bingyu , Jiang Chao , Huang Zhiliang

Regularization is a common tool in variational inverse problems to impose assumptions on the parameters of the problem. One such assumption is sparsity, which is commonly promoted using lasso and total variation-like regularization.…

Statistics Theory · Mathematics 2023-02-15 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

This paper proposes a precise signal recovery method with multilayered non-convex regularization, enhancing sparsity/low-rankness for high-dimensional signals including images and videos. In optimization-based signal recovery, multilayered…

Signal Processing · Electrical Eng. & Systems 2024-09-24 Akari Katsuma , Seisuke Kyochi , Shunsuke Ono , Ivan Selesnick