English
Related papers

Related papers: Homotopy based algorithms for $\ell_0$-regularized…

200 papers

Sparse signal recovery deals with finding the sparsest solution of an under-determined linear system $\vx = \mQ\vs$. In this paper, we propose a novel greedy approach to addressing the challenges from such a problem. Such an approach is…

Information Theory · Computer Science 2026-04-09 Gang Li , Qiuwei Li , Shuang Li , Wu Angela Li

We establish an equivalence between the $\ell_2$-regularized solution path for a convex loss function, and the solution of an ordinary differentiable equation (ODE). Importantly, this equivalence reveals that the solution path can be viewed…

Machine Learning · Statistics 2021-07-08 Yunzhang Zhu , Renxiong Liu

Homotopy optimization is a traditional method to deal with a complicated optimization problem by solving a sequence of easy-to-hard surrogate subproblems. However, this method can be very sensitive to the continuation schedule design and…

Machine Learning · Computer Science 2023-07-25 Xi Lin , Zhiyuan Yang , Xiaoyuan Zhang , Qingfu Zhang

This paper seeks to bridge the two major algorithmic approaches to sparse signal recovery from an incomplete set of linear measurements -- L_1-minimization methods and iterative methods (Matching Pursuits). We find a simple regularized…

Numerical Analysis · Mathematics 2008-03-15 Deanna Needell , Roman Vershynin

The $\ell_{1\text{-}2}$ regularization method has a strong sparsity promoting capability in approaching sparse solutions of linear inverse problems and gained successful applications in various mathematics and applied science fields. This…

Optimization and Control · Mathematics 2026-03-04 Yaohua Hu , Hao Wang , Xiaoqi Yang

In this paper, we present a novel yet simple homotopy proximal mapping algorithm for compressive sensing. The algorithm adopts a simple proximal mapping of the $\ell_1$ norm at each iteration and gradually reduces the regularization…

Information Theory · Computer Science 2016-08-29 Tianbao Yang , Lijun Zhang , Rong Jin , Shenghuo Zhu , Zhi-Hua Zhou

In this paper, we consider the efficient and robust reconstruction of signals and images via $\ell_{1}-\alpha \ell_{2}~(0<\alpha\leq 1)$ minimization in impulsive noise case. To achieve this goal, we introduce two new models: the…

Optimization and Control · Mathematics 2018-10-15 Peng Li , Huanmin Ge , Wengu Chen

The sparse optimization problems arise in many areas of science and engineering, such as compressed sensing, image processing, statistical and machine learning. The $\ell_{0}$-minimization problem is one of such optimization problems, which…

Optimization and Control · Mathematics 2019-04-23 Jialiang Xu , Yun-Bin Zhao

An algorithmic framework, based on the difference of convex functions algorithm (DCA), is proposed for minimizing a class of concave sparse metrics for compressed sensing problems. The resulting algorithm iterates a sequence of $\ell_1$…

Information Theory · Computer Science 2016-11-02 Penghang Yin , Jack Xin

The theory behind compressive sampling pre-supposes that a given sequence of observations may be exactly represented by a linear combination of a small number of basis vectors. In practice, however, even small deviations from an exact…

Optimization and Control · Mathematics 2014-06-30 Jonathan M. Nichols , Albert K. Oh , Rebecca M. Willett

Many real world practical problems can be formulated as $\ell_{0}$-minimization problems with nonnegativity constraints, which seek the sparsest nonnegative signals to underdetermined linear systems. They have been widely applied in signal…

Optimization and Control · Mathematics 2017-08-29 Angang Cui , Haiyang Li , Meng Wen , Jigen Peng

In many application areas we are faced with the following question: Can we recover a sparse vector $x_o \in \mathbb{R}^N$ from its undersampled set of noisy observations $y \in \mathbb{R}^n$, $y=A x_o+w$. The last decade has witnessed a…

Information Theory · Computer Science 2016-06-14 Le Zheng , Arian Maleki , Haolei Weng , Xiaodong Wang , Teng Long

Constrained least squares regression is an essential tool for high-dimensional data analysis. Given a partition $\mathcal{G}$ of input variables, this paper considers a particular class of nonconvex constraint functions that encourage the…

Machine Learning · Statistics 2014-10-28 Fabian L. Wauthier , Peter Donnelly

We present a homotopic approach to solving challenging, optimization-based motion planning problems. The approach uses Homotopy Optimization, which, unlike standard continuation methods for solving homotopy problems, solves a sequence of…

Robotics · Computer Science 2024-08-23 Shayan Pardis , Matthew Chignoli , Sangbae Kim

This work deals with a regularization method enforcing solution sparsity of linear ill-posed problems by appropriate discretization in the image space. Namely, we formulate the so called least error method in an $\ell^1$ setting and perform…

Numerical Analysis · Mathematics 2016-08-03 Kristian Bredies , Barbara Kaltenbacher , Elena Resmerita

Recent studies of under-determined linear systems of equations with sparse solutions showed a great practical and theoretical efficiency of a particular technique called $\ell_1$-optimization. Seminal works \cite{CRT,DOnoho06CS} rigorously…

Information Theory · Computer Science 2013-06-18 Mihailo Stojnic

The reconstruction of sparse signals requires the solution of an $\ell_0$-norm minimization problem in Compressed Sensing. Previous research has focused on the investigation of a single candidate to identify the support (index of nonzero…

Information Theory · Computer Science 2017-01-12 Zhetao Li , Hongqing Zeng , Chengqing Li , Jun Fang

Sparse representation learning has recently gained a great success in signal and image processing, thanks to recent advances in dictionary learning. To this end, the $\ell_0$-norm is often used to control the sparsity level. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Yuan Liu , Stéphane Canu , Paul Honeine , Su Ruan

Homotopy methods have been widely utilized to solve low-thrust orbital transfer problems, however, it is not guaranteed that the optimal solution can be obtained by the existing homotopy methods. In this paper, a new homotopy method is…

Instrumentation and Methods for Astrophysics · Physics 2018-09-05 Binfeng Pan , Xun Pan , Siqi Zhang

In this paper, we consider an $\ell_{0}$-norm penalized formulation of the generalized eigenvalue problem (GEP), aimed at extracting the leading sparse generalized eigenvector of a matrix pair. The formulation involves maximization of a…

Machine Learning · Statistics 2015-06-22 Junxiao Song , Prabhu Babu , Daniel P. Palomar