English
Related papers

Related papers: Proximal Iteratively Reweighted Algorithm with Mul…

200 papers

Owing to their statistical properties, non-convex sparse regularizers have attracted much interest for estimating a sparse linear model from high dimensional data. Given that the solution is sparse, for accelerating convergence, a working…

Machine Learning · Computer Science 2021-10-22 Alain Rakotomamonjy , Rémi Flamary , Gilles Gasso , Joseph Salmon

The proximal gradient algorithm has been popularly used for convex optimization. Recently, it has also been extended for nonconvex problems, and the current state-of-the-art is the nonmonotone accelerated proximal gradient algorithm.…

Optimization and Control · Mathematics 2017-05-24 Quanming Yao , James T. Kwok , Fei Gao , Wei Chen , Tie-Yan Liu

We consider linear sparse recovery problems where additional structure regarding the support of the solution is known. The form of the structure considered is non-overlapping sets of indices that each contain part of the support. An…

Numerical Analysis · Mathematics 2021-10-05 Joseph S. Donato , Howard W. Levinson

We investigate implicit regularization schemes for gradient descent methods applied to unpenalized least squares regression to solve the problem of reconstructing a sparse signal from an underdetermined system of linear measurements under…

Machine Learning · Statistics 2019-09-12 Tomas Vaškevičius , Varun Kanade , Patrick Rebeschini

This technical note considers the identification of nonlinear discrete-time systems with additive process noise but without measurement noise. In particular, we propose a method and its associated algorithm to identify the system nonlinear…

Optimization and Control · Mathematics 2015-04-27 Wei Pan , Ye Yuan , Jorge Gonçalves , Guy-Bart Stan

The computational kernel in solving the $S_N$ transport equations is the parallel sweep, which corresponds to directly inverting a block lower triangular linear system that arises in discretizations of the linear transport equation.…

Computational Physics · Physics 2019-10-28 Joshua Hanophy , Ben S. Southworth , Ruipeng Li , Jim Morel , Tom Manteuffel

Near-field localization for ISAC requires large-aperture arrays, making fully-digital implementations prohibitively complex and costly. While sparse subarray architectures can reduce cost, they introduce severe estimation ambiguity from…

Signal Processing · Electrical Eng. & Systems 2026-01-30 Sai Pavan Deram , Jacopo Pegoraro , Javier Lorca Hernando , Jesus O. Lacruz , Joerg Widmer

We consider the energy minimization problem for undirected graphical models, also known as MAP-inference problem for Markov random fields which is NP-hard in general. We propose a novel polynomial time algorithm to obtain a part of its…

Artificial Intelligence · Computer Science 2015-08-19 Paul Swoboda , Alexander Shekhovtsov , Jörg Hendrik Kappes , Christoph Schnörr , Bogdan Savchynskyy

This work studies the problem of sparse signal recovery with automatic grouping of variables. To this end, we investigate sorted nonsmooth penalties as a regularization approach for generalized linear models. We focus on a family of sorted…

Optimization and Control · Mathematics 2025-06-19 Anne Gagneux , Mathurin Massias , Emmanuel Soubies

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply…

Optimization and Control · Mathematics 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Sparse coding and dictionary learning are popular techniques for linear inverse problems such as denoising or inpainting. However in many cases, the measurement process is nonlinear, for example for clipped, quantized or 1-bit measurements.…

Signal Processing · Electrical Eng. & Systems 2020-01-08 Lucas Rencker , Francis Bach , Wenwu Wang , Mark D. Plumbley

This work aims at solving the problems with intractable sparsity-inducing norms that are often encountered in various machine learning tasks, such as multi-task learning, subspace clustering, feature selection, robust principal component…

Machine Learning · Computer Science 2019-07-03 Feiping Nie , Zhanxuan Hu , Xiaoqian Wang , Rong Wang , Xuelong Li , Heng Huang

Multinomial Logistic Regression is a well-studied tool for classification and has been widely used in fields like image processing, computer vision and, bioinformatics, to name a few. Under a supervised classification scenario, a…

Machine Learning · Statistics 2020-02-24 R. Jyothi , P. Babu

A computationally efficient method to solve non-convex programming problems with linear equality constraints is presented. The proposed method is based on a recursively feasible and descending sequential convex programming procedure proven…

Optimization and Control · Mathematics 2018-10-25 Josep Virgili-Llop , Marcello Romano

We consider linear inverse problems where the solution is assumed to have a sparse expansion on an arbitrary pre-assigned orthonormal basis. We prove that replacing the usual quadratic regularizing penalties by weighted l^p-penalties on the…

Functional Analysis · Mathematics 2025-10-20 Ingrid Daubechies , Michel Defrise , Christine De Mol

Flexible sparsity regularization means stably approximating sparse solutions of operator equations by using coefficient-dependent penalizations. We propose and analyse a general nonconvex approach in this respect, from both theoretical and…

Optimization and Control · Mathematics 2021-11-12 Daria Ghilli , Dirk A. Lorenz , Elena Resmerita

Minimizing sum of two functions under a linear constraint is what we called splitting problem. This convex optimization has wide applications in machine learning problems, such as Lasso, Group Lasso and Sparse logistic regression. A recent…

Computation · Statistics 2017-11-20 Sen Na , Cho-Jui Hsieh

We propose a variable smoothing algorithm for solving nonconvexly constrained nonsmooth optimization problems. The target problem has two issues that need to be addressed: (i) the nonconvex constraint and (ii) the nonsmooth term. To handle…

Optimization and Control · Mathematics 2024-04-04 Keita Kume , Isao Yamada

Sparse channel estimation for massive multiple-input multiple-output systems has drawn much attention in recent years. The required pilots are substantially reduced when the sparse channel state vectors can be reconstructed from a few…

Information Theory · Computer Science 2021-02-17 Pengxia Wu , Hui Ma , Julian Cheng

With the availability of more powerful computers, iterative reconstruction algorithms are the subject of an ongoing work in the design of more efficient reconstruction algorithms for X-ray computed tomography. In this work, we show how two…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 D. Trinca , Y. Zhong