English
Related papers

Related papers: A framework to generate sparsity-inducing regulari…

200 papers

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

A reduced-rank framework with set-membership filtering (SMF) techniques is presented for adaptive beamforming problems encountered in radar systems. We develop and analyze stochastic gradient (SG) and recursive least squares (RLS)-type…

Information Theory · Computer Science 2013-02-05 L. Wang , R. C. de Lamare

We consider a class of $\ell_0$-regularized linear-quadratic (LQ) optimal control problems. This class of problems is obtained by augmenting a penalizing sparsity measure to the cost objective of the standard linear-quadratic regulator…

Optimization and Control · Mathematics 2015-07-31 MirSaleh Bahavarnia

We present a new, simple and computationally efficient iterative method for low rank matrix completion. Our method is inspired by the class of factorization-type iterative algorithms, but substantially differs from them in the way the…

Optimization and Control · Mathematics 2021-06-30 Jonathan Bauch , Boaz Nadler , Pini Zilber

The goal of this paper is to find a low-rank approximation for a given tensor. Specifically, we give a computable strategy on calculating the rank of a given tensor, based on approximating the solution to an NP-hard problem. In this paper,…

Numerical Analysis · Mathematics 2016-10-20 Xiaofei Wang , Carmeliza Navasca

Recently, convex formulations of low-rank matrix factorization problems have received considerable attention in machine learning. However, such formulations often require solving for a matrix of the size of the data matrix, making it…

Machine Learning · Computer Science 2017-08-29 Benjamin D. Haeffele , Rene Vidal

Nonconvex regularization has been popularly used in low-rank matrix learning. However, extending it for low-rank tensor learning is still computationally expensive. To address this problem, we develop an efficient solver for use with a…

Machine Learning · Computer Science 2022-05-09 Quanming Yao , Yaqing Wang , Bo Han , James Kwok

In this paper, we propose a successive convex approximation framework for sparse optimization where the nonsmooth regularization function in the objective function is nonconvex and it can be written as the difference of two convex…

Machine Learning · Computer Science 2018-10-26 Yang Yang , Marius Pesavento , Symeon Chatzinotas , Björn Ottersten

Given a limited number of entries from the superposition of a low-rank matrix plus the product of a known fat compression matrix times a sparse matrix, recovery of the low-rank and sparse components is a fundamental task subsuming…

Multiagent Systems · Computer Science 2013-10-01 Morteza Mardani , Gonzalo Mateos , Georgios B. Giannakis

In this article, we propose a novel regularization method for a class of nonlinear inverse problems that is inspired by an application in quantitative magnetic resonance imaging (qMRI). The latter is a special instance of a general…

Optimization and Control · Mathematics 2025-06-16 Guozhi Dong , Michael Hintermüller , Clemens Sirotenko

Our proposal is on a new stochastic optimizer for non-convex and possibly non-smooth objective functions typically defined over large dimensional design spaces. Towards this, we have tried to bridge noise-assisted global search and faster…

Machine Learning · Computer Science 2025-03-03 Uttam Suman , Mariya Mamajiwala , Mukul Saxena , Ankit Tyagi , Debasish Roy

We consider a class of learning problems regularized by a structured sparsity-inducing norm defined as the sum of l_2- or l_infinity-norms over groups of variables. Whereas much effort has been put in developing fast optimization techniques…

Optimization and Control · Mathematics 2011-10-17 Julien Mairal , Rodolphe Jenatton , Guillaume Obozinski , Francis Bach

One of the popular approaches for low-rank tensor completion is to use the latent trace norm regularization. However, most existing works in this direction learn a sparse combination of tensors. In this work, we fill this gap by proposing a…

Machine Learning · Computer Science 2018-11-13 Madhav Nimishakavi , Pratik Jawanpuria , Bamdev Mishra

In many statistical learning problems, it is desired that the optimal solution conforms to an a priori known sparsity structure represented by a directed acyclic graph. Inducing such structures by means of convex regularizers requires…

Optimization and Control · Mathematics 2020-10-20 Dewei Zhang , Yin Liu , Sam Davanloo Tajbakhsh

Trace norm regularization is a widely used approach for learning low rank matrices. A standard optimization strategy is based on formulating the problem as one of low rank matrix factorization which, however, leads to a non-convex problem.…

Machine Learning · Computer Science 2017-08-01 Carlo Ciliberto , Dimitris Stamos , Massimiliano Pontil

We propose an iterative algorithm for low-rank matrix completion that can be interpreted as both an iteratively reweighted least squares (IRLS) algorithm and a saddle-escaping smoothing Newton method applied to a non-convex rank surrogate…

Optimization and Control · Mathematics 2020-09-08 Christian Kümmerle , Claudio M. Verdun

We study the problem of finding structured low-rank matrices using nuclear norm regularization where the structure is encoded by a linear map. In contrast to most known approaches for linearly structured rank minimization, we do not (a) use…

Systems and Control · Computer Science 2015-09-09 Adams Wei Yu , Wanli Ma , Yaoliang Yu , Jaime G. Carbonell , Suvrit Sra

We propose a general method for optimization with semi-infinite constraints that involve a linear combination of functions, focusing on the case of the exponential function. Each function is lower and upper bounded on sub-intervals by…

Optimization and Control · Mathematics 2014-01-13 Bogdan Dumitrescu , Bogdan C. Sicleru , Florin Avram

In this paper, we propose a general framework that transforms the problems of designing sparse finite-impulseresponse linear equalizers and non-linear decision-feedback equalizers, for multiple antenna systems, into the problem of…

Information Theory · Computer Science 2018-03-06 Abubakr O. Al-Abbasi , Ridha Hamila , Waheed U. Bajwa , Naofal Al-Dhahir

Ill-posed linear inverse problems (ILIP), such as restoration and reconstruction, are a core topic of signal/image processing. A standard approach to deal with ILIP uses a constrained optimization problem, where a regularization function is…

Optimization and Control · Mathematics 2016-11-15 Manya V. Afonso , Jose M. Bioucas-Dias , Mario A. T. Figueiredo