English
Related papers

Related papers: A projection proximal-point algorithm for l^1-mini…

200 papers

Motivated by vision tasks such as robust face and object recognition, we consider the following general problem: given a collection of low-dimensional linear subspaces in a high-dimensional ambient (image) space, and a query point (image),…

Computer Vision and Pattern Recognition · Computer Science 2014-12-16 Ju Sun , Yuqian Zhang , John Wright

We consider a regularized least squares problem, with regularization by structured sparsity-inducing norms, which extend the usual $\ell_1$ and the group lasso penalty, by allowing the subsets to overlap. Such regularizations lead to…

Optimization and Control · Mathematics 2012-09-04 Silvia Villa , Lorenzo Rosasco , Sofia Mosci , Alessandro Verri

The paper considers a split inverse problem involving component equilibrium problems in Hilbert spaces. This problem therefore is called the split equilibrium problem (SEP). It is known that almost solution methods for solving problem (SEP)…

Optimization and Control · Mathematics 2019-04-17 Dang Van Hieu

Convergence of a projected stochastic gradient algorithm is demonstrated for convex objective functionals with convex constraint sets in Hilbert spaces. In the convex case, the sequence of iterates ${u_n}$ converges weakly to a point in the…

Optimization and Control · Mathematics 2019-10-01 Caroline Geiersbach , Georg Pflug

We propose a new modified primal-dual proximal best approximation method for solving convex not necessarily differentiable optimization problems. The novelty of the method relies on introducing memory by taking into account iterates…

Optimization and Control · Mathematics 2018-04-18 Ewa M. Bednarczuk , Anna Jezierska , Krzysztof E. Rutkowski

A broad range of inverse problems can be abstracted into the problem of minimizing the sum of several convex functions in a Hilbert space. We propose a proximal decomposition algorithm for solving this problem with an arbitrary number of…

Optimization and Control · Mathematics 2009-11-13 Patrick L. Combettes , Jean-Christophe Pesquet

Box-constrained L1-minimization can perform remarkably better than classical L1-minimization when correction box constraints are available. And also many practical L1-minimization models indeed involve box constraints because they take…

Optimization and Control · Mathematics 2014-08-25 Hui Zhang , Lizhi Cheng

In this paper we analyze a class of nonconvex optimization problem from the viewpoint of abstract convexity. Using the respective generalizations of the subgradient we propose an abstract notion proximal operator and derive a number of…

Optimization and Control · Mathematics 2024-02-29 Ewa Bednarczuk , Dirk Lorenz , The Hung Tran

This paper is devoted to general nonconvex problems of multiobjective optimization in Hilbert spaces. Based on Mordukhovich's limiting subgradients, we define a new notion of Pareto critical points for such problems, establish necessary…

Optimization and Control · Mathematics 2024-03-18 G. C. Bento , J. X. Cruz Neto , J. O. Lopes , B. S. Mordukhovich , P. R. Silva Filho

This paper primarily focuses on computing the Euclidean projection of a vector onto the $\ell_{p}$ ball in which $p\in(0,1)$. Such a problem emerges as the core building block in statistical machine learning and signal processing tasks…

Optimization and Control · Mathematics 2024-10-28 Xiangyu Yang , Jiashan Wang , Hao Wang

We study three well-known minimization problems in Hilbert spaces: the weighted least squares problem and the related problems of abstract splines and smoothing. In each case we analyze the solvability of the problem for every point of the…

Functional Analysis · Mathematics 2019-10-23 Maximiliano Contino , Maria Eugenia Di Iorio y Lucero , Guillermina Fongi

Several optimization schemes have been known for convex optimization problems. However, numerical algorithms for solving nonconvex optimization problems are still underdeveloped. A progress to go beyond convexity was made by considering the…

Optimization and Control · Mathematics 2015-06-29 Nguyen Thai An , Nguyen Mau Nam

We consider the problem of maximizing a convex function over a closed convex set in a real Hilbert space. For linear functions, we show that a single orthogonal projection suffices to obtain an approximate solution. For continuous convex…

Optimization and Control · Mathematics 2026-02-23 Pedro Felzenszwalb , Heon Lee

We study the L1 minimization problem with additional box constraints. We motivate the problem with two different views of optimality considerations. We look into imposing such constraints in projected gradient techniques and propose a worst…

Data Structures and Algorithms · Computer Science 2010-10-04 Mithun Das Gupta , Sanjeev Kumar , Jing Xiao

In this paper we develop proximal methods for statistical learning. Proximal point algorithms are useful in statistics and machine learning for obtaining optimization solutions for composite functions. Our approach exploits closed-form…

Machine Learning · Statistics 2015-06-02 Nicholas G. Polson , James G. Scott , Brandon T. Willard

We consider a modification of the OMM energy functional which contains an $\ell^1$ penalty term in order to find a sparse representation of the low-lying eigenspace of self-adjoint operators. We analyze the local minima of the modified…

Numerical Analysis · Mathematics 2017-03-08 Jianfeng Lu , Kyle Thicke

In this paper we propose two proximal gradient algorithms for fractional programming problems in real Hilbert spaces, where the numerator is a proper, convex and lower semicontinuous function and the denominator is a smooth function, either…

Optimization and Control · Mathematics 2016-02-01 Radu Ioan Bot , Ernö Robert Csetnek

In this paper we present a variant of the proximal forward-backward splitting iteration for solving nonsmooth optimization problems in Hilbert spaces, when the objective function is the sum of two nondifferentiable convex functions. The…

Optimization and Control · Mathematics 2016-01-13 Jose Yunier Bello Cruz

Many iterative methods for solving optimization or feasibility problems have been invented, and often convergence of the iterates to some solution is proven. Under favourable conditions, one might have additional bounds on the distance of…

Optimization and Control · Mathematics 2020-04-14 Heinz H. Bauschke , Minh N. Dao , Dominikus Noll , Hung M. Phan

This paper proposes a two-point inertial proximal point algorithm to find zero of maximal monotone operators in Hilbert spaces. We obtain weak convergence results and non-asymptotic $O(1/n)$ convergence rate of our proposed algorithm in…

Optimization and Control · Mathematics 2022-07-21 Olaniyi S. Iyiola , Yekini Shehu