English
Related papers

Related papers: Extending Linear Convergence of the Proximal Point…

200 papers

An extension of the Gauss-Newton algorithm is proposed to find local minimizers of penalized nonlinear least squares problems, under generalized Lipschitz assumptions. Convergence results of local type are obtained, as well as an estimate…

Optimization and Control · Mathematics 2011-03-03 Saverio Salzo , Silvia Villa

In this article we consider a consistent convex feasibility problem in a real Hilbert space defined by a finite family of sets $C_i$. We are interested, in particular, in the case where for each $i$, $C_i=Fix (U_i)=\{z\in \mathcal H\mid…

Optimization and Control · Mathematics 2017-03-29 Victor I. Kolobov , Simeon Reich , Rafał Zalas

In this paper, we study the convergence properties of a randomized block-coordinate descent algorithm for the minimization of a composite convex objective function, where the block-coordinates are updated asynchronously and randomly…

Optimization and Control · Mathematics 2023-04-14 Cheik Traoré , Saverio Salzo , Silvia Villa

In this paper, we provide a simple convergence analysis of proximal gradient algorithm with Bregman distance, which provides a tighter bound than existing result. In particular, for the problem of minimizing a class of convex objective…

Optimization and Control · Mathematics 2017-12-19 Yi Zhou , Yingbin Liang , Lixin Shen

In this paper, we introduce various mechanisms to obtain accelerated first-order stochastic optimization algorithms when the objective function is convex or strongly convex. Specifically, we extend the Catalyst approach originally designed…

Optimization and Control · Mathematics 2019-10-10 Andrei Kulunchakov , Julien Mairal

This paper investigates a general class of problems in which a lower bounded smooth convex function incorporating $\ell_{0}$ and $\ell_{2,0}$ regularization is minimized over a box constraint. Although such problems arise frequently in…

Optimization and Control · Mathematics 2025-11-26 Yuge Ye , Qingna Li

We investigate the convergence properties of exact and inexact forward-backward algorithms to minimise the sum of two weakly convex functions defined on a Hilbert space, where one has a Lipschitz-continuous gradient. We show that the exact…

Optimization and Control · Mathematics 2024-06-24 Ewa Bednarczuk , Giovanni Bruccola , Gabriele Scrivanti , The Hung Tran

Perspective functions arise explicitly or implicitly in various forms in applied mathematics and in statistical data analysis. To date, no systematic strategy is available to solve the associated, typically nonsmooth, optimization problems.…

Optimization and Control · Mathematics 2016-12-15 Patrick L. Combettes , Christian L. Müller

We consider the problem of finding the minimization of the sum of a convex function and the composition of another convex function with a continuous linear operator from the view of fixed point algorithms based on proximity operators. We…

Optimization and Control · Mathematics 2016-04-19 Meng Wen , Shigang Yue , Yuchao Tang , Jigen Peng

In this article we use techniques of proof mining to analyse a result, due to Yonghong Yao and Muhammad Aslam Noor, concerning the strong convergence of a generalized proximal point algorithm which involves multiple parameters. Yao and…

Logic · Mathematics 2021-01-13 Bruno Dinis , Pedro Pinto

In this paper, we focus on solving a class of constrained non-convex non-concave saddle point problems in a decentralized manner by a group of nodes in a network. Specifically, we assume that each node has access to a summand of a global…

Optimization and Control · Mathematics 2019-11-01 Weijie Liu , Aryan Mokhtari , Asuman Ozdaglar , Sarath Pattathil , Zebang Shen , Nenggan Zheng

In this note, we provide convergence results for the proximal point algorithm and a splitting variant thereof in the setting of CAT$(\kappa)$ spaces with $\kappa > 0$ using a recent definition for the resolvent of a convex, lower…

Optimization and Control · Mathematics 2016-12-05 Rafa Espínola , Adriana Nicolae

We propose a proximal algorithm for minimizing objective functions consisting of three summands: the composition of a nonsmooth function with a linear operator, another nonsmooth function, each of the nonsmooth summands depending on an…

Optimization and Control · Mathematics 2020-08-03 Radu Ioan Bot , Ernö Robert Csetnek , Dang-Khoa Nguyen

In this paper, an inexact proximal-point penalty method is studied for constrained optimization problems, where the objective function is non-convex, and the constraint functions can also be non-convex. The proposed method approximately…

Optimization and Control · Mathematics 2020-12-02 Qihang Lin , Runchao Ma , Yangyang Xu

This work investigates the convergence behavior of augmented Lagrangian methods (ALMs) when applied to convex optimization problems that may be infeasible. ALMs are a popular class of algorithms for solving constrained optimization…

Optimization and Control · Mathematics 2026-03-17 Roland Andrews , Justin Carpentier , Adrien Taylor

This paper investigates a category of constrained fractional optimization problems that emerge in various practical applications. The objective function for this category is characterized by the ratio of a numerator and denominator, both…

Optimization and Control · Mathematics 2026-05-28 Yizun Lin , Jian-Feng Cai , Zhao-Rong Lai , Cheng Li

We study the convergence rate of the proximal-gradient homotopy algorithm applied to norm-regularized linear least squares problems, for a general class of norms. The homotopy algorithm reduces the regularization parameter in a series of…

Optimization and Control · Mathematics 2016-09-28 Reza Eghbali , Maryam Fazel

We consider the problem of optimizing the sum of a smooth convex function and a non-smooth convex function using proximal-gradient methods, where an error is present in the calculation of the gradient of the smooth term or in the proximity…

Machine Learning · Computer Science 2011-12-02 Mark Schmidt , Nicolas Le Roux , Francis Bach

This Note is inspired by the recent paper by Djafary Rouhani and Moradi [J. Optim. Theory Appl. 172 (2017) 222-235], where a proximal point algorithm proposed by Boikanyo and Moro\c{s}anu [Optim. Lett. 7 (2013) 415-420] is discussed. We…

Optimization and Control · Mathematics 2017-03-14 Gheorghe Morosanu

We consider global efficiency of algorithms for minimizing a sum of a convex function and a composition of a Lipschitz convex function with a smooth map. The basic algorithm we rely on is the prox-linear method, which in each iteration…

Optimization and Control · Mathematics 2017-08-16 Dmitriy Drusvyatskiy , Courtney Paquette