English
Related papers

Related papers: Inertial Bregman Proximal Gradient Algorithm For N…

200 papers

This work considers an Inertial version of Bregman Proximal Gradient algorithm (IBPG) for minimizing the sum of two single-valued functions in finite dimension. We suppose that one of the functions is proper, closed, and convex but…

Optimization and Control · Mathematics 2025-01-30 Jean-Jacques Godeme

In this paper, we propose the approximate Bregman proximal gradient algorithm (ABPG) for solving composite nonconvex optimization problems. ABPG employs a new distance that approximates the Bregman distance, making the subproblem of ABPG…

Optimization and Control · Mathematics 2024-11-25 Shota Takahashi , Akiko Takeda

Lipschitz continuity of the gradient mapping of a continuously differentiable function plays a crucial role in designing various optimization algorithms. However, many functions arising in practical applications such as low rank matrix…

Optimization and Control · Mathematics 2020-12-25 Mahesh Chandra Mukkamala , Jalal Fadili , Peter Ochs

We propose a variant of the approximate Bregman proximal gradient (ABPG) algorithm for minimizing the sum of a smooth nonconvex function and a nonsmooth convex function. ABPG is known to converge globally to a stationary point even when the…

Optimization and Control · Mathematics 2026-03-23 Kiwamu Fujiki , Shota Takahashi , Akiko Takeda

In this paper, we consider an accelerated method for solving nonconvex and nonsmooth minimization problems. We propose a Bregman Proximal Gradient algorithm with extrapolation(BPGe). This algorithm extends and accelerates the Bregman…

Optimization and Control · Mathematics 2019-04-26 Xiaoya Zhang , Roberto Barrio , M. Angeles Martinez , Hao Jiang , Lizhi Cheng

We propose a forward-backward proximal-type algorithm with inertial/memory effects for minimizing the sum of a nonsmooth function with a smooth one in the nonconvex setting. The sequence of iterates generated by the algorithm converges to a…

Optimization and Control · Mathematics 2014-10-03 Radu Ioan Bot , Ernö Robert Csetnek , Szilárd László

Stochastic gradient methods for minimizing nonconvex composite objective functions typically rely on the Lipschitz smoothness of the differentiable part, but this assumption fails in many important problem classes like quadratic inverse…

Optimization and Control · Mathematics 2025-01-22 Kuangyu Ding , Jingyang Li , Kim-Chuan Toh

We investigate the convergence of a forward-backward-forward proximal-type algorithm with inertial and memory effects when minimizing the sum of a nonsmooth function with a smooth one in the absence of convexity. The convergence is obtained…

Optimization and Control · Mathematics 2014-06-04 Radu Ioan Bot , Ernö Robert Csetnek

We propose BIBPA, a block inertial Bregman proximal algorithm for minimizing the sum of a block relatively smooth function (that is, relatively smooth concerning each block) and block separable nonsmooth nonconvex functions. We prove that…

Optimization and Control · Mathematics 2020-05-11 Masoud Ahookhosh , Le Thi Khanh Hien , Nicolas Gillis , Panagiotis Patrinos

In this paper, we study an algorithm for solving a class of nonconvex and nonsmooth nonseparable optimization problems. Based on proximal alternating linearized minimization (PALM), we propose a new iterative algorithm which combines…

Optimization and Control · Mathematics 2023-06-14 Chenzheng Guo , Jing Zhao

In this paper, we propose a multi-step inertial Forward--Backward splitting algorithm for minimizing the sum of two non-necessarily convex functions, one of which is proper lower semi-continuous while the other is differentiable with a…

Optimization and Control · Mathematics 2016-10-28 Jingwei Liang , Jalal Fadili , Gabriel Peyré

We investigate an inertial algorithm of gradient type in connection with the minimization of a nonconvex differentiable function. The algorithm is formulated in the spirit of Nesterov's accelerated convex gradient method. We prove some…

Functional Analysis · Mathematics 2020-02-11 Szilárd Csaba László

In this paper, we explore a specific optimization problem that involves the combination of a differentiable nonconvex function and a nondifferentiable function. The differentiable component lacks a global Lipschitz continuous gradient,…

Optimization and Control · Mathematics 2024-01-05 Qingsong Wang , Zehui Liu , Chunfeng Cui , Deren Han

We investigate an inertial algorithm of gradient type in connection with the minimization of a nonconvex differentiable function. The algorithm is formulated in the spirit of Nesterov's accelerated convex gradient method. We show that the…

Functional Analysis · Mathematics 2018-11-26 Szilárd Csaba László

In this paper, we introduce an inertial version of the Proximal Incremental Aggregated Gradient method (PIAG) for minimizing the sum of smooth convex component functions and a possibly nonsmooth convex regularization function.…

Optimization and Control · Mathematics 2017-12-19 Xiaoya Zhang , Wei Peng , Hui Zhang , Wei Zhu

We investigate stochastic Bregman proximal gradient (SBPG) methods for minimizing a finite-sum nonconvex function $\Psi(x):=\frac{1}{n}\sum_{i=1}^nf_i(x)+\phi(x)$, where $\phi$ is convex and nonsmooth, while $f_i$, instead of gradient…

Optimization and Control · Mathematics 2025-09-23 Junyu Zhang

In this paper, we consider a class of structured nonconvex nonsmooth optimization problems, in which the objective function is formed by the sum of a possibly nonsmooth nonconvex function and a differentiable function whose gradient is…

Optimization and Control · Mathematics 2024-10-01 Tan Nhat Pham , Minh N. Dao , Rakibuzzaman Shah , Nargiz Sultanova , Guoyin Li , Syed Islam

The Bregman proximal gradient method (BPGM), which uses the Bregman distance as a proximity measure in the iterative scheme, has recently been re-developed for minimizing convex composite problems without the global Lipschitz gradient…

Optimization and Control · Mathematics 2025-04-16 Lei Yang , Kim-Chuan Toh

In this paper, we propose some accelerated methods for solving optimization problems under the condition of relatively smooth and relatively Lipschitz continuous functions with an inexact oracle. We consider the problem of minimizing the…

Optimization and Control · Mathematics 2024-11-27 O. S. Savchuk , M. S. Alkousa , A. S. Shushko , A. A. Vyguzov , F. S. Stonyakin , D. A. Pasechnyuk , A. V. Gasnikov

We propose a unifying algorithm for non-smooth non-convex optimization. The algorithm approximates the objective function by a convex model function and finds an approximate (Bregman) proximal point of the convex model. This approximate…

Optimization and Control · Mathematics 2018-06-27 Peter Ochs , Jalal Fadili , Thomas Brox
‹ Prev 1 2 3 10 Next ›