English
Related papers

Related papers: Generalized Bregman Projection Algorithms for Solv…

200 papers

In this paper, we propose a random gradient-free method for optimization in infinite dimensional Hilbert spaces, applicable to functional optimization in diverse settings. Though such problems are often solved through finite-dimensional…

Optimization and Control · Mathematics 2025-12-25 Caio Lins Peixoto , Daniel Csillag , Bernardo F. P. da Costa , Yuri F. Saporito

We consider distributed optimization problems in which a group of agents are to collaboratively seek the global optimum through peer-to-peer communication networks. The problem arises in various application areas, such as resource…

Optimization and Control · Mathematics 2016-08-30 Jinming Xu , Shanying Zhu , Yeng Chai Soh , Lihua Xie

Sparse solution problems play an important role in both signal processing and image restoration. In this paper, we propose a stochastic column-block nonlinear Bregman method for efficiently computing sparse solutions to nonlinear systems.…

Numerical Analysis · Mathematics 2026-05-11 Wendi Bao , Naiyu Jiang , Lili Xing , Weiguo Li

We consider the problem of estimating the inverse covariance matrix by maximizing the likelihood function with a penalty added to encourage the sparsity of the resulting matrix. We propose a new approach based on the split Bregman method to…

Machine Learning · Statistics 2015-03-17 Gui-Bo Ye , Jian-Feng Cai , Xiaohui Xie

Minimizing sum of two functions under a linear constraint is what we called splitting problem. This convex optimization has wide applications in machine learning problems, such as Lasso, Group Lasso and Sparse logistic regression. A recent…

Computation · Statistics 2017-11-20 Sen Na , Cho-Jui Hsieh

Parallel and cyclic projection algorithms are proposed for minimizing the sum of a finite family of convex functions over the intersection of a finite family of closed convex subsets of a Hilbert space. These algorithms are of…

Optimization and Control · Mathematics 2019-01-08 Hong-Kun Xu , Vera Roshchina

In this paper, we explore a specific optimization problem that involves the combination of a differentiable nonconvex function and a nondifferentiable function. The differentiable component lacks a global Lipschitz continuous gradient,…

Optimization and Control · Mathematics 2024-01-05 Qingsong Wang , Zehui Liu , Chunfeng Cui , Deren Han

We prove global convergence of classical projection algorithms for feasibility problems involving union convex sets, which refer to sets expressible as the union of a finite number of closed convex sets. We present a unified strategy for…

Optimization and Control · Mathematics 2023-07-18 Jan Harold Alcantara , Ching-pei Lee

In this paper, we propose a catalog of iterative methods for solving the Split Feasibility Problem in the non-convex setting. We study four different optimization formulations of the problem, where each model has advantageous in different…

Optimization and Control · Mathematics 2020-10-12 Aviv Gibali , Shoham Sabach , Sergey Voldman

In this paper we present a variant of the proximal forward-backward splitting iteration for solving nonsmooth optimization problems in Hilbert spaces, when the objective function is the sum of two nondifferentiable convex functions. The…

Optimization and Control · Mathematics 2016-01-13 Jose Yunier Bello Cruz

In the literature, besides the assumption of strict complementarity, superlinear convergence of implementable polynomial-time interior point algorithms using known search directions, namely, the HKM direction, its dual or the NT direction,…

Optimization and Control · Mathematics 2024-08-22 Chee-Khian Sim

In this work, we introduce two algorithmic frameworks, named Bregman extragradient method and Bregman extrapolation method, for solving saddle point problems. The proposed frameworks not only include the well-known extragradient and…

Optimization and Control · Mathematics 2021-08-26 Hui Zhang

The split common fixed point problems has found its applications in various branches of mathematics both pure and applied. It provides us a unified structure to study a large number of nonlinear mappings. Our interest here is to apply these…

Functional Analysis · Mathematics 2017-04-18 A. Kilicman , L. B. Mohammed

In this paper, we analyze the iteration-complexity of Generalized Forward--Backward (GFB) splitting algorithm, as proposed in \cite{gfb2011}, for minimizing a large class of composite objectives $f + \sum_{i=1}^n h_i$ on a Hilbert space,…

Optimization and Control · Mathematics 2014-02-11 Jingwei Liang , Jalal M. Fadili , Gabriel Peyré

This paper provides a comprehensive study of the nonmonotone forward-backward splitting (FBS) method for solving a class of nonsmooth composite problems in Hilbert spaces. The objective function is the sum of a Fr\'echet differentiable (not…

Optimization and Control · Mathematics 2023-03-06 Behzad Azmi , Marco Bernreuther

We establish the convergence of the forward-backward splitting algorithm based on Bregman distances for the sum of two monotone operators in reflexive Banach spaces. Even in Euclidean spaces, the convergence of this algorithm has so far…

Optimization and Control · Mathematics 2020-09-29 Minh N. Bùi , Patrick L. Combettes

In this paper, we consider an accelerated method for solving nonconvex and nonsmooth minimization problems. We propose a Bregman Proximal Gradient algorithm with extrapolation(BPGe). This algorithm extends and accelerates the Bregman…

Optimization and Control · Mathematics 2019-04-26 Xiaoya Zhang , Roberto Barrio , M. Angeles Martinez , Hao Jiang , Lizhi Cheng

In this paper, we propose the approximate Bregman proximal gradient algorithm (ABPG) for solving composite nonconvex optimization problems. ABPG employs a new distance that approximates the Bregman distance, making the subproblem of ABPG…

Optimization and Control · Mathematics 2024-11-25 Shota Takahashi , Akiko Takeda

Cutting plane methods, particularly outer approximation, are a well-established approach for solving nonlinear discrete optimization problems without relaxing the integrality of decision variables. While powerful in theory, their…

Optimization and Control · Mathematics 2025-11-04 Hòa T. Bùi , Alberto De Marchi

In this paper we present a unifying framework for continuous optimization methods grounded in the concept of generalized convexity. Utilizing the powerful theory of $\Phi$-convexity, we propose a conceptual algorithm that extends the…

Optimization and Control · Mathematics 2025-03-25 Konstantinos Oikonomidis , Emanuel Laude , Panagiotis Patrinos