English
Related papers

Related papers: New Bregman proximal type algorithms for solving D…

200 papers

Stochastic algorithms are well-known for their performance in the era of big data. In convex optimization, stochastic algorithms have been studied in depth and breadth. However, the current body of research on stochastic algorithms for…

Optimization and Control · Mathematics 2021-08-06 Hoai An Le Thi , Hoang Phuc Hau Luu , Tao Pham Dinh

This paper presents a directional proximal point method (DPPM) to derive the minimum of any C1-smooth function f. The proposed method requires a function persistent a local convex segment along the descent direction at any non-critical…

Optimization and Control · Mathematics 2022-04-29 Ming-Yu Chung , Jinn Ho , Wen-Liang Hwang

This paper proposes a novel CTA (Combine-Then-Adapt)-based decentralized algorithm for solving convex composite optimization problems over undirected and connected networks. The local loss function in these problems contains both smooth and…

Optimization and Control · Mathematics 2023-03-07 Luyao Guo , Xinli Shi , Jinde Cao , Zihao Wang

We propose Frank--Wolfe (FW) algorithms with an adaptive Bregman step-size strategy for smooth adaptable (also called: relatively smooth) (weakly-) convex functions. This means that the gradient of the objective function is not necessarily…

Optimization and Control · Mathematics 2026-02-19 Shota Takahashi , Sebastian Pokutta , Akiko Takeda

We consider a class of difference-of-convex (DC) optimization problems where the objective function is the sum of a smooth function and a possible nonsmooth DC function. The application of proximal DC algorithms to address this problem…

Optimization and Control · Mathematics 2023-08-30 Shummin Nakayama , Yasushi Narushima , Hiroshi Yabe

Sparse optimization refers to an optimization problem involving the zero-norm in objective or constraints. In this paper, nonconvex approximation approaches for sparse optimization have been studied with a unifying point of view in DC…

Numerical Analysis · Computer Science 2014-07-23 Hoai An Le Thi , Tao Pham Dinh , Hoai Minh Le , Xuan Thanh Vo

In this paper, we consider a class of structured nonsmooth optimization problems over an embedded submanifold of a Euclidean space, where the first part of the objective is the sum of a difference-of-convex (DC) function and a smooth…

Optimization and Control · Mathematics 2025-11-07 Qia Li , Na Zhang , Junyu Feng , Hanwei Yan

We study the continuous-time structure of the difference-of-convex algorithm (DCA) for smooth DC decompositions with a strongly convex component. In dual coordinates, classical DCA is exactly the full-step explicit Euler discretization of a…

Optimization and Control · Mathematics 2026-04-09 Yi-Shuai Niu

We introduce two new algorithms to minimise smooth difference of convex (DC) functions that accelerate the convergence of the classical DC algorithm (DCA). We prove that the point computed by DCA can be used to define a descent direction…

Optimization and Control · Mathematics 2017-07-24 Francisco J. Aragón Artacho , Ronan M. T. Fleming , Phan T. Vuong

The paper presents primal-dual proximal splitting methods for convex optimization, in which generalized Bregman distances are used to define the primal and dual proximal update steps. The methods extend the primal and dual Condat-Vu…

Optimization and Control · Mathematics 2024-08-20 Xin Jiang , Lieven Vandenberghe

This paper proposes a novel proximal-gradient algorithm for a decentralized optimization problem with a composite objective containing smooth and non-smooth terms. Specifically, the smooth and nonsmooth terms are dealt with by gradient and…

Optimization and Control · Mathematics 2021-02-02 Zhi Li , Wei Shi , Ming Yan

This work is concerned with the optimization of nonconvex, nonsmooth composite optimization problems, whose objective is a composition of a nonlinear mapping and a nonsmooth nonconvex function, that can be written as an infimal convolution…

Optimization and Control · Mathematics 2018-03-28 Emanuel Laude , Daniel Cremers

In this paper, we propose a variance-reduced primal-dual algorithm with Bregman distance for solving convex-concave saddle-point problems with finite-sum structure and nonbilinear coupling function. This type of problems typically arises in…

Optimization and Control · Mathematics 2021-06-02 Erfan Yazdandoost Hamedani , Afrooz Jalilzadeh

In this paper we consider minimization of a difference-of-convex (DC) function with and without linear constraints. We first study a smooth approximation of a generic DC function, termed difference-of-Moreau-envelopes (DME) smoothing, where…

Optimization and Control · Mathematics 2022-11-21 Kaizhao Sun , Xu Andy Sun

We present a new feasible proximal gradient method for constrained optimization where both the objective and constraint functions are given by the summation of a smooth, possibly nonconvex function and a convex simple function. The…

Optimization and Control · Mathematics 2024-02-01 Digvijay Boob , Qi Deng , Guanghui Lan

In this paper we consider convergence rate problems for stochastic strongly-convex optimization in the non-Euclidean sense with a constraint set over a time-varying multi-agent network. We propose two efficient non-Euclidean stochastic…

Optimization and Control · Mathematics 2018-08-23 Deming Yuan , Yiguang Hong , Daniel W. C. Ho , Guoping Jiang

The Boosted Difference of Convex functions Algorithm (BDCA) has been recently introduced to accelerate the performance of the classical Difference of Convex functions Algorithm (DCA). This acceleration is achieved thanks to an extrapolation…

Optimization and Control · Mathematics 2022-08-03 Francisco J. Aragón Artacho , Rubén Campoy , Phan T. Vuong

Structured convex optimization problems typically involve a mix of smooth and nonsmooth functions. The common practice is to activate the smooth functions via their gradient and the nonsmooth ones via their proximity operator. We show that,…

Optimization and Control · Mathematics 2019-09-11 Patrick L. Combettes , Lilian E. Glaudin

This dissertation explores block decomposable methods for large-scale optimization problems. It focuses on alternating direction method of multipliers (ADMM) schemes and block coordinate descent (BCD) methods. Specifically, it introduces a…

Optimization and Control · Mathematics 2026-01-15 Leandro Farias Maia

Convex nonsmooth optimization problems, whose solutions live in very high dimensional spaces, have become ubiquitous. To solve them, the class of first-order algorithms known as proximal splitting algorithms is particularly adequate: they…

Optimization and Control · Mathematics 2023-02-27 Laurent Condat , Daichi Kitahara , Andrés Contreras , Akira Hirabayashi