English
Related papers

Related papers: Variable Metric Forward-Backward Algorithm for Com…

200 papers

We consider minimizing the sum of three convex functions, where the first one F is smooth, the second one is nonsmooth and proximable and the third one is the composition of a nonsmooth proximable function with a linear operator L. This…

Optimization and Control · Mathematics 2022-07-27 Adil Salim , Laurent Condat , Konstantin Mishchenko , Peter Richtárik

This paper concerns the minimization of the composition of a nonsmooth convex function and a $\mathcal{C}^{1,1}$ mapping $F$ over a $\mathcal{C}^2$-smooth embedded closed submanifold $\mathcal{M}$. For this class of nonconvex and nonsmooth…

Optimization and Control · Mathematics 2026-05-12 Hao He , Ruyu Liu , Yitian Qian , Shaohua Pan

Composite minimization involves a collection of functions which are aggregated in a nonsmooth manner. It covers, as a particular case, smooth approximation of minimax games, minimization of max-type functions, and simple composite…

Optimization and Control · Mathematics 2025-03-04 Yassine Nabou , Ion Necoara

The forward-backward operator splitting algorithm is one of the most important methods for solving the optimization problem of the sum of two convex functions, where one is differentiable with a Lipschitz continuous gradient and the other…

Optimization and Control · Mathematics 2019-08-30 Yu-Chao Tang , Guo-Rong Wu , Chuan-Xi Zhu

We consider the problem of minimizing the sum of an average function of a large number of smooth convex components and a general, possibly non-differentiable, convex function. Although many methods have been proposed to solve this problem…

Optimization and Control · Mathematics 2019-01-01 Le Thi Khanh Hien , Cuong V. Nguyen , Huan Xu , Canyi Lu , Jiashi Feng

We present a new Frank-Wolfe (FW) type algorithm that is applicable to minimization problems with a nonsmooth convex objective. We provide convergence bounds and show that the scheme yields so-called coreset results for various Machine…

Optimization and Control · Mathematics 2017-08-23 Sathya N. Ravi , Maxwell D. Collins , Vikas Singh

We consider a variable metric linesearch based proximal gradient method for the minimization of the sum of a smooth, possibly nonconvex function plus a convex, possibly nonsmooth term. We prove convergence of this iterative algorithm to a…

Numerical Analysis · Mathematics 2017-04-11 Silvia Bonettini , Ignace Loris , Federica Porta , Marco Prato , Simone Rebegoldi

This paper extends the algorithm schemes proposed in \cite{Nesterov2007a} and \cite{Nesterov2007b} to the minimization of the sum of a composite objective function and a convex function. Two proximal point-type schemes are provided and…

Optimization and Control · Mathematics 2011-05-03 Quoc Tran Dinh , Moritz Diehl

Many optimization problems arising in high-dimensional statistics decompose naturally into a sum of several terms, where the individual terms are relatively simple but the composite objective function can only be optimized with iterative…

Optimization and Control · Mathematics 2016-06-30 Rina Foygel Barber , Emil Y. Sidky

We consider minimizing a function consisting of a quadratic term and a proximable term which is possibly nonconvex and nonsmooth. This problem is also known as scaled proximal operator. Despite its simple form, existing methods suffer from…

Optimization and Control · Mathematics 2024-03-01 Yiming Zhou , Wei Dai

We consider an inertial primal-dual fixed point algorithm (IPDFP) to compute the minimizations of the following Problem (1.1). This is a full splitting approach, in the sense that the nonsmooth functions are processed individually via their…

Optimization and Control · Mathematics 2016-04-20 Meng Wen , Yu-Chao Tang , Jigen Peng

Several optimization schemes have been known for convex optimization problems. However, numerical algorithms for solving nonconvex optimization problems are still underdeveloped. A progress to go beyond convexity was made by considering the…

Optimization and Control · Mathematics 2015-06-29 Nguyen Thai An , Nguyen Mau Nam

This paper analyzes block-coordinate proximal gradient methods for minimizing the sum of a separable smooth function and a (nonseparable) nonsmooth function, both of which are allowed to be nonconvex. The main tool in our analysis is the…

Optimization and Control · Mathematics 2024-04-17 Puya Latafat , Andreas Themelis , Panagiotis Patrinos

In this paper, we address a manifold constrained nonsmooth optimization problem involving the composition of a weakly convex function and a smooth mapping under the availability of a parametrization of the manifold. To find a stationary…

Optimization and Control · Mathematics 2026-02-03 Keita Kume , Isao Yamada

In this paper, we consider a class of nonconvex and nonsmooth fractional programming problems, that involve the sum of a convex, possibly nonsmooth function composed with a linear operator and a differentiable, possibly nonconvex function…

Optimization and Control · Mathematics 2025-03-18 Radu Ioan Boţ , Guoyin Li , Min Tao

In this paper we focus on the convergence analysis of the forward-backward splitting method for solving nonsmooth optimization problems in Hilbert spaces when the objective function is the sum of two convex functions. Assuming that one of…

Optimization and Control · Mathematics 2016-10-17 J. Y. Bello Cruz , T. T. A. Nghia

In this paper, we develop a splitting algorithm incorporating Bregman distances to solve a broad class of linearly constrained composite optimization problems, whose objective function is the separable sum of possibly nonconvex nonsmooth…

Optimization and Control · Mathematics 2024-10-01 Tan Nhat Pham , Minh N. Dao , Andrew Eberhard , Nargiz Sultanova

We develop a new proximal-gradient method for minimizing the sum of a differentiable, possibly nonconvex, function plus a convex, possibly non differentiable, function. The key features of the proposed method are the definition of a…

Numerical Analysis · Mathematics 2016-05-13 Silvia Bonettini , Ignace Loris , Federica Porta , Marco Prato

In this paper, we propose an optimization-based method for robust phase retrieval problem where the goal is to estimate an unknown signal from a quadratic measurement corrupted by outliers. To enhance the robustness of existing optimization…

Optimization and Control · Mathematics 2026-04-17 Kumataro Yazawa , Keita Kume , Isao Yamada

We propose a variable metric extension of the forward--backward-forward algorithm for finding a zero of the sum of a maximally monotone operator and a Lipschitzian monotone operator in Hilbert spaces. In turn, this framework provides a…

Optimization and Control · Mathematics 2012-11-01 B. C. Vũ