English
Related papers

Related papers: A general framework for solving convex optimizatio…

200 papers

In this paper we propose a stochastic primal dual fixed point method (SPDFP) for solving the sum of two proper lower semi-continuous convex function and one of which is composite. The method is based on the primal dual fixed point method…

Optimization and Control · Mathematics 2020-04-21 YaNanZhu , XiaoqunZhang

In this paper, we consider a class of structured nonconvex nonsmooth optimization problems whose objective function is the sum of three nonconvex functions, one of which is expressed in a difference-of-convex (DC) form. This problem class…

Optimization and Control · Mathematics 2025-06-10 Minh N. Dao , Tan Nhat Pham , Phan Thanh Tung

Using convex combination and linesearch techniques, we introduce a novel primal-dual algorithm for solving structured convex-concave saddle point problems with a generic smooth nonbilinear coupling term. Our adaptive linesearch strategy…

Optimization and Control · Mathematics 2024-01-17 Xiaokai Chang , Junfeng Yang , Hongchao Zhang

This paper analyzes the iteration-complexity of a quadratic penalty accelerated inexact proximal point method for solving linearly constrained nonconvex composite programs. More specifically, the objective function is of the form $f + h$…

Optimization and Control · Mathematics 2019-07-17 Weiwei Kong , Jefferson G. Melo , Renato D. C. Monteiro

Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration…

Optimization and Control · Mathematics 2019-01-25 Ching-pei Lee , Stephen J. Wright

This paper discusses several (sub)gradient methods attaining the optimal complexity for smooth problems with Lipschitz continuous gradients, nonsmooth problems with bounded variation of subgradients, weakly smooth problems with H\"older…

Optimization and Control · Mathematics 2016-05-02 Masoud Ahookhosh

We consider convex optimization with non-smooth objective function and log-concave sampling with non-smooth potential (negative log density). In particular, we study two specific settings where the convex objective/potential function is…

Optimization and Control · Mathematics 2025-11-13 Jiaming Liang , Yongxin Chen

In this paper we focus on the convergence analysis of the forward-backward splitting method for solving nonsmooth optimization problems in Hilbert spaces when the objective function is the sum of two convex functions. Assuming that one of…

Optimization and Control · Mathematics 2016-10-17 J. Y. Bello Cruz , T. T. A. Nghia

This paper studies a class of double-loop (inner-outer) algorithms for convex composite optimization. For unconstrained problems, we develop a restarted accelerated composite gradient method that attains the optimal first-order complexity…

Optimization and Control · Mathematics 2026-02-23 Matthew X. Burns , Jiaming Liang

Optimization problems under affine constraints appear in various areas of machine learning. We consider the task of minimizing a smooth strongly convex function F(x) under the affine constraint Kx=b, with an oracle providing evaluations of…

Optimization and Control · Mathematics 2022-04-12 Adil Salim , Laurent Condat , Dmitry Kovalev , Peter Richtárik

This paper extends the algorithm schemes proposed in \cite{Nesterov2007a} and \cite{Nesterov2007b} to the minimization of the sum of a composite objective function and a convex function. Two proximal point-type schemes are provided and…

Optimization and Control · Mathematics 2011-05-03 Quoc Tran Dinh , Moritz Diehl

In this paper, we develop a novel distributed algorithm for addressing convex optimization with both nonlinear inequality and linear equality constraints, where the objective function can be a general nonsmooth convex function and all the…

Optimization and Control · Mathematics 2021-02-26 Xuyang Wu , He Wang , Jie Lu

We provide a general framework to construct finite dimensional approximations of the space of convex functions, which also applies to the space of c-convex functions and to the space of support functions of convex bodies. We give estimates…

Numerical Analysis · Mathematics 2014-03-11 Quentin Mérigot , Edouard Oudet

In this letter, we consider a bilevel optimization problem in which the outer-level objective function is strongly convex, whereas the inner-level problem consists of a finite sum of convex functions. Bilevel optimization problems arise in…

Optimization and Control · Mathematics 2026-01-22 Sudkobfa Boontawee , Mootta Prangprakhon , Nimit Nimana

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

This work presents a unified framework that combines global approximations with locally built models to handle challenging nonconvex and nonsmooth composite optimization problems, including cases involving extended real-valued functions. We…

Optimization and Control · Mathematics 2026-02-19 Welington de Oliveira , Johannes O. Royset

For the general problem of minimizing a convex function over a compact convex domain, we will investigate a simple iterative approximation algorithm based on the method by Frank & Wolfe 1956, that does not need projection steps in order to…

Optimization and Control · Mathematics 2011-12-30 Martin Jaggi

In this paper, we derive a Fast Reflected Forward-Backward (Fast RFB) algorithm to solve the problem of finding a zero of the sum of a maximally monotone operator and a monotone and Lipschitz continuous operator in a real Hilbert space. Our…

Optimization and Control · Mathematics 2025-10-20 Radu Ioan Bot , Dang-Khoa Nguyen , Chunxiang Zong

We consider structured optimisation problems defined in terms of the sum of a smooth and convex function, and a proper, l.s.c., convex (typically non-smooth) one in reflexive variable exponent Lebesgue spaces $L_{p(\cdot)}(\Omega)$. Due to…

Optimization and Control · Mathematics 2022-11-10 Marta Lazzaretti , Luca Calatroni , Claudio Estatico

The possibilities of exploiting the special structure of d.c. programs, which consist of optimizing the difference of convex functions, are currently more or less limited to variants of the DCA proposed by Pham Dinh Tao and Le Thi Hoai An…

Optimization and Control · Mathematics 2016-10-21 Sebastian Banert , Radu Ioan Bot