English
Related papers

Related papers: An equivalent reformulation and multi-proximity gr…

200 papers

We study the convergence rate of the proximal incremental aggregated gradient (PIAG) method for minimizing the sum of a large number of smooth component functions (where the sum is strongly convex) and a non-smooth convex function. At each…

Optimization and Control · Mathematics 2016-11-28 Nuri Denizcan Vanli , Mert Gurbuzbalaban , Asu Ozdaglar

This paper addresses the unconstrained minimization of smooth convex functions whose gradients are locally Holder continuous. Building on these results, we analyze the Scaled Gradient Algorithm (SGA) under local smoothness assumptions,…

Optimization and Control · Mathematics 2025-11-14 Susan Ghaderi , Morteza Rahimi , Yves Moreau , Masoud Ahookhosh

In this paper, we investigate a class of non-convex sum-of-ratios programs relevant to decision-making in key areas such as product assortment and pricing, and facility location and cost planning. These optimization problems, characterized…

Optimization and Control · Mathematics 2026-01-13 Hoang Giang Pham , Ngan Ha Duong , Tien Mai , Thuy Anh Ta , Minh Hoang Ha

In this paper, we study the proximal gradient algorithm with extrapolation for minimizing the sum of a Lipschitz differentiable function and a proper closed convex function. Under the error bound condition used in [19] for analyzing the…

Optimization and Control · Mathematics 2016-08-02 Bo Wen , Xiaojun Chen , Ting Kei Pong

In this paper we study the problems of minimizing the sum of two nonconvex functions: one is differentiable and satisfies smooth adaptable property. The smooth adaptable property, also named relatively smooth condition, is weaker than the…

Optimization and Control · Mathematics 2019-04-10 Xiaoya Zhang , Hui Zhang , Wei Peng

Stochastic gradient methods for minimizing nonconvex composite objective functions typically rely on the Lipschitz smoothness of the differentiable part, but this assumption fails in many important problem classes like quadratic inverse…

Optimization and Control · Mathematics 2025-01-22 Kuangyu Ding , Jingyang Li , Kim-Chuan Toh

We consider the problem of minimizing a difference-of-convex (DC) function, which can be written as the sum of a smooth convex function with Lipschitz gradient, a proper closed convex function and a continuous possibly nonsmooth concave…

Optimization and Control · Mathematics 2018-04-20 Tianxiang Liu , Ting Kei Pong , Akiko Takeda

We study the convergence properties of a general inertial first-order proximal splitting algorithm for solving nonconvex nonsmooth optimization problems. Using the Kurdyka--\L ojaziewicz (KL) inequality we establish new convergence rates…

Optimization and Control · Mathematics 2016-09-14 Patrick R. Johnstone , Pierre Moulin

We propose a variable metric framework for minimizing the sum of a self-concordant function and a possibly non-smooth convex function, endowed with an easily computable proximal operator. We theoretically establish the convergence of our…

Machine Learning · Statistics 2014-04-15 Quoc Tran-Dinh , Anastasios Kyrillidis , Volkan Cevher

This work studies a composite minimization problem involving a differentiable function q and a nonsmooth function h, both of which may be nonconvex. This problem is ubiquitous in signal processing and machine learning yet remains…

Signal Processing · Electrical Eng. & Systems 2025-09-22 Yiming Zhou , Wei Dai

In this paper, we consider a class of constrained multiobjective optimization problems, where each objective function can be expressed by adding a possibly nonsmooth nonconvex function and a differentiable function with Lipschitz continuous…

Optimization and Control · Mathematics 2026-01-01 Nguyen Van Tuyen , Minh N. Dao , Tran Van Nghi

Classical results show that gradient descent converges linearly to minimizers of smooth strongly convex functions. A natural question is whether there exists a locally nearly linearly convergent method for nonsmooth functions with quadratic…

Optimization and Control · Mathematics 2023-07-18 Damek Davis , Liwei Jiang

In this paper, we propose some accelerated methods for solving optimization problems under the condition of relatively smooth and relatively Lipschitz continuous functions with an inexact oracle. We consider the problem of minimizing the…

Optimization and Control · Mathematics 2024-11-27 O. S. Savchuk , M. S. Alkousa , A. S. Shushko , A. A. Vyguzov , F. S. Stonyakin , D. A. Pasechnyuk , A. V. Gasnikov

In this paper, we present new stochastic methods for solving two important classes of nonconvex optimization problems. We first introduce a randomized accelerated proximal gradient (RapGrad) method for solving a class of nonconvex…

Optimization and Control · Mathematics 2019-08-20 Guanghui Lan , Yu Yang

This paper deals with composite optimization problems having the objective function formed as the sum of two terms, one has Lipschitz continuous gradient along random subspaces and may be nonconvex and the second term is simple and…

Optimization and Control · Mathematics 2024-01-10 I. Necoara , F. Chorobura

With the advancement of modern applications, an increasing number of composite optimization problems arise whose smooth component does not possess a globally Lipschitz continuous gradient. This setting prevents the direct use of the…

Optimization and Control · Mathematics 2026-05-11 Lei Yang , Jingjing Hu , Tianxiang Liu

Mixed integer linear programming (MILP) has seen a sharp rise in use for engineering optimization applications in recent years. Even for initially non-linear problems, it is often the method of choice. Then, the non-linear functions have to…

Optimization and Control · Mathematics 2023-09-20 Felix Birkelbach , David Huber , René Hofmann

We study a class of optimization problems in which the objective function is given by the sum of a differentiable but possibly nonconvex component and a nondifferentiable convex regularization term. We introduce an auxiliary variable to…

Optimization and Control · Mathematics 2019-08-27 Neil K. Dhingra , Sei Zhen Khong , Mihailo R. Jovanović

Composite minimization involves a collection of functions which are aggregated in a nonsmooth manner. It covers, as a particular case, smooth approximation of minimax games, minimization of max-type functions, and simple composite…

Optimization and Control · Mathematics 2025-03-04 Yassine Nabou , Ion Necoara

We study a generic class of decentralized algorithms in which $N$ agents jointly optimize the non-convex objective $f(u):=1/N\sum_{i=1}^{N}f_i(u)$, while only communicating with their neighbors. This class of problems has become popular in…

Optimization and Control · Mathematics 2020-06-23 Mingyi Hong , Siliang Zeng , Junyu Zhang , Haoran Sun