English
Related papers

Related papers: On the Pervasiveness of Difference-Convexity in Op…

200 papers

The difference-of-convex algorithm (DCA) and its variants are the most popular methods to solve the difference-of-convex optimization problem. Each iteration of them is reduced to a convex optimization problem, which generally needs to be…

Optimization and Control · Mathematics 2025-05-19 Songnian He , Qiao-Li Dong , Michael Th. Rassias

This paper investigates a specific class of nonsmooth nonconvex optimization problems in the face of data uncertainty, namely, robust optimization problems, where the given objective function can be expressed as a difference of two…

Optimization and Control · Mathematics 2026-02-20 Feryal Mashkoorzadeh , Nooshin Movahedian

We consider a difference-of-convex formulation where one of the terms is allowed to be hypoconvex (or weakly convex). We first examine the precise behavior of a single iteration of the Difference-of-Convex algorithm (DCA), giving a tight…

Optimization and Control · Mathematics 2024-03-26 Teodor Rotaru , Panagiotis Patrinos , François Glineur

Difference-of-Convex Algorithm (DCA) is a well-known nonconvex optimization algorithm for minimizing a nonconvex function that can be expressed as the difference of two convex ones. Many famous existing optimization algorithms, such as SGD…

Machine Learning · Computer Science 2024-12-16 Youran Sun , Yihua Liu , Yi-Shuai Niu

We develop two penalty based difference of convex (DC) algorithms for solving chance constrained programs. First, leveraging a rank-based DC decomposition of the chance constraint, we propose a proximal penalty based DC algorithm in the…

Optimization and Control · Mathematics 2026-03-16 Zhiping Li , Nan Jiang , Rujun Jiang

We present a new piecewise linear regression methodology that utilizes fitting a difference of convex functions (DC functions) to the data. These are functions $f$ that may be represented as the difference $\phi_1 - \phi_2$ for a choice of…

Machine Learning · Statistics 2020-11-17 Ali Siahkamari , Aditya Gangrade , Brian Kulis , Venkatesh Saligrama

We investigate the computation of the gradient of the value function in parametric convex optimization problems. We derive general expression for the gradient of the value function in terms of the cost function, constraints and Lagrange…

Optimization and Control · Mathematics 2016-07-04 Mato Baotić

We propose an algorithm for optimizing the parameters of single hidden layer neural networks. Specifically, we derive a blockwise difference-of-convex (DC) functions representation of the objective function. Based on the latter, we propose…

Machine Learning · Computer Science 2024-01-17 Daniel Tschernutter , Mathias Kraus , Stefan Feuerriegel

This paper considers convex optimization problems where nodes of a network have access to summands of a global objective. Each of these local objectives is further assumed to be an average of a finite set of functions. The motivation for…

Optimization and Control · Mathematics 2015-06-16 Aryan Mokhtari , Alejandro Ribeiro

We consider the conic linear program given by a closed convex cone in an Euclidean space and a matrix, where vector on the right-hand-side of the constraint system and the vector defining the objective function are subject to change. Using…

Optimization and Control · Mathematics 2020-12-18 Nguyen Ngoc Luan , Do Sang Kim , Nguyen Dong Yen

In this paper, we consider a class of constrained multiobjective optimization problems, where each objective function can be expressed by adding a possibly nonsmooth nonconvex function and a differentiable function with Lipschitz continuous…

Optimization and Control · Mathematics 2026-01-01 Nguyen Van Tuyen , Minh N. Dao , Tran Van Nghi

Preconditioning is a crucial operation in gradient-based numerical optimisation. It helps decrease the local condition number of a function by appropriately transforming its gradient. For a convex function, where the gradient can be…

Optimization and Control · Mathematics 2023-08-29 Dmitrii A. Pasechnyuk , Alexander Gasnikov , Martin Takáč

Quasi-differentiable functions were introduced by Pshenichnyi in a 1969 monograph written in Russian and translated in an English version in 1971. This class of nonsmooth functions was studied extensively in two decades since but has not…

Optimization and Control · Mathematics 2025-07-17 Jong-Shi Pang , Yulin Peng

Many modern statistical estimation problems are defined by three major components: a statistical model that postulates the dependence of an output variable on the input features; a loss function measuring the error between the observed…

Optimization and Control · Mathematics 2018-10-09 Ying Cui , Jong-Shi Pang , Bodhisattva Sen

We propose a novel decomposition framework for the distributed optimization of Difference Convex (DC)-type nonseparable sum-utility functions subject to coupling convex constraints. A major contribution of the paper is to develop for the…

Information Theory · Computer Science 2013-09-23 Alberth Alvarado , Gesualdo Scutari , Jong-Shi Pang

We consider a class of difference-of-convex (DC) optimization problems whose objective is level-bounded and is the sum of a smooth convex function with Lipschitz gradient, a proper closed convex function and a continuous concave function.…

Optimization and Control · Mathematics 2017-06-23 Bo Wen , Xiaojun Chen , Ting Kei Pong

This paper is devoted to the analysis of a finite horizon discrete-time stochastic optimal control problem, in presence of constraints. We study the regularity of the value function which comes from the dynamic programming algorithm. We…

Optimization and Control · Mathematics 2007-05-23 M. Papi , S. Sbaraglia

The minimization of convex objectives coming from linear supervised learning problems, such as penalized generalized linear models, can be formulated as finite sums of convex functions. For such problems, a large set of stochastic…

Machine Learning · Statistics 2018-12-18 Martin Bompaire , Emmanuel Bacry , Stéphane Gaïffas

In this paper we propose a variant of the random coordinate descent method for solving linearly constrained convex optimization problems with composite objective functions. If the smooth part of the objective function has Lipschitz…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Andrei Patrascu

In this work, we propose and analyze DCA-PAGE, a novel algorithm that integrates the difference-of-convex algorithm (DCA) with the ProbAbilistic Gradient Estimator (PAGE) to solve structured nonsmooth difference-of-convex programs. In the…

Optimization and Control · Mathematics 2025-09-16 Anh Duc Nguyen , Alp Yurtsever , Suvrit Sra , Kim-Chuan Toh