English
Related papers

Related papers: The difference of convex algorithm on Hadamard man…

200 papers

In the paper, we study a class of useful minimax problems on Riemanian manifolds and propose a class of effective Riemanian gradient-based methods to solve these minimax problems. Specifically, we propose an effective Riemannian gradient…

Machine Learning · Computer Science 2023-01-04 Feihu Huang , Shangqian Gao

Neural networks (NNs) can be viewed as approximation tools. Traditionally, NNs are relying on gradient and stochastic gradient (SG) methods. There are a number of available computational packages for constructing least squares…

Optimization and Control · Mathematics 2026-01-12 Vinesha Peiris , Nadezda Sukhorukova

Convex optimization is a well-established research area with applications in almost all fields. Over the decades, multiple approaches have been proposed to solve convex programs. The development of interior-point methods allowed solving a…

Optimization and Control · Mathematics 2020-01-08 Ahmed Douik , Babak Hassibi

In this work, we study decentralized convex constrained optimization problems in networks. We focus on the dual averaging-based algorithmic framework that is well-documented to be superior in handling constraints and complex communication…

Optimization and Control · Mathematics 2022-08-16 Changxin Liu , Yang Shi , Huiping Li , Wenli Du

This paper aims to investigate the distributed stochastic optimization problems on compact embedded submanifolds (in the Euclidean space) for multi-agent network systems. To address the manifold structure, we propose a distributed…

Optimization and Control · Mathematics 2025-10-28 Jishu Zhao , Xi Wang , Jinlong Lei , Shixiang Chen

We study the convergence of the Riemannian steepest descent algorithm on the Grassmann manifold for minimizing the block version of the Rayleigh quotient of a symmetric matrix. Even though this problem is non-convex in the Euclidean sense…

Optimization and Control · Mathematics 2023-09-20 Foivos Alimisis , Bart Vandereycken

The optimization problem of sparse and low-rank matrix recovery is considered, which involves a least squares problem with a rank constraint and a cardinality constraint. To overcome the challenges posed by these constraints, an asymptotic…

Optimization and Control · Mathematics 2024-03-18 Mingcai Ding , Xiaoliang Song , Bo Yu

Submodular functions, defined on continuous or discrete domains, arise in numerous applications. We study the minimization of the difference of two submodular (DS) functions, over both domains, extending prior work restricted to set…

Optimization and Control · Mathematics 2025-11-05 George Orfanides , Tim Hoheisel , Marwa El Halabi

We establish new theoretical convergence guarantees for the difference-of-convex algorithm (DCA), where the second function is allowed to be weakly-convex, measuring progress via composite gradient mapping. Based on a tight analysis of two…

Optimization and Control · Mathematics 2026-01-23 Teodor Rotaru , Panagiotis Patrinos , François Glineur

In this paper, we consider a class of constrained multiobjective optimization problems, where each objective function can be expressed by adding a possibly nonsmooth nonconvex function and a differentiable function with Lipschitz continuous…

Optimization and Control · Mathematics 2026-01-01 Nguyen Van Tuyen , Minh N. Dao , Tran Van Nghi

In this work, we propose and analyze DCA-PAGE, a novel algorithm that integrates the difference-of-convex algorithm (DCA) with the ProbAbilistic Gradient Estimator (PAGE) to solve structured nonsmooth difference-of-convex programs. In the…

Optimization and Control · Mathematics 2025-09-16 Anh Duc Nguyen , Alp Yurtsever , Suvrit Sra , Kim-Chuan Toh

In this paper, we propose a cutting plane algorithm based on DC (Difference-of-Convex) programming and DC cut for globally solving Mixed-Binary Linear Program (MBLP). We first use a classical DC programming formulation via the exact…

Optimization and Control · Mathematics 2021-03-02 Yi-Shuai Niu , Yu You

In this paper, we study possible extensions of the main ideas and methods of constrained DC optimization to the case of nonlinear semidefinite programming problems and more general nonlinear and nonsmooth cone constrained optimization…

Optimization and Control · Mathematics 2024-04-23 M. V. Dolgopolik

Stochastic algorithms are well-known for their performance in the era of big data. In convex optimization, stochastic algorithms have been studied in depth and breadth. However, the current body of research on stochastic algorithms for…

Optimization and Control · Mathematics 2021-08-06 Hoai An Le Thi , Hoang Phuc Hau Luu , Tao Pham Dinh

This paper proposes a novel proximal difference-of-convex (DC) algorithm enhanced with extrapolation and aggressive non-monotone line search for solving non-convex optimization problems. We introduce an adaptive conservative update strategy…

Optimization and Control · Mathematics 2026-02-18 Ran Zhang , Hongpeng Sun

Imaging tasks are typically tackled using a structured optimization framework. This paper delves into a class of algorithms for difference-of-convex (DC) structured optimization, focusing on minimizing a DC function along with a possibly…

Optimization and Control · Mathematics 2024-09-19 Tsz Ching Chow , Chaoyan Huang , Zhongming Wu , Tieyong Zeng , Angelica I. Aviles-Rivero

In this paper, we discuss the solution of a Quadratic Eigenvalue Complementarity Problem (QEiCP) by using Difference of Convex (DC) programming approaches. We first show that QEiCP can be represented as dc programming problem. Then we…

Optimization and Control · Mathematics 2019-02-14 Yi-Shuai Niu , Joaquim Judice , Hoai An Le thi , Dinh Tao Pham

Higher-order tensor methods were recently proposed for minimizing smooth convex and nonconvex functions. Higher-order algorithms accelerate the convergence of the classical first-order methods thanks to the higher-order derivatives used in…

Optimization and Control · Mathematics 2024-01-11 Ion Necoara

A wide range of fundamental machine learning tasks that are addressed by the maximum a posteriori estimation can be reduced to a general minimum conical hull problem. The best-known solution to tackle general minimum conical hull problems…

Machine Learning · Computer Science 2020-08-12 Yuxuan Du , Min-Hsiu Hsieh , Tongliang Liu , Dacheng Tao

We are interested in solving the Asymmetric Eigenvalue Complementarity Problem (AEiCP) by accelerated Difference-of-Convex (DC) algorithms. Two novel hybrid accelerated DCA: the Hybrid DCA with Line search and Inertial force (HDCA-LI) and…

Optimization and Control · Mathematics 2023-05-23 Yi-Shuai Niu