English
Related papers

Related papers: A Refined Inertial DC Algorithm for DC Programming

200 papers

By exploiting the property that the RBM log-likelihood function is the difference of convex functions, we formulate a stochastic variant of the difference of convex functions (DC) programming to minimize the negative log-likelihood.…

Machine Learning · Computer Science 2017-10-06 Vidyadhar Upadhya , P. S. Sastry

Higher-order tensor methods were recently proposed for minimizing smooth convex and nonconvex functions. Higher-order algorithms accelerate the convergence of the classical first-order methods thanks to the higher-order derivatives used in…

Optimization and Control · Mathematics 2024-01-11 Ion Necoara

We propose an algorithm for optimizing the parameters of single hidden layer neural networks. Specifically, we derive a blockwise difference-of-convex (DC) functions representation of the objective function. Based on the latter, we propose…

Machine Learning · Computer Science 2024-01-17 Daniel Tschernutter , Mathias Kraus , Stefan Feuerriegel

In this paper, we propose a cutting plane algorithm based on DC (Difference-of-Convex) programming and DC cut for globally solving Mixed-Binary Linear Program (MBLP). We first use a classical DC programming formulation via the exact…

Optimization and Control · Mathematics 2021-03-02 Yi-Shuai Niu , Yu You

We investigate an inertial algorithm of gradient type in connection with the minimization of a nonconvex differentiable function. The algorithm is formulated in the spirit of Nesterov's accelerated convex gradient method. We show that the…

Functional Analysis · Mathematics 2018-11-26 Szilárd Csaba László

As one of the emerging algorithms in the field of Artificial Immune Systems (AIS), the Dendritic Cell Algorithm (DCA) has been successfully applied to a number of challenging real-world problems. However, one criticism is the lack of a…

Neural and Evolutionary Computing · Computer Science 2013-06-03 Feng Gu , Julie Greensmith , Uwe Aickelin

In this paper, we consider a class of nonconvex (not necessarily differentiable) optimization problems called generalized DC (Difference-of-Convex functions) programming, which is minimizing the sum of two separable DC parts and one…

Optimization and Control · Mathematics 2023-08-07 Hongjin He , Zhiyuan Zhang

In this paper, we discuss the solution of a Quadratic Eigenvalue Complementarity Problem (QEiCP) by using Difference of Convex (DC) programming approaches. We first show that QEiCP can be represented as dc programming problem. Then we…

Optimization and Control · Mathematics 2019-02-14 Yi-Shuai Niu , Joaquim Judice , Hoai An Le thi , Dinh Tao Pham

We introduce a novel method for handling endpoint constraints in constrained differential dynamic programming (DDP). Unlike existing approaches, our method guarantees quadratic convergence and is exact, effectively managing rank…

Optimization and Control · Mathematics 2025-03-07 Maria Parilli , Sergi Martinez , Carlos Mastalli

We design algorithms for Robust Principal Component Analysis (RPCA) which consists in decomposing a matrix into the sum of a low rank matrix and a sparse matrix. We propose a deep unrolled algorithm based on an accelerated alternating…

Signal Processing · Electrical Eng. & Systems 2023-07-13 Elizabeth Z. C. Tan , Caroline Chaux , Emmanuel Soubies , Vincent Y. F. Tan

Sparse optimization refers to an optimization problem involving the zero-norm in objective or constraints. In this paper, nonconvex approximation approaches for sparse optimization have been studied with a unifying point of view in DC…

Numerical Analysis · Computer Science 2014-07-23 Hoai An Le Thi , Tao Pham Dinh , Hoai Minh Le , Xuan Thanh Vo

This paper considers convex optimization problems where nodes of a network have access to summands of a global objective. Each of these local objectives is further assumed to be an average of a finite set of functions. The motivation for…

Optimization and Control · Mathematics 2015-06-16 Aryan Mokhtari , Alejandro Ribeiro

In this paper, we study a family of non-convex and possibly non-smooth inf-projection minimization problems, where the target objective function is equal to minimization of a joint function over another variable. This problem include…

Machine Learning · Computer Science 2020-07-15 Yan Yan , Yi Xu , Lijun Zhang , Xiaoyu Wang , Tianbao Yang

We consider a class of difference-of-convex (DC) optimization problems where the objective function is the sum of a smooth function and a possible nonsmooth DC function. The application of proximal DC algorithms to address this problem…

Optimization and Control · Mathematics 2023-08-30 Shummin Nakayama , Yasushi Narushima , Hiroshi Yabe

Cardinality constraints in optimization are commonly of $L^0$-type, and they lead to sparsely supported optimizers. An efficient way of dealing with these constraints algorithmically, when the objective functional is convex, is…

Optimization and Control · Mathematics 2026-02-26 Bastian Dittrich , Evelyn Herberg , Roland Herzog , Georg Müller

This paper seeks to address how to solve non-smooth convex and strongly convex optimization problems with functional constraints. The introduced Mirror Descent (MD) method with adaptive stepsizes is shown to have a better convergence rate…

Optimization and Control · Mathematics 2017-05-08 Anastasia Bayandina

Bilevel programming has emerged as a valuable tool for hyperparameter selection, a central concern in machine learning. In a recent study by Ye et al. (2023), a value function-based difference of convex algorithm was introduced to address…

Optimization and Control · Mathematics 2024-01-23 Lucy L. Gao , Jane J. Ye , Haian Yin , Shangzhi Zeng , Jin Zhang

Two characteristics that make convex decomposition algorithms attractive are simplicity of operations and generation of parallelizable structures. In principle, these schemes require that all coordinates update at the same time, i.e., they…

Optimization and Control · Mathematics 2018-03-07 Giorgos Stathopoulos , Colin N. Jones

The classical Krasnoselskii-Mann iteration is broadly used for approximating fixed points of nonexpansive operators. To accelerate the convergence of the Krasnoselskii-Mann iteration, the inertial methods were received much attention in…

Functional Analysis · Mathematics 2020-01-09 Fuying Cui , Yang Yang , Yuchao Tang , Chuanxi Zhu

This work proposes a novel and unified sparse recovery framework, termed the difference of convex Elastic Net (DCEN). This framework effectively balances strong sparsity promotion with solution stability, and is particularly suitable for…

Optimization and Control · Mathematics 2026-04-03 Lang Yu , Nanjing Huang
‹ Prev 1 3 4 5 6 7 10 Next ›