中文
相关论文

相关论文: On the convergence rate of the boosted Difference-…

200 篇论文

With the increasing interest in applying the methodology of difference-of-convex (dc) optimization to diverse problems in engineering and statistics, this paper establishes the dc property of many well-known functions not previously known…

最优化与控制 · 数学 2019-02-20 Maher Nouiehed , Jong-Shi Pang , Meisam Razaviyayn

In this paper, we study possible extensions of the main ideas and methods of constrained DC optimization to the case of nonlinear semidefinite programming problems and more general nonlinear and nonsmooth cone constrained optimization…

最优化与控制 · 数学 2024-04-23 M. V. Dolgopolik

In this paper, we focus on the problem of minimizing the sum of a nonconvex differentiable function and a DC (Difference of Convex functions) function, where the differentiable function is not restricted to the global Lipschitz gradient…

最优化与控制 · 数学 2021-06-10 Duy Nhat Phan , Hoai An Le Thi

We propose a simple proof of the worst-case iteration complexity for the Difference of Convex functions Algorithm (DCA) for unconstrained minimization, showing that the global rate of convergence of the norm of the objective function's…

最优化与控制 · 数学 2026-01-23 Serge Gratton , Philippe L. Toint

This article explores distributed convex optimization with globally-coupled constraints, where the objective function is a general nonsmooth convex function, the constraints include nonlinear inequalities and affine equalities, and the…

最优化与控制 · 数学 2025-03-14 Zixuan Liu , Xuyang Wu , Dandan Wang , Jie Lu

We consider the large sum of DC (Difference of Convex) functions minimization problem which appear in several different areas, especially in stochastic optimization and machine learning. Two DCA (DC Algorithm) based algorithms are proposed:…

最优化与控制 · 数学 2019-11-12 Hoai An Le Thi , Hoai Minh Le , Duy Nhat Phan , Bach Tran

We introduce an extension of the Difference of Convex Algorithm (DCA) in the form of a randomized block coordinate approach for problems with separable structure. For $n$ coordinate-blocks and $k$ iterations, our main result proves a…

最优化与控制 · 数学 2025-12-01 Hoomaan Maskan , Paniz Halvachi , Suvrit Sra , Alp Yurtsever

In this paper, we propose a clean and general proof framework to establish the convergence analysis of the Difference-of-Convex (DC) programming algorithm (DCA) for both standard DC program and convex constrained DC program. We first…

最优化与控制 · 数学 2022-11-22 Yi-Shuai Niu

We propose an algorithm for optimizing the parameters of single hidden layer neural networks. Specifically, we derive a blockwise difference-of-convex (DC) functions representation of the objective function. Based on the latter, we propose…

机器学习 · 计算机科学 2024-01-17 Daniel Tschernutter , Mathias Kraus , Stefan Feuerriegel

Decentralized optimization, particularly the class of decentralized composite convex optimization (DCCO) problems, has found many applications. Due to ubiquitous communication congestion and random dropouts in practice, it is highly…

最优化与控制 · 数学 2022-10-12 Changxin Liu , Zirui Zhou , Jian Pei , Yong Zhang , Yang Shi

We propose and study a version of the DCA (Difference-of-Convex functions Algorithm) using the $\ell_1$ penalty function for solving nonsmooth DC optimization problems with nonsmooth DC equality and inequality constraints. The method…

最优化与控制 · 数学 2024-04-23 M. V. Dolgopolik

We address the minimization of a smooth objective function under an $\ell_0$-constraint and simple convex constraints. When the problem has no constraints except the $\ell_0$-constraint, some efficient algorithms are available; for example,…

最优化与控制 · 数学 2017-01-31 Katsuya Tono , Akiko Takeda , Jun-ya Gotoh

Augmenting algorithms with learned predictions is a promising approach for going beyond worst-case bounds. Dinitz, Im, Lavastida, Moseley, and Vassilvitskii~(2021) have demonstrated that a warm start with learned dual solutions can improve…

机器学习 · 计算机科学 2022-05-23 Shinsaku Sakaue , Taihei Oki

We establish new theoretical convergence guarantees for the difference-of-convex algorithm (DCA), where the second function is allowed to be weakly-convex, measuring progress via composite gradient mapping. Based on a tight analysis of two…

最优化与控制 · 数学 2026-01-23 Teodor Rotaru , Panagiotis Patrinos , François Glineur

When solving decision-making problems with mathematical optimization, some constraints or objectives may lack analytic expressions but can be approximated from data. When an approximation is made by neural networks, the underlying problem…

最优化与控制 · 数学 2025-03-25 Xinwei Liu , Vladimir Dvorkin

Boosting is a popular way to derive powerful learners from simpler hypothesis classes. Following previous work (Mason et al., 1999; Friedman, 2000) on general boosting frameworks, we analyze gradient-based descent algorithms for boosting…

机器学习 · 计算机科学 2012-02-15 Alexander Grubb , J. Andrew Bagnell

In this work, we propose and analyze DCA-PAGE, a novel algorithm that integrates the difference-of-convex algorithm (DCA) with the ProbAbilistic Gradient Estimator (PAGE) to solve structured nonsmooth difference-of-convex programs. In the…

最优化与控制 · 数学 2025-09-16 Anh Duc Nguyen , Alp Yurtsever , Suvrit Sra , Kim-Chuan Toh

The fields of machine learning and mathematical optimization increasingly intertwined. The special topic on supervised learning and convex optimization examines this interplay. The training part of most supervised learning algorithms can…

机器学习 · 计算机科学 2015-07-14 Nan Wang

We develop two penalty based difference of convex (DC) algorithms for solving chance constrained programs. First, leveraging a rank-based DC decomposition of the chance constraint, we propose a proximal penalty based DC algorithm in the…

最优化与控制 · 数学 2026-03-16 Zhiping Li , Nan Jiang , Rujun Jiang

Learning effective regularization is crucial for solving ill-posed inverse problems, which arise in a wide range of scientific and engineering applications. While data-driven methods that parameterize regularizers using deep neural networks…

机器学习 · 统计学 2025-02-04 Yasi Zhang , Oscar Leong