English
Related papers

Related papers: The Boosted DC Algorithm for Clustering with Const…

200 papers

Fairness of decision-making algorithms is an increasingly important issue. In this paper, we focus on spectral clustering with group fairness constraints, where every demographic group is represented in each cluster proportionally as in the…

Machine Learning · Computer Science 2025-06-11 Francesco Tonin , Alex Lambert , Johan A. K. Suykens , Volkan Cevher

We consider a class of difference-of-convex (DC) optimization problems whose objective is level-bounded and is the sum of a smooth convex function with Lipschitz gradient, a proper closed convex function and a continuous concave function.…

Optimization and Control · Mathematics 2017-06-23 Bo Wen , Xiaojun Chen , Ting Kei Pong

In this paper, we focus on the problem of minimizing the sum of a nonconvex differentiable function and a DC (Difference of Convex functions) function, where the differentiable function is not restricted to the global Lipschitz gradient…

Optimization and Control · Mathematics 2021-06-10 Duy Nhat Phan , Hoai An Le Thi

Coordinate descent algorithms are widely used in machine learning and large-scale data analysis due to their strong optimality guarantees and impressive empirical performance in solving non-convex problems. In this work, we introduce Block…

Optimization and Control · Mathematics 2024-12-17 Zhijie Yuan , Ganzhao Yuan , Lei Sun

We propose an algorithm for optimizing the parameters of single hidden layer neural networks. Specifically, we derive a blockwise difference-of-convex (DC) functions representation of the objective function. Based on the latter, we propose…

Machine Learning · Computer Science 2024-01-17 Daniel Tschernutter , Mathias Kraus , Stefan Feuerriegel

In this paper, we study the convergence rate of the DCA (Difference-of-Convex Algorithm), also known as the convex-concave procedure, with two different termination criteria that are suitable for smooth and nonsmooth decompositions…

Optimization and Control · Mathematics 2023-02-24 Hadi Abbaszadehpeivasti , Etienne de Klerk , Moslem Zamani

In this paper, we study possible extensions of the main ideas and methods of constrained DC optimization to the case of nonlinear semidefinite programming problems and more general nonlinear and nonsmooth cone constrained optimization…

Optimization and Control · Mathematics 2024-04-23 M. V. Dolgopolik

In this paper we consider the difference-of-convex (DC) programming problems, whose objective function is the difference of two convex functions. The classical DC Algorithm (DCA) is well-known for solving this kind of problems, which…

Optimization and Control · Mathematics 2022-04-27 Yu You , Yi-Shuai Niu

In this work, we study decentralized convex constrained optimization problems in networks. We focus on the dual averaging-based algorithmic framework that is well-documented to be superior in handling constraints and complex communication…

Optimization and Control · Mathematics 2022-08-16 Changxin Liu , Yang Shi , Huiping Li , Wenli Du

This paper discusses a deterministic clustering approach to capacitated resource allocation problems. In particular, the Deterministic Annealing (DA) algorithm from the data-compression literature, which bears a distinct analogy to the…

Optimization and Control · Mathematics 2016-06-22 Mayank Baranwal , Srinivasa M. Salapaka

This paper introduces an efficient perturbed difference-of-convex algorithm (pDCA) for computing d-stationary points of an important class of structured nonsmooth difference-of-convex problems. Compared to the principal algorithms…

Optimization and Control · Mathematics 2026-01-07 Zhangcheng Feng , Yancheng Yuan

We consider a difference-of-convex formulation where one of the terms is allowed to be hypoconvex (or weakly convex). We first examine the precise behavior of a single iteration of the Difference-of-Convex algorithm (DCA), giving a tight…

Optimization and Control · Mathematics 2024-03-26 Teodor Rotaru , Panagiotis Patrinos , François Glineur

Convex clustering is a convex relaxation of the $k$-means and hierarchical clustering. It involves solving a convex optimization problem with the objective function being a squared error loss plus a fusion penalty that encourages the…

Methodology · Statistics 2024-10-10 Qiang Sun , Archer Gong Zhang , Chenyu Liu , Kean Ming Tan

Decentralized optimization, particularly the class of decentralized composite convex optimization (DCCO) problems, has found many applications. Due to ubiquitous communication congestion and random dropouts in practice, it is highly…

Optimization and Control · Mathematics 2022-10-12 Changxin Liu , Zirui Zhou , Jian Pei , Yong Zhang , Yang Shi

We develop two penalty based difference of convex (DC) algorithms for solving chance constrained programs. First, leveraging a rank-based DC decomposition of the chance constraint, we propose a proximal penalty based DC algorithm in the…

Optimization and Control · Mathematics 2026-03-16 Zhiping Li , Nan Jiang , Rujun Jiang

Difference-of-Convex Algorithm (DCA) is a well-known nonconvex optimization algorithm for minimizing a nonconvex function that can be expressed as the difference of two convex ones. Many famous existing optimization algorithms, such as SGD…

Machine Learning · Computer Science 2024-12-16 Youran Sun , Yihua Liu , Yi-Shuai Niu

Block coordinate descent (BCD) methods are prevalent in large scale optimization problems due to the low memory and computational costs per iteration, the predisposition to parallelization, and the ability to exploit the structure of the…

Optimization and Control · Mathematics 2025-10-31 Luis Briceño-Arias , Paulo Gonçalves , Guillaume Lauga , Nelly Pustelnik , Elisa Riccietti

In recent years, spectral clustering has become a standard method for data analysis used in a broad range of applications. In this paper we propose a new class of algorithms for multiway spectral clustering based on optimization of a…

Machine Learning · Computer Science 2016-05-05 James Voss , Mikhail Belkin , Luis Rademacher

Deep learning and especially the use of Deep Neural Networks (DNNs) provides impressive results in various regression and classification tasks. However, to achieve these results, there is a high demand for computing and storing resources.…

Machine Learning · Computer Science 2021-07-21 Erion-Vasilis Pikoulis , Christos Mavrokefalidis , Aris S. Lalos

For the degree corrected stochastic block model in the presence of arbitrary or even adversarial outliers, we develop a convex-optimization-based clustering algorithm that includes a penalization term depending on the positive deviation of…

Machine Learning · Computer Science 2019-06-11 Xin Qian , Yudong Chen , Andreea Minca