English
Related papers

Related papers: The Boosted DC Algorithm for Clustering with Const…

200 papers

With the development of Big data technology, data analysis has become increasingly important. Traditional clustering algorithms such as K-means are highly sensitive to the initial centroid selection and perform poorly on non-convex…

Machine Learning · Computer Science 2023-07-28 Ying Xiao , Hou-biao Li , Yu-pu Zhang

This paper considers the problem of minimizing an expectation function over a closed convex set, coupled with a {\color{black} functional or expectation} constraint on either decision variables or problem parameters. We first present a new…

Optimization and Control · Mathematics 2020-10-05 Guanghui Lan , Zhiqiang Zhou

The (constrained) minimization of a ratio of set functions is a problem frequently occurring in clustering and community detection. As these optimization problems are typically NP-hard, one uses convex or spectral relaxations in practice.…

Machine Learning · Statistics 2013-06-17 Thomas Bühler , Syama Sundar Rangapuram , Simon Setzer , Matthias Hein

The high dimensionality of hyperspectral images often results in the degradation of clustering performance. Due to the powerful ability of deep feature extraction and non-linear feature representation, the clustering algorithm based on deep…

Machine Learning · Computer Science 2019-04-02 Jinguang Sun , Wanli Wang , Xian Wei , Li Fang , Xiaoliang Tang , Yusheng Xu , Hui Yu , Wei Yao

Block coordinate descent methods and stochastic subgradient methods have been extensively studied in optimization and machine learning. By combining randomized block sampling with stochastic subgradient methods based on dual averaging, we…

Optimization and Control · Mathematics 2015-09-16 Qi Deng , Guanghui Lan , Anand Rangarajan

Convex clustering has recently garnered increasing interest due to its attractive theoretical and computational properties, but its merits become limited in the face of high-dimensional data. In such settings, pairwise affinity terms that…

Methodology · Statistics 2021-04-02 Saptarshi Chakraborty , Jason Xu

The recently developed Distributed Block Proximal Method, for solving stochastic big-data convex optimization problems, is studied in this paper under the assumption of constant stepsizes and strongly convex (possibly non-smooth) local…

Optimization and Control · Mathematics 2020-03-06 Francesco Farina , Giuseppe Notarstefano

The stochastic gradient (SG) method can minimize an objective function composed of a large number of differentiable functions, or solve a stochastic optimization problem, to a moderate accuracy. The block coordinate descent/update (BCD)…

Optimization and Control · Mathematics 2015-11-23 Yangyang Xu , Wotao Yin

This paper is devoted to a new modification of a recently proposed adaptive stochastic mirror descent algorithm for constrained convex optimization problems in the case of several convex functional constraints. Algorithms, standard and its…

Optimization and Control · Mathematics 2020-01-22 Mohammad S. Alkousa

Cardinality constraints in optimization are commonly of $L^0$-type, and they lead to sparsely supported optimizers. An efficient way of dealing with these constraints algorithmically, when the objective functional is convex, is…

Optimization and Control · Mathematics 2026-02-26 Bastian Dittrich , Evelyn Herberg , Roland Herzog , Georg Müller

Boosting has attracted much research attention in the past decade. The success of boosting algorithms may be interpreted in terms of the margin theory. Recently it has been shown that generalization error of classifiers can be obtained by…

Machine Learning · Computer Science 2010-01-06 Chunhua Shen , Hanxi Li

We consider nonconvex constrained optimization problems and propose a new approach to the convergence analysis based on penalty functions. We make use of classical penalty functions in an unconventional way, in that penalty functions only…

Optimization and Control · Mathematics 2020-06-02 Francisco Facchinei , Vyacheslav Kungurtsev , Lorenzo Lampariello , Gesualdo Scutari

When it comes to clustering nonconvex shapes, two paradigms are used to find the most suitable clustering: minimum cut and maximum density. The most popular algorithms incorporating these paradigms are Spectral Clustering and DBSCAN. Both…

Machine Learning · Computer Science 2019-07-02 Sibylle Hess , Wouter Duivesteijn , Philipp Honysz , Katharina Morik

This paper addresses a distributed convex optimization problem with a class of coupled constraints, which arise in a multi-agent system composed of multiple communities modeled by cliques. First, we propose a fully distributed…

Optimization and Control · Mathematics 2022-11-21 Yuto Watanabe , Kazunori Sakurama

Clustering, like covariate selection for classification, is an important step to compress and interpret the data. However, clustering of covariates is often performed independently of the classification step, which can lead to undesirable…

Computation · Statistics 2020-04-08 Daniel Andrade , Kenji Fukumizu , Yuzuru Okajima

This paper discusses distributed approaches for the solution of random convex programs (RCP). RCPs are convex optimization problems with a (usually large) number N of randomly extracted constraints; they arise in several applicative areas,…

Optimization and Control · Mathematics 2012-07-27 Luca Carlone , Vaibhav Srivastava , Francesco Bullo , Giuseppe Calafiore

We study decentralized asynchronous multiagent optimization over networks, modeled as static (possibly directed) graphs. The optimization problem consists of minimizing a (possibly nonconvex) smooth function--the sum of the agents' local…

Optimization and Control · Mathematics 2020-02-03 Ye Tian , Ying Sun , Gesualdo Scutari

The purpose of this paper is to present a boosted scaled subgradient-type method (BSSM) to minimize the difference of two convex functions (DC functions), where the first function is differentiable and the second one is possibly non-smooth.…

Optimization and Control · Mathematics 2021-03-22 Orizon P. Ferreira , Elianderson M. Santos , João Carlos O. Souza

Unsupervised Re-ID methods aim at learning robust and discriminative features from unlabeled data. However, existing methods often ignore the relationship between module parameters of Re-ID framework and feature distributions, which may…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Ziqi He , Mengjia Xue , Yunhao Du , Zhicheng Zhao , Fei Su

The problem of constrained clustering has attracted significant attention in the past decades. In this paper, we study the balanced $k$-center, $k$-median, and $k$-means clustering problems where the size of each cluster is constrained by…

Computational Geometry · Computer Science 2018-09-11 Hu Ding