English
Related papers

Related papers: Regularized Sparse Optimal Discriminant Clustering

200 papers

This paper proposes a novel technique called "successive stochastic smoothing" that optimizes nonsmooth and discontinuous functions while considering various constraints. Our methodology enables local and global optimization, making it a…

Optimization and Control · Mathematics 2023-08-17 Vladimir Norkin , Alois Pichler , Anton Kozyriev

The stochastic block model (SBM) is a popular framework for studying community detection in networks. This model is limited by the assumption that all nodes in the same community are statistically equivalent and have equal expected degrees.…

Statistics Theory · Mathematics 2016-01-20 Yudong Chen , Xiaodong Li , Jiaming Xu

Cluster analysis, which focuses on the grouping and categorization of similar elements, is widely used in various fields of research. A novel and fast clustering algorithm, fission clustering algorithm, is proposed in recent year. In this…

Machine Learning · Computer Science 2021-02-09 Yu Han , Shizhan Lu , Haiyan Xu

Joint clustering and feature learning methods have shown remarkable performance in unsupervised representation learning. However, the training schedule alternating between feature clustering and network parameters update leads to unstable…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Xiaohang Zhan , Jiahao Xie , Ziwei Liu , Yew Soon Ong , Chen Change Loy

This paper provides a theoretical and numerical investigation of a penalty decomposition scheme for the solution of optimization problems with geometric constraints. In particular, we consider some situations where parts of the constraints…

Optimization and Control · Mathematics 2023-03-23 Matteo Lapucci , Christian Kanzow

In this study, we consider unsupervised clustering of categorical vectors that can be of different size using mixture. We use likelihood maximization to estimate the parameters of the underlying mixture model and a penalization technique to…

Statistics Theory · Mathematics 2017-09-08 Esther Derman , Erwan Le Pennec

Stochastic Dominance (SD) theory provides a rigorous framework for selecting superior assets tailored to the asset allocation needs of investors with varying risk preferences (i.e., risk-averse, risk-seeking, and risk-neutral). However,…

Machine Learning · Statistics 2026-05-26 Hua Li , Xue Jia , Yilin Kang , Wing-Keung Wong

We propose Ordered Subspace Clustering (OSC) to segment data drawn from a sequentially ordered union of subspaces. Similar to Sparse Subspace Clustering (SSC) we formulate the problem as one of finding a sparse representation but include an…

Computer Vision and Pattern Recognition · Computer Science 2015-04-17 Stephen Tierney , Yi Guo , Junbin Gao

Sparse linear prediction methods suffer from decreased prediction accuracy when the predictor variables have cluster structure (e.g. there are highly correlated groups of variables). To improve prediction accuracy, various methods have been…

Machine Learning · Statistics 2022-02-03 Rebecca Marion , Johannes Lederer , Bernadette Govaerts , Rainer von Sachs

Cluster analysis requires many decisions: the clustering method and the implied reference model, the number of clusters and, often, several hyper-parameters and algorithms' tunings. In practice, one produces several partitions, and a final…

Machine Learning · Statistics 2023-08-14 Luca Coraggio , Pietro Coretto

We study the large sample behavior of a convex clustering framework, which minimizes the sample within cluster sum of squares under an~$\ell_1$ fusion constraint on the cluster centroids. This recently proposed approach has been gaining in…

Methodology · Statistics 2016-12-30 Peter Radchenko , Gourab Mukherjee

In this paper, we introduce a neural network framework for semi-supervised clustering (SSC) with pairwise (must-link or cannot-link) constraints. In contrast to existing approaches, we decompose SSC into two simpler classification…

Machine Learning · Computer Science 2020-01-22 Marek Śmieja , Łukasz Struski , Mário A. T. Figueiredo

This paper aims at developing a clustering approach with spectral images directly from CASSI compressive measurements. The proposed clustering method first assumes that compressed measurements lie in the union of multiple low-dimensional…

Image and Video Processing · Electrical Eng. & Systems 2019-11-06 Jianchen Zhu , Tong Zhang , Shengjie Zhao , Carlos Hinojosa , Zengli Liu , Gonzalo R. Arce

This paper introduces a novel approach to solving multi-block nonconvex composite optimization problems through a proximal linearized Alternating Direction Method of Multipliers (ADMM). This method incorporates an Increasing Penalization…

Optimization and Control · Mathematics 2025-04-01 Ganzhao Yuan

Co-Clustering, the problem of simultaneously identifying clusters across multiple aspects of a data set, is a natural generalization of clustering to higher-order structured data. Recent convex formulations of bi-clustering and tensor…

Machine Learning · Statistics 2019-07-30 Michael Weylandt

In this work, we study the stochastic optimal control problem (SOC) mainly from the probabilistic view point, i.e. via the Stochastic Maximum principle (SMP) \cite{Peng4}. We adopt the sample-wise backpropagation scheme proposed in…

Optimization and Control · Mathematics 2025-06-17 Hui Sun , Feng Bao

With the aggressive scaling of VLSI technology, the explosion of layout patterns creates a critical bottleneck for DFM applications like OPC. Pattern clustering is essential to reduce data complexity, yet existing methods struggle with…

Hardware Architecture · Computer Science 2025-12-16 Shuo Liu

In this paper, we study high-dimensional sparse Quadratic Discriminant Analysis (QDA) and aim to establish the optimal convergence rates for the classification error. Minimax lower bounds are established to demonstrate the necessity of…

Methodology · Statistics 2019-12-09 T. Tony Cai , Linjun Zhang

We study here the semi-supervised $k$-clustering problem where information is available on whether pairs of objects are in the same or in different clusters. This information is either available with certainty or with a limited level of…

Machine Learning · Computer Science 2024-10-21 Philipp Baumann , Dorit S. Hochbaum

Traditional clustering methods often perform clustering with low-level indiscriminative representations and ignore relationships between patterns, resulting in slight achievements in the era of deep learning. To handle this problem, we…

Machine Learning · Computer Science 2019-05-07 Jianlong Chang , Yiwen Guo , Lingfeng Wang , Gaofeng Meng , Shiming Xiang , Chunhong Pan