English
Related papers

Related papers: Scalable Iterative Algorithm for Robust Subspace C…

200 papers

Spectral clustering approaches have led to well-accepted algorithms for finding accurate clusters in a given dataset. However, their application to large-scale datasets has been hindered by computational complexity of eigenvalue…

Machine Learning · Computer Science 2016-03-17 Shahzad Bhatti , Carolyn Beck , Angelia Nedic

Clustering algorithms are iterative and have complex data access patterns that result in many small random memory accesses. The performance of parallel implementations suffer from synchronous barriers for each iteration and skewed…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-19 Disa Mhembere , Da Zheng , Carey E. Priebe , Joshua T. Vogelstein , Randal Burns

Clustering, a fundamental activity in unsupervised learning, is notoriously difficult when the feature space is high-dimensional. Fortunately, in many realistic scenarios, only a handful of features are relevant in distinguishing clusters.…

Machine Learning · Statistics 2020-10-23 Zhiyue Zhang , Kenneth Lange , Jason Xu

This paper aims at developing a clustering approach with spectral images directly from CASSI compressive measurements. The proposed clustering method first assumes that compressed measurements lie in the union of multiple low-dimensional…

Image and Video Processing · Electrical Eng. & Systems 2019-11-06 Jianchen Zhu , Tong Zhang , Shengjie Zhao , Carlos Hinojosa , Zengli Liu , Gonzalo R. Arce

This work considers the decentralized successive convex approximation (SCA) method for minimizing stochastic non-convex objectives subject to convex constraints, along with possibly non-smooth convex regularizers. Although SCA has been…

Optimization and Control · Mathematics 2024-05-29 Basil M. Idrees , Shivangi Dubey Sharma , Ketan Rajawat

The cyclic block coordinate descent-type (CBCD-type) methods, which performs iterative updates for a few coordinates (a block) simultaneously throughout the procedure, have shown remarkable computational performance for solving strongly…

Optimization and Control · Mathematics 2017-11-23 Xingguo Li , Tuo Zhao , Raman Arora , Han Liu , Mingyi Hong

In recent work, robust Principal Components Analysis (PCA) has been posed as a problem of recovering a low-rank matrix $\mathbf{L}$ and a sparse matrix $\mathbf{S}$ from their sum, $\mathbf{M}:= \mathbf{L} + \mathbf{S}$ and a provably exact…

Information Theory · Computer Science 2023-07-19 Jinchun Zhan , Namrata Vaswani

Stochastic Optimization is a cornerstone of operations research, providing a framework to solve optimization problems under uncertainty. Despite the development of numerous algorithms to tackle these problems, several persistent challenges…

Optimization and Control · Mathematics 2025-03-28 Di Zhang , Suvrajeet Sen

Sparse principal component analysis (PCA), an important variant of PCA, attempts to find sparse loading vectors when conducting dimension reduction. This paper considers the nonsmooth Riemannian optimization problem associated with the…

Optimization and Control · Mathematics 2021-09-03 Wen Huang , Ke Wei

As in other estimation scenarios, likelihood based estimation in the normal mixture set-up is highly non-robust against model misspecification and presence of outliers (apart from being an ill-posed optimization problem). A robust…

Methodology · Statistics 2023-12-20 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

One key challenge for solving a general stochastic optimization problem with expectations in the objective and constraint functions using ordinary stochastic iterative methods lies in the infeasibility issue caused by the randomness over…

Information Theory · Computer Science 2019-08-30 Chencheng Ye , Ying Cui

Clustering algorithms remain valuable tools for grouping and summarizing the most important aspects of data. Example areas where this is the case include image segmentation, dimension reduction, signals analysis, model order reduction,…

Numerical Analysis · Mathematics 2024-12-24 Guy B. Oldaker , Maria Emelianenko

Most multi-view clustering methods are limited by shallow models without sound nonlinear information perception capability, or fail to effectively exploit complementary information hidden in different views. To tackle these issues, we…

Machine Learning · Computer Science 2022-10-14 Fu Lele , Zhang Lei , Yang Jinghua , Chen Chuan , Zhang Chuanfu , Zheng Zibin

Clustering is one of the major tasks in data mining. In the last few years, Clustering of spatial data has received a lot of research attention. Spatial databases are components of many advanced information systems like geographic…

Databases · Computer Science 2012-06-04 Mohamed A. El-Zawawy

With the aggressive scaling of VLSI technology, the explosion of layout patterns creates a critical bottleneck for DFM applications like OPC. Pattern clustering is essential to reduce data complexity, yet existing methods struggle with…

Hardware Architecture · Computer Science 2025-12-16 Shuo Liu

We introduce primed-PCA (pPCA), a two-step algorithm for speeding up the approximation of principal components. This algorithm first runs any approximate-PCA method to get an initial estimate of the principal components (priming), and then…

Machine Learning · Computer Science 2022-05-23 Bálint Máté , François Fleuret

We present an algorithm for recovering planted solutions in two well-known models, the stochastic block model and planted constraint satisfaction problems, via a common generalization in terms of random bipartite graphs. Our algorithm…

Data Structures and Algorithms · Computer Science 2015-04-30 Vitaly Feldman , Will Perkins , Santosh Vempala

This paper addresses the optimization problem of minimizing non-convex continuous functions, which is relevant in the context of high-dimensional machine learning applications characterized by over-parametrization. We analyze a randomized…

Machine Learning · Computer Science 2025-02-28 Jim Zhao , Aurelien Lucchi , Nikita Doikov

Identifying spatially contiguous clusters and repeated spatial patterns (RSP) characterized by similar underlying distributions that are spatially apart is a key challenge in modern spatial statistics. Existing constrained clustering…

Methodology · Statistics 2026-04-23 Rajitha Senanayake , Pratheepa Jeganathan

For multivariate data, tandem clustering is a well-known technique aiming to improve cluster identification through initial dimension reduction. Nevertheless, the usual approach using principal component analysis (PCA) has been criticized…

Methodology · Statistics 2024-03-26 Andreas Alfons , Aurore Archimbaud , Klaus Nordhausen , Anne Ruiz-Gazen