English
Related papers

Related papers: Isotropic PCA and Affine-Invariant Clustering

200 papers

Clustering algorithms are fundamental tools across many fields, with density-based methods offering particular advantages in identifying arbitrarily shaped clusters and handling noise. However, their effectiveness is often limited by the…

Machine Learning · Computer Science 2025-12-01 Meysam Shirdel Bilehsavar , Razieh Ghaedi , Samira Seyed Taheri , Xinqi Fan , Christian O'Reilly

Image tile-based approaches are popular in many image processing applications such as denoising (e.g., non-local means). A key step in their use is grouping the images into clusters, which usually proceeds iteratively splitting the images…

Image and Video Processing · Electrical Eng. & Systems 2025-12-09 Tharindu Wickremasinghe , Marco F. Duarte

Clustering in image analysis is a central technique that allows to classify elements of an image. We describe a simple clustering technique that uses the method of similarity matrices. We expand upon recent results in spectral analysis for…

Statistics Theory · Mathematics 2022-03-23 Denis Gaidashev , Ralf Pihlström , Martin Ryner

Learning augmented is a machine learning concept built to improve the performance of a method or model, such as enhancing its ability to predict and generalize data or features, or testing the reliability of the method by introducing noise…

Machine Learning · Computer Science 2024-01-09 Issam K. O Jabari , Shofiyah , Pradiptya Kahvi S , Novi Nur Putriwijaya , Novanto Yudistira

Sparse subspace clustering (SSC) is a state-of-the-art method for segmenting a set of data points drawn from a union of subspaces into their respective subspaces. It is now well understood that SSC produces subspace-preserving data affinity…

Signal Processing · Electrical Eng. & Systems 2018-11-22 Chun-Guang Li , Chong You , René Vidal

Commonly used in computer vision and other applications, robust PCA represents an algorithmic attempt to reduce the sensitivity of classical PCA to outliers. The basic idea is to learn a decomposition of some data matrix of interest into…

Computer Vision and Pattern Recognition · Computer Science 2016-10-10 Tae-Hyun Oh , Yasuyuki Matsushita , In So Kweon , David Wipf

We consider the following multi-component sparse PCA problem: given a set of data points, we seek to extract a small number of sparse components with disjoint supports that jointly capture the maximum possible variance. These components can…

We give the first outlier-robust efficient algorithm for clustering a mixture of $k$ statistically separated d-dimensional Gaussians (k-GMMs). Concretely, our algorithm takes input an $\epsilon$-corrupted sample from a $k$-GMM and whp in…

Data Structures and Algorithms · Computer Science 2020-12-15 Ainesh Bakshi , Pravesh Kothari

In this paper we propose a new iterative algorithm to solve the fair PCA (FPCA) problem. We start with the max-min fair PCA formulation originally proposed in [1] and derive a simple and efficient iterative algorithm which is based on the…

Machine Learning · Statistics 2023-05-11 Prabhu Babu , Petre Stoica

In this work, we propose a new data visualization and clustering technique for discovering discriminative structures in high-dimensional data. This technique, referred to as cPCA++, utilizes the fact that the interesting features of a…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Ronald Salloum , C. -C. Jay Kuo

Consider a two-class clustering problem where we observe $X_i = \ell_i \mu + Z_i$, $Z_i \stackrel{iid}{\sim} N(0, I_p)$, $1 \leq i \leq n$. The feature vector $\mu\in R^p$ is unknown but is presumably sparse. The class labels…

Statistics Theory · Mathematics 2016-06-09 Jiashun Jin , Zheng Tracy Ke , Wanjie Wang

Clustering algorithms remain valuable tools for grouping and summarizing the most important aspects of data. Example areas where this is the case include image segmentation, dimension reduction, signals analysis, model order reduction,…

Numerical Analysis · Mathematics 2024-12-24 Guy B. Oldaker , Maria Emelianenko

This paper presents a remarkably simple, yet powerful, algorithm termed Coherence Pursuit (CoP) to robust Principal Component Analysis (PCA). As inliers lie in a low dimensional subspace and are mostly correlated, an inlier is likely to…

Machine Learning · Computer Science 2017-11-28 Mostafa Rahmani , George Atia

Unsupervised dictionary learning has been a key component in state-of-the-art computer vision recognition architectures. While highly effective methods exist for patch-based dictionary learning, these methods may learn redundant features…

Computer Vision and Pattern Recognition · Computer Science 2013-02-21 Yangqing Jia , Oriol Vinyals , Trevor Darrell

This paper considers the estimation and inference of the low-rank components in high-dimensional matrix-variate factor models, where each dimension of the matrix-variates ($p \times q$) is comparable to or greater than the number of…

Statistics Theory · Mathematics 2022-10-20 Elynn Y. Chen , Jianqing Fan

Pairwise clustering, in general, partitions a set of items via a known similarity function. In our treatment, clustering is modeled as a transductive prediction problem. Thus rather than beginning with a known similarity function, the…

Machine Learning · Computer Science 2017-06-21 Stephen Pasteris , Fabio Vitale , Claudio Gentile , Mark Herbster

A limitation of many clustering algorithms is the requirement to tune adjustable parameters for each application or even for each dataset. Some techniques require an \emph{a priori} estimate of the number of clusters while density-based…

Methodology · Statistics 2016-05-20 Jeremy F. Magland , Alex H. Barnett

Subspace clustering is to find underlying low-dimensional subspaces and cluster the data points correctly. In this paper, we propose a novel multi-view subspace clustering method. Most existing methods suffer from two critical issues.…

Artificial Intelligence · Computer Science 2022-05-24 Mengyuan Zhang , Kai Liu

Sparse Principal Component Analysis (sPCA) is a cardinal technique for obtaining combinations of features, or principal components (PCs), that explain the variance of high-dimensional datasets in an interpretable manner. This involves…

Optimization and Control · Mathematics 2025-12-02 Ryan Cory-Wright , Jean Pauphilet

We consider the problem of principal component analysis (PCA) in the presence of outliers. Given a matrix $A$ ($d \times n$) and parameters $k, m$, the goal is to remove a set of at most $m$ columns of $A$ (known as outliers), so as to…

Data Structures and Algorithms · Computer Science 2018-05-14 Aditya Bhaskara , Srivatsan Kumar