English
Related papers

Related papers: Noisy Sparse Subspace Clustering

200 papers

Attribute-efficient PAC learning of sparse halfspaces has been a fundamental problem in machine learning theory. In recent years, machine learning algorithms are faced with prevalent data corruptions or even malicious attacks. It is of…

Machine Learning · Computer Science 2026-03-06 Shiwei Zeng , Jie Shen

This work studies the robust subspace tracking (ST) problem. Robust ST can be simply understood as a (slow) time-varying subspace extension of robust PCA. It assumes that the true data lies in a low-dimensional subspace that is either fixed…

Machine Learning · Computer Science 2022-09-01 Praneeth Narayanamurthy , Namrata Vaswani

We study the problem of identifying a small set $k\sim n^\theta$, $0<\theta<1$, of infected individuals within a large population of size $n$ by testing groups of individuals simultaneously. All tests are conducted concurrently. The goal is…

Discrete Mathematics · Computer Science 2025-03-05 Amin Coja-Oghlan , Max Hahn-Klimroth , Lukas Hintze , Dominik Kaaser , Lena Krieg , Maurice Rolvien , Olga Scheftelowitsch

There are synergies of research interests and industrial efforts in modeling fairness and correcting algorithmic bias in machine learning. In this paper, we present a scalable algorithm for spectral clustering (SC) with group fairness…

Machine Learning · Computer Science 2023-04-18 Ji Wang , Ding Lu , Ian Davidson , Zhaojun Bai

Clustering is a ubiquitous problem in data science and signal processing. In many applications where we observe noisy signals, it is common practice to first denoise the data, perhaps using wavelet denoising, and then to apply a clustering…

Machine Learning · Statistics 2021-11-03 Michael Weylandt , T. Mitchell Roddenberry , Genevera I. Allen

Subspace clustering (SC) algorithms utilize the union of subspaces model to cluster data points according to the subspaces from which they are drawn. To better address separability of subspaces and robustness to noise we propose a wavelet…

Machine Learning · Computer Science 2024-06-07 Ivica Kopriva , Damir Sersic

Image classification systems recently made a giant leap with the advancement of deep neural networks. However, these systems require an excessive amount of labeled data to be adequately trained. Gathering a correctly annotated dataset is…

Machine Learning · Computer Science 2021-01-19 Görkem Algan , Ilkay Ulusoy

There has been a surge in the number of large and flat data sets - data sets containing a large number of features and a relatively small number of observations - due to the growing ability to collect and store information in medical…

Machine Learning · Statistics 2017-07-05 Hongyang Zhang , Ruben H. Zamar

We introduce a novel framework for clustering a collection of tall matrices based on their column spaces, a problem we term Subspace Clustering of Subspaces (SCoS). Unlike traditional subspace clustering methods that assume vectorized data,…

Machine Learning · Computer Science 2025-09-30 Paris A. Karakasis , Nicholas D. Sidiropoulos

Dimension reduction is widely regarded as an effective way for decreasing the computation, storage and communication loads of data-driven intelligent systems, leading to a growing demand for statistical methods that allow analysis (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Guangcan Liu , Zhao Zhang , Qingshan Liu , Kongkai Xiong

In this paper, we propose an efficient clustering technique to solve the problem of clustering in the presence of obstacles. The proposed algorithm divides the spatial area into rectangular cells. Each cell is associated with statistical…

Databases · Computer Science 2009-09-25 Mohamed E. El-Sharkawi , Mohamed A. El-Zawawy

This paper is concerned with computationally efficient learning of homogeneous sparse halfspaces in $\mathbb{R}^d$ under noise. Though recent works have established attribute-efficient learning algorithms under various types of label noise…

Machine Learning · Statistics 2021-03-03 Jie Shen , Chicheng Zhang

In this paper, we propose a simple algorithm to cluster nonnegative data lying in disjoint subspaces. We analyze its performance in relation to a certain measure of correlation between said subspaces. We use our clustering algorithm to…

Machine Learning · Statistics 2020-09-04 C. Strohmeier , D. Needell

Sparse coding is an unsupervised learning algorithm that learns a succinct high-level representation of the inputs given only unlabeled data; it represents each input as a sparse linear combination of a set of basis functions. Originally…

Machine Learning · Computer Science 2012-06-26 Roger Grosse , Rajat Raina , Helen Kwong , Andrew Y. Ng

In this paper, we consider batch supervised learning where an adversary is allowed to corrupt instances with arbitrarily large noise. The adversary is allowed to corrupt any $l$ features in each instance and the adversary can change their…

Machine Learning · Computer Science 2019-07-30 Chris Mesterharm , Rauf Izmailov , Scott Alexander , Simon Tsang

Sparse subspace clustering (SSC) relies on sparse regression for accurate neighbor identification. Inspired by recent progress in compressive sensing, this paper proposes a new sparse regression scheme for SSC via two-step reweighted…

Information Theory · Computer Science 2019-07-18 Jwo-Yuh Wu , Liang-Chi Huang , Ming-Hsun Yang , Chun-Hung Liu

In this paper we initiate the study of whether or not sparse estimation tasks can be performed efficiently in high dimensions, in the robust setting where an $\eps$-fraction of samples are corrupted adversarially. We study the natural…

Machine Learning · Computer Science 2017-03-02 Jerry Li

The problem of structured noise suppression is addressed by i)modelling the subspaces hosting the components of the signal conveying the information and ii)applying a non-extensive nonlinear technique for effecting the right separation.…

Mathematical Physics · Physics 2015-05-13 Zhiqiang Xu , Laura Rebollo-Neira , A. Plastino

Semi-supervised clustering seeks to augment traditional clustering methods by incorporating side information provided via human expertise in order to increase the semantic meaningfulness of the resulting clusters. However, most current…

Machine Learning · Computer Science 2014-02-17 Caiming Xiong , David Johnson , Jason J. Corso

We develop an efficient and robust high-dimensional sparse Fourier algorithm for noisy samples. Earlier in the paper ``Multi-dimensional sublinear sparse Fourier algorithm" (2016), an efficient sparse Fourier algorithm with $\Theta(ds \log…

Numerical Analysis · Mathematics 2019-07-09 Bosu Choi , Andrew Christlieb , Yang Wang