English
Related papers

Related papers: Scalable Sparse Subspace Clustering via Ordered We…

200 papers

Subspace clustering aims to group data points into multiple clusters of which each corresponds to one subspace. Most existing subspace clustering approaches assume that input data lie on linear subspaces. In practice, however, this…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Liangli Zhen , Dezhong Peng , Wei Wang , Xin Yao

Sparse Subspace Clustering (SSC) has achieved state-of-the-art clustering quality by performing spectral clustering over a $\ell^{1}$-norm based similarity graph. However, SSC is a transductive method which does not handle with the data not…

Machine Learning · Computer Science 2014-09-11 Xi Peng , Lei Zhang , Zhang Yi

Algebraic Subspace Clustering (ASC) is a simple and elegant method based on polynomial fitting and differentiation for clustering noiseless data drawn from an arbitrary union of subspaces. In practice, however, ASC is limited to…

Computer Vision and Pattern Recognition · Computer Science 2015-10-16 Manolis C. Tsakiris , Rene Vidal

The problem of dimension reduction is of increasing importance in modern data analysis. In this paper, we consider modeling the collection of points in a high dimensional space as a union of low dimensional subspaces. In particular we…

Machine Learning · Statistics 2020-06-12 Weiwei Li , Jan Hannig , Sayan Mukherjee

Iteratively reweighted $\ell_1$ algorithm is a popular algorithm for solving a large class of optimization problems whose objective is the sum of a Lipschitz differentiable loss function and a possibly nonconvex sparsity inducing…

Optimization and Control · Mathematics 2017-11-21 Peiran Yu , Ting Kei Pong

Sparse clustering, which aims to find a proper partition of an extremely high-dimensional data set with redundant noise features, has been attracted more and more interests in recent years. The existing studies commonly solve the problem in…

Machine Learning · Statistics 2019-02-25 Xiangyu Chang , Yu Wang , Rongjian Li , Zongben Xu

The recovery of sparse data is at the core of many applications in machine learning and signal processing. While such problems can be tackled using $\ell_1$-regularization as in the LASSO estimator and in the Basis Pursuit approach,…

Optimization and Control · Mathematics 2021-11-15 Christian Kümmerle , Claudio Mayrink Verdun , Dominik Stöger

Clustering can be defined as the process of assembling objects into a number of groups whose elements are similar to each other in some manner. As a technique that is used in many domains, such as face clustering, plant categorization,…

Machine Learning · Computer Science 2022-04-05 Mehmet F. Demirel , Enrico Au-Yeung

Deepening and widening convolutional neural networks (CNNs) significantly increases the number of trainable weight parameters by adding more convolutional layers and feature maps per layer, respectively. By imposing inter- and intra-group…

Computer Vision and Pattern Recognition · Computer Science 2019-12-18 Kevin Bui , Fredrick Park , Shuai Zhang , Yingyong Qi , Jack Xin

In this paper, we propose a novel algorithm for analysis-based sparsity reconstruction. It can solve the generalized problem by structured sparsity regularization with an orthogonal basis and total variation regularization. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2015-04-29 Chen Chen , Junzhou Huang , Lei He , Hongsheng Li

This paper focuses on the sparse subspace clustering problem, and develops an online algorithmic solution to cluster data points on-the-fly, without revisiting the whole dataset. The strategy involves an online solution of a sparse…

Optimization and Control · Mathematics 2024-07-16 Liam Madden , Stephen Becker , Emiliano Dall'Anese

Spectral clustering is a celebrated algorithm that partitions objects based on pairwise similarity information. While this approach has been successfully applied to a variety of domains, it comes with limitations. The reason is that there…

Statistics Theory · Mathematics 2018-05-24 Kwangjun Ahn , Kangwook Lee , Changho Suh

In this paper, a novel unsupervised low-rank representation model, i.e., Auto-weighted Low-Rank Representation (ALRR), is proposed to construct a more favorable similarity graph (SG) for clustering. In particular, ALRR enhances the…

Machine Learning · Computer Science 2021-04-27 Zhiqiang Fu , Yao Zhao , Dongxia Chang , Xingxing Zhang , Yiming Wang

We consider a new family of regularizers, termed {\it weighted sorted $\ell_1$ norms} (WSL1), which generalizes the recently introduced {\it octagonal shrinkage and clustering algorithm for regression} (OSCAR) and also contains the $\ell_1$…

Computer Vision and Pattern Recognition · Computer Science 2014-04-14 Xiangrong Zeng , Mário A. T. Figueiredo

This study concentrates on clustering problems and aims to find compact clusters that are informative regarding the outcome variable. The main goal is partitioning data points so that observations in each cluster are similar and the outcome…

Neural and Evolutionary Computing · Computer Science 2022-01-27 Zahra Ghasemi , Hadi Akbarzadeh Khorshidi , Uwe Aickelin

The $\ell_1$-penalized method, or the Lasso, has emerged as an important tool for the analysis of large data sets. Many important results have been obtained for the Lasso in linear regression which have led to a deeper understanding of…

Machine Learning · Statistics 2011-12-30 Jian Huang , Cun-Hui Zhang

It is now well understood that $\ell_1$ minimization algorithm is able to recover sparse signals from incomplete measurements [2], [1], [3] and sharp recoverable sparsity thresholds have also been obtained for the $\ell_1$ minimization…

Probability · Mathematics 2009-04-07 Weiyu Xu , M. Amin Khajehnejad , Salman Avestimehr , Babak Hassibi

We address the task of identifying densely connected subsets of multivariate Gaussian random variables within a graphical model framework. We propose two novel estimators based on the Ordered Weighted $\ell_1$ (OWL) norm: 1) The Graphical…

Machine Learning · Statistics 2020-11-20 Cody Mazza-Anthony , Bogdan Mazoure , Mark Coates

In recent years, stochastic gradient descent (SGD) methods and randomized linear algebra (RLA) algorithms have been applied to many large-scale problems in machine learning and data analysis. We aim to bridge the gap between these two…

Optimization and Control · Mathematics 2017-07-11 Jiyan Yang , Yin-Lam Chow , Christopher Ré , Michael W. Mahoney

The iteratively reweighted least squares method (IRLS) is a popular technique used in practice for solving regression problems. Various versions of this method have been proposed, but their theoretical analyses failed to capture the good…

Data Structures and Algorithms · Computer Science 2019-07-11 Alina Ene , Adrian Vladu