English
Related papers

Related papers: Learning with $\ell^{0}$-Graph: $\ell^{0}$-Induced…

200 papers

Sparse representation learning has recently gained a great success in signal and image processing, thanks to recent advances in dictionary learning. To this end, the $\ell_0$-norm is often used to control the sparsity level. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Yuan Liu , Stéphane Canu , Paul Honeine , Su Ruan

In this paper we revisit under-determined linear systems of equations with sparse solutions. As is well known, these systems are among core mathematical problems of a very popular compressed sensing field. The popularity of the field as…

Information Theory · Computer Science 2013-06-18 Mihailo Stojnic

Stochastic optimization algorithms update models with cheap per-iteration costs sequentially, which makes them amenable for large-scale data analysis. Such algorithms have been widely studied for structured sparse models where the sparsity…

Machine Learning · Computer Science 2019-05-10 Baojian Zhou , Feng Chen , Yiming Ying

Standard probabilistic sparse coding assumes a Laplace prior, a linear mapping from latents to observables, and Gaussian observable distributions. We here derive a solely entropy-based learning objective for the parameters of standard…

Machine Learning · Statistics 2024-04-11 Dmytro Velychko , Simon Damm , Asja Fischer , Jörg Lücke

The nowadays massive amounts of generated and communicated data present major challenges in their processing. While capable of successfully classifying nonlinearly separable objects in various settings, subspace clustering (SC) methods…

Machine Learning · Computer Science 2015-10-07 Panagiotis A. Traganitis , Konstantinos Slavakis , Georgios B. Giannakis

Clustering can be defined as the process of assembling objects into a number of groups whose elements are similar to each other in some manner. As a technique that is used in many domains, such as face clustering, plant categorization,…

Machine Learning · Computer Science 2022-04-05 Mehmet F. Demirel , Enrico Au-Yeung

Current modularity-based community detection algorithms attempt to find cluster memberships that maximize modularity within a fixed graph topology. Diverging from this conventional approach, our work introduces a novel strategy that employs…

Data Analysis, Statistics and Probability · Physics 2024-02-27 Yongyu Wang , Shiqi Hao , Xiaoyang Wang , Xiaotian Zhuang

We introduce an extension to the CLRS algorithmic learning benchmark, prioritizing scalability and the utilization of sparse representations. Many algorithms in CLRS require global memory or information exchange, mirrored in its execution…

Machine Learning · Computer Science 2023-11-21 Julian Minder , Florian Grötschla , Joël Mathys , Roger Wattenhofer

Quantization can be used to form new vectors/matrices with shared values close to the original. In recent years, the popularity of scalar quantization for value-sharing applications has been soaring as it has been found huge utilities in…

Machine Learning · Computer Science 2019-12-11 Chen Wang , Xiaomei Yang , Shaomin Fei , Kai Zhou , Xiaofeng Gong , Miao Du , Ruisen Luo

Hypergraph-based machine learning methods are now widely recognized as important for modeling and using higher-order and multiway relationships between data objects. Local hypergraph clustering and semi-supervised learning specifically…

Social and Information Networks · Computer Science 2021-03-22 Meng Liu , Nate Veldt , Haoyu Song , Pan Li , David F. Gleich

Sparse Subspace Clustering (SSC) has been used extensively for subspace identification tasks due to its theoretical guarantees and relative ease of implementation. However SSC has quadratic computation and memory requirements with respect…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Stephen Tierney , Yi Guo , Junbin Gao

Dimensionality reduction, cluster analysis, and sparse representation are basic components in machine learning. However, their relationships have not yet been fully investigated. In this paper, we find that the spectral graph theory…

Computer Vision and Pattern Recognition · Computer Science 2017-05-22 Zhenfang Hu , Gang Pan , Yueming Wang , Zhaohui Wu

We consider the problem of spectral clustering under group fairness constraints, where samples from each sensitive group are approximately proportionally represented in each cluster. Traditional fair spectral clustering (FSC) methods…

Machine Learning · Computer Science 2023-11-27 Xiang Zhang , Qiao Wang

Graph-based semi-supervised learning (GSSL) has long been a hot research topic. Traditional methods are generally shallow learners, based on the cluster assumption. Recently, graph convolutional networks (GCNs) have become the predominant…

Machine Learning · Computer Science 2025-08-07 Zheng Wang , Hongming Ding , Li Pan , Jianhua Li , Zhiguo Gong , Philip S. Yu

Graph embedding learns low-dimensional representations for nodes in a graph and effectively preserves the graph structure. Recently, a significant amount of progress has been made toward this emerging research area. However, there are…

Machine Learning · Computer Science 2019-05-20 Yuan Yin , Zhewei Wei

Sparse Subspace Clustering (SSC) is one of the most popular methods for clustering data points into their underlying subspaces. However, SSC may suffer from heavy computational burden. Orthogonal Matching Pursuit applied on SSC accelerates…

Machine Learning · Computer Science 2020-01-08 Wenqi Zhu , Yuesheng Zhu , Li Zhong , Shuai Yang

Sparse Subspace Clustering (SSC) is a state-of-the-art method for clustering high-dimensional data points lying in a union of low-dimensional subspaces. However, while $\ell_1$ optimization-based SSC algorithms suffer from high…

Machine Learning · Computer Science 2018-02-14 Yanxi Chen , Gen Li , Yuantao Gu

Subspace clustering techniques have shown promise in hyperspectral image segmentation. The fundamental assumption in subspace clustering is that the samples belonging to different clusters/segments lie in separable subspaces. What if this…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Anurag Goel , Angshul Majumdar

The problem of finding sparse solutions to underdetermined systems of linear equations arises in several applications (e.g. signal and image processing, compressive sensing, statistical inference). A standard tool for dealing with sparse…

Optimization and Control · Mathematics 2016-08-03 Marianna De Santis , Stefano Lucidi , Francesco Rinaldi

Graph based clustering is one of the major clustering methods. Most of it work in three separate steps: similarity graph construction, clustering label relaxing and label discretization with k-means. Such common practice has three…

Machine Learning · Computer Science 2019-04-26 Yudong Han , Lei Zhu , Zhiyong Cheng , Jingjing Li , Xiaobai Liu