English
Related papers

Related papers: Sparse Quantized Spectral Clustering

200 papers

This is the first of two papers to describe a matrix sparsification algorithm that takes a general real or complex matrix as input and produces a sparse output matrix of the same size. The non-zero entries in the output are chosen to…

Numerical Analysis · Mathematics 2013-04-29 Chetan Jhurani

We develop an effective nonhierarchical data clustering method using an analogy to the dynamic coarse graining of a stochastic system. Analyzing the eigensystem of an interitem transition matrix identifies fuzzy clusters corresponding to…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Daniel Korenblum , David Shalloway

Self-supervision is key to extending use of deep learning for label scarce domains. For most of self-supervised approaches data transformations play an important role. However, up until now the impact of transformations have not been…

Machine Learning · Statistics 2020-02-19 Abhimanu Kumar , Aniket Anand Deshmukh , Urun Dogan , Denis Charles , Eren Manavoglu

Spectral clustering is a popular method for effectively clustering nonlinearly separable data. However, computational limitations, memory requirements, and the inability to perform incremental learning challenge its widespread application.…

Machine Learning · Computer Science 2023-11-15 Jo-Chun Chen , Hung-Hsuan Chen

A new approach of solving the ill-conditioned inverse problem for analytical continuation is proposed. The root of the problem lies in the fact that even tiny noise of imaginary-time input data has a serious impact on the inferred…

Strongly Correlated Electrons · Physics 2017-06-28 Junya Otsuki , Masayuki Ohzeki , Hiroshi Shinaoka , Kazuyoshi Yoshimi

We propose a sparse algebra for samplet compressed kernel matrices, to enable efficient scattered data analysis. We show the compression of kernel matrices by means of samplets produces optimally sparse matrices in a certain S-format. It…

Numerical Analysis · Mathematics 2023-05-05 H. Harbrecht , M. Multerer , O. Schenk , Ch. Schwab

The growing environmental footprint of artificial intelligence (AI), especially in terms of storage and computation, calls for more frugal and interpretable models. Sparse models (e.g., linear, neural networks) offer a promising solution by…

Machine Learning · Statistics 2025-09-23 Sylvain Sardy , Maxime van Cutsem , Xiaoyu Ma

Spectral clustering views the similarity matrix as a weighted graph, and partitions the data by minimizing a graph-cut loss. Since it minimizes the across-cluster similarity, there is no need to model the distribution within each cluster.…

Methodology · Statistics 2023-04-14 Leo L. Duan , Arkaprava Roy

Spectral clustering is a powerful method for finding structure in a dataset through the eigenvectors of a similarity matrix. It often outperforms traditional clustering algorithms such as $k$-means when the structure of the individual…

Numerical Analysis · Mathematics 2019-04-26 Paola Favati , Grazia Lotti , Ornella Menchi , Francesco Romani

A widely used paradigm to improve the generalization performance of high-capacity neural models is through the addition of auxiliary unsupervised tasks during supervised training. Tasks such as similarity matching and input reconstruction…

Machine Learning · Computer Science 2022-01-19 Shivin Srivastava , Kenji Kawaguchi , Vaibhav Rajan

A number of authors have suggested that nonlinear interactions can enhance resolution of phase shifts beyond the usual Heisenberg scaling of 1/n, where n is a measure of resources such as the number of subsystems of the probe state or the…

Quantum Physics · Physics 2012-11-05 Michael J. W. Hall , Howard M. Wiseman

In this abstract paper, we introduce a new kernel learning method by a nonparametric density estimator. The estimator consists of a group of k-centroids clusterings. Each clustering randomly selects data points with randomly selected…

Machine Learning · Computer Science 2017-08-02 Xiao-Lei Zhang

Linear-scaling electronic-structure techniques, also called O(N) techniques, rely heavily on the multiplication of sparse matrices, where the sparsity arises from spatial cut-offs. In order to treat very large systems, the calculations must…

Materials Science · Physics 2009-10-31 D. R. Bowler , T. Miyazaki , M. J. Gillan

Diffusion models are one of the key architectures of generative AI. Their main drawback, however, is the computational costs. This study indicates that the concept of sparsity, well known especially in statistics, can provide a pathway to…

Machine Learning · Computer Science 2025-09-26 Mahsa Taheri , Johannes Lederer

Dense and sparse tensors allow the representation of most bulk data structures in computational science applications. We show that sparse tensor algebra can also be used to express many of the transformations on these datasets, especially…

Mathematical Software · Computer Science 2015-12-02 Edgar Solomonik , Torsten Hoefler

Learned data models based on sparsity are widely used in signal processing and imaging applications. A variety of methods for learning synthesis dictionaries, sparsifying transforms, etc., have been proposed in recent years, often imposing…

Machine Learning · Computer Science 2018-10-22 Saiprasad Ravishankar , Brendt Wohlberg

Multidimensional scaling is an important dimension reduction tool in statistics and machine learning. Yet few theoretical results characterizing its statistical performance exist, not to mention any in high dimensions. By considering a…

Methodology · Statistics 2022-03-30 Xiucai Ding , Qiang Sun

Deep neural networks have become very popular in modeling complex nonlinear processes due to their extraordinary ability to fit arbitrary nonlinear functions from data with minimal expert intervention. However, they are almost always…

Chemical Physics · Physics 2023-01-16 Erlend Torje Berg Lundby , Adil Rasheed , Ivar Johan Halvorsen , Jan Tommy Gravdahl

Semi-supervised clustering seeks to augment traditional clustering methods by incorporating side information provided via human expertise in order to increase the semantic meaningfulness of the resulting clusters. However, most current…

Machine Learning · Computer Science 2014-02-17 Caiming Xiong , David Johnson , Jason J. Corso

Spectral clustering is one of the most popular methods for community detection in graphs. A key step in spectral clustering algorithms is the eigen decomposition of the $n{\times}n$ graph Laplacian matrix to extract its $k$ leading…

Machine Learning · Statistics 2018-09-10 Muni Sreenivas Pydi , Ambedkar Dukkipati