English
Related papers

Related papers: Optimal Laplacian regularization for sparse spectr…

200 papers

We introduce a novel stochastic regularization technique for deep neural networks, which decomposes a layer into multiple branches with different parameters and merges stochastically sampled combinations of the outputs from the branches…

Machine Learning · Computer Science 2019-10-04 Wonpyo Park , Paul Hongsuck Seo , Bohyung Han , Minsu Cho

We consider the properties of vibrational dynamics on random networks, with random masses and spring constants. The localization properties of the eigenstates contrast greatly with the Laplacian case on these networks. We introduce several…

Disordered Systems and Neural Networks · Physics 2009-11-07 M. B. Hastings

Deep neural networks have become very popular in modeling complex nonlinear processes due to their extraordinary ability to fit arbitrary nonlinear functions from data with minimal expert intervention. However, they are almost always…

Chemical Physics · Physics 2023-01-16 Erlend Torje Berg Lundby , Adil Rasheed , Ivar Johan Halvorsen , Jan Tommy Gravdahl

Because of the significant increase in size and complexity of the networks, the distributed computation of eigenvalues and eigenvectors of graph matrices has become very challenging and yet it remains as important as before. In this paper…

Numerical Analysis · Mathematics 2017-11-27 Konstantin Avrachenkov , Philippe Jacquet , Jithin Sreedharan

Low-Rank Representation (LRR) highly suffers from discarding the locality information of data points in subspace clustering, as it may not incorporate the data structure nonlinearity and the non-uniform distribution of observations over the…

Machine Learning · Computer Science 2022-03-09 Eysan Mehrbani , Mohammad Hossein Kahaei , Seyed Aliasghar Beheshti

Spectral clustering has become a popular technique due to its high performance in many contexts. It comprises three main steps: create a similarity graph between N objects to cluster, compute the first k eigenvectors of its Laplacian matrix…

Data Structures and Algorithms · Computer Science 2016-05-24 Nicolas Tremblay , Gilles Puy , Remi Gribonval , Pierre Vandergheynst

In solving a linear system with iterative methods, one is usually confronted with the dilemma of having to choose between cheap, inefficient iterates over sparse search directions (e.g., coordinate descent), or expensive iterates in…

Numerical Analysis · Computer Science 2019-08-07 Michael T. Schaub , Maguy Trefois , Paul Van Dooren , Jean-Charles Delvenne

Detection of sparse signals arises in a wide range of modern scientific studies. The focus so far has been mainly on Gaussian mixture models. In this paper, we consider the detection problem under a general sparse mixture model and obtain…

Information Theory · Computer Science 2012-11-13 T. Tony Cai , Yihong Wu

Community detection has been one of the central problems in network studies and directed network is particularly challenging due to asymmetry among its links. In this paper, we found that incorporating the direction of links reveals new…

Social and Information Networks · Computer Science 2013-09-24 Sungmin Kim , Tao Shi

Recent developments in deep learning have revolutionized the paradigm of image restoration. However, its applications on real image denoising are still limited, due to its sensitivity to training data and the complex nature of real image…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Jin Zeng , Jiahao Pang , Wenxiu Sun , Gene Cheung

Spectral clustering requires the time-consuming decomposition of the Laplacian matrix of the similarity graph, thus limiting its applicability to large datasets. To improve the efficiency of spectral clustering, a top-down approach was…

Machine Learning · Computer Science 2024-12-19 Zhichang Xu , Zhiguo Long , Hua Meng

This paper focuses on the concentration properties of the spectral norm of the normalized Laplacian matrix for Erd\H{o}s-R\'enyi random graphs. First, We achieve the optimal bound that can be attained in the further question posed by Le et…

Probability · Mathematics 2025-02-05 Yiming Chen , Xuanang Hu , Pengtao Li

The $k$-support norm is a regularizer which has been successfully applied to sparse vector prediction problems. We show that it belongs to a general class of norms which can be formulated as a parameterized infimum over quadratics. We…

Machine Learning · Statistics 2014-03-07 Andrew M. McDonald , Massimiliano Pontil , Dimitris Stamos

We propose an efficient strategy to infer sparse Hopfield network based on magnetizations and pairwise correlations measured through Glauber samplings. This strategy incorporates the $\ell_{1}$ regularization into the Bethe approximation by…

Statistical Mechanics · Physics 2013-11-28 Haiping Huang

Graph convolutional neural networks (GCNNs) have been widely used in graph learning. It has been observed that the smoothness functional on graphs can be defined in terms of the graph Laplacian. This fact points out in the direction of…

Machine Learning · Computer Science 2020-09-30 Asif Salim , Sumitra S

Community-based graph clustering is one of the most popular topics in the analysis of complex social networks. This type of clustering involves grouping vertices that are considered to share more connections, whereas vertices in different…

Optimization and Control · Mathematics 2025-11-25 Wenshun Teng , Qingna Li

Subspace clustering refers to the problem of clustering high-dimensional data that lie in a union of low-dimensional subspaces. State-of-the-art subspace clustering methods are based on the idea of expressing each data point as a linear…

Computer Vision and Pattern Recognition · Computer Science 2016-08-08 Qilin Li , Ling Li , Wanquan Liu

We develop techniques to solve ill-posed inverse problems on the sphere by sparse regularisation, exploiting sparsity in both axisymmetric and directional scale-discretised wavelet space. Denoising, inpainting, and deconvolution problems,…

Information Theory · Computer Science 2017-08-17 Christopher G. R. Wallis , Yves Wiaux , Jason D. McEwen

Recommendation algorithm plays an important role in recommendation system (RS), which predicts users' interests and preferences for some given items based on their known information. Recently, a recommendation algorithm based on the graph…

Information Retrieval · Computer Science 2023-07-06 Guangrui Yang , Lihua Yang , Qing Zhang , Zhihua Yang

Graph clustering, or community detection, is the task of identifying groups of closely related objects in a large network. In this paper we introduce a new community-detection framework called LambdaCC that is based on a specially weighted…

Data Structures and Algorithms · Computer Science 2018-07-17 Nate Veldt , David Gleich , Anthony Wirth