English
Related papers

Related papers: Sparse random graphs: regularization and concentra…

200 papers

We propose graph-dependent implicit regularisation strategies for distributed stochastic subgradient descent (Distributed SGD) for convex problems in multi-agent learning. Under the standard assumptions of convexity, Lipschitz continuity,…

Machine Learning · Computer Science 2018-09-20 Dominic Richards , Patrick Rebeschini

Graph-Laplacians and their spectral embeddings play an important role in multiple areas of machine learning. This paper is focused on graph-Laplacian dimension reduction for the spectral clustering of data as a primary application. Spectral…

Machine Learning · Computer Science 2021-09-08 Vladimir Druskin , Alexander V. Mamonov , Mikhail Zaslavsky

Selecting regularization parameters in penalized high-dimensional graphical models in a principled, data-driven, and computationally efficient manner continues to be one of the key challenges in high-dimensional statistics. We present…

Methodology · Statistics 2016-10-19 Christian L. Müller , Richard Bonneau , Zachary Kurtz

Graph-based representations play a key role in machine learning. The fundamental step in these representations is the association of a graph structure to a dataset. In this paper, we propose a method that aims at finding a block sparse…

Signal Processing · Electrical Eng. & Systems 2019-03-27 Stefania Sardellitti , Sergio Barbarossa , Paolo Di Lorenzo

We consider random walks in the form of nearest-neighbor hopping on Erdos-Renyi random graphs of finite fixed mean degree c as the number of vertices N tends to infinity. In this regime, using statistical field theory methods, we develop an…

Disordered Systems and Neural Networks · Physics 2025-02-14 Oleg Evnin , Weerawit Horinouchi

Let $k,d $ be positive integers. We determine a sequence of constants that are asymptotic to the probability that the cluster at the origin in a $d$-dimensional Poisson Boolean model with balls of fixed radius is of order $k$, as the…

Probability · Mathematics 2025-04-10 Mathew D. Penrose , Xiaochuan Yang

We study the statistical and computational properties of a network Lasso method for local graph clustering. The clusters delivered by nLasso can be characterized elegantly via network flows between cluster boundary and seed nodes. While…

Machine Learning · Computer Science 2021-02-24 Alexander Jung , Yasmin SarcheshmehPour

Following Hartigan, a cluster is defined as a connected component of the t-level set of the underlying density, i.e., the set of points for which the density is greater than t. A clustering algorithm which combines a density estimate with…

Machine Learning · Statistics 2010-02-12 Bruno Pelletier , Pierre Pudlo

Spectral clustering methods are known for their ability to represent clusters of diverse shapes, densities etc. However, results of such algorithms, when applied e.g. to text documents, are hard to explain to the user, especially due to…

Machine Learning · Computer Science 2023-08-02 Bartłomiej Starosta , Mieczysław A. Kłopotek , Sławomir T. Wierzchoń

Almost equitable partitions (AEPs) have been linked to cluster synchronization in oscillatory systems, highlighting the importance of structure in collective network dynamics. We provide a general spectral framework that formalizes this…

Social and Information Networks · Computer Science 2025-09-15 Tobias Timofeyev , Alice Patania

The Laplacian matrix of a simple graph is the difference of the diagonal matrix of vertex degree and the (0,1) adjacency matrix. In the past decades, the Laplacian spectrum has received much more and more attention, since it has been…

Combinatorics · Mathematics 2013-10-31 Xiao-Dong Zhang

We show that the dominating set problem admits a constant factor approximation in a constant number of rounds in the LOCAL model of distributed computing on graph classes with bounded expansion. This generalizes a result of Czygrinow et al.…

Discrete Mathematics · Computer Science 2022-07-07 Ozan Heydt , Simeon Kublenz , Patrice Ossona de Mendez , Sebastian Siebertz , Alexandre Vigny

We introduce a graph renormalization procedure based on the coarse-grained Laplacian, which generates reduced-complexity representations for characteristic scales identified through the spectral gap. This method retains both diffusion…

Statistical Mechanics · Physics 2024-11-20 M. Schmidt , F. Caccioli , T. Aste

We apply concepts from manifold regularization to develop new regularization techniques for training locally stable deep neural networks. Our regularizers are based on a sparsification of the graph Laplacian which holds with high…

Machine Learning · Statistics 2020-09-24 Charles Jin , Martin Rinard

We propose a symmetric graph convolutional autoencoder which produces a low-dimensional latent representation from a graph. In contrast to the existing graph autoencoders with asymmetric decoder parts, the proposed autoencoder has a newly…

Machine Learning · Computer Science 2019-08-08 Jiwoong Park , Minsik Lee , Hyung Jin Chang , Kyuewang Lee , Jin Young Choi

Graph clustering is an important technique to understand the relationships between the vertices in a big graph. In this paper, we propose a novel random-walk-based graph clustering method. The proposed method restricts the reach of the…

Social and Information Networks · Computer Science 2016-06-22 Honglei Zhang , Jenni Raitoharju , Serkan Kiranyaz , Moncef Gabbouj

In this note, we study Laplacians on graphs for which connectivity within certain subgraphs tends to infinity. Our main focus are graphs sharing a common node set on which edge weights within certain clusters grow to infinity. As…

Functional Analysis · Mathematics 2026-01-28 Christian Koke

The stochastic block model is a canonical random graph model for clustering and community detection on network-structured data. Decades of extensive study on the problem have established many profound results, among which the phase…

Machine Learning · Statistics 2024-02-29 Junda Sheng , Thomas Strohmer

The spectral density of random graphs with topological constraints is analysed using the replica method. We consider graph ensembles featuring generalised degree-degree correlations, as well as those with a community structure. In each case…

Disordered Systems and Neural Networks · Physics 2011-04-08 Tim Rogers , Conrad Pérez Vicente , Koujin Takeda , Isaac Pérez Castillo

Local clustering aims to identify specific substructures within a large graph without any additional structural information of the graph. These substructures are typically small compared to the overall graph, enabling the problem to be…

Machine Learning · Computer Science 2025-10-31 Zhaiming Shen , Sung Ha Kang