English
Related papers

Related papers: Universal Graph Compression: Stochastic Block Mode…

200 papers

We propose a scalable Gromov-Wasserstein learning (S-GWL) method and establish a novel and theoretically-supported paradigm for large-scale graph analysis. The proposed method is based on the fact that Gromov-Wasserstein discrepancy is a…

Machine Learning · Computer Science 2019-10-10 Hongteng Xu , Dixin Luo , Lawrence Carin

Directed graphs have asymmetric connections, yet the current graph clustering methodologies cannot identify the potentially global structure of these asymmetries. We give a spectral algorithm called di-sim that builds on a dual measure of…

Machine Learning · Statistics 2015-01-09 Karl Rohe , Tai Qin , Bin Yu

An important problem arising in the study of complex networks, for instance in community detection and motif finding, is the sampling of graphs with fixed degree sequence. The equivalent problem of generating random 0,1 matrices with fixed…

Combinatorics · Mathematics 2018-07-27 Annabell Berger , Corrie Jacobien Carstens

Federated graph learning is a widely recognized technique that promotes collaborative training of graph neural networks (GNNs) by multi-client graphs.However, existing approaches heavily rely on the communication of model parameters or…

Machine Learning · Computer Science 2025-05-06 Hao Zhang , Xunkai Li , Yinlin Zhu , Lianglin Hu

The recent years we have seen the rise of graph neural networks for prediction tasks on graphs. One of the dominant architectures is graph attention due to its ability to make predictions using weighted edge features and not only node…

Machine Learning · Computer Science 2022-10-19 Kimon Fountoulakis , Dake He , Silvio Lattanzi , Bryan Perozzi , Anton Tsitsulin , Shenghao Yang

Graphical models use graphs to compactly capture stochastic dependencies amongst a collection of random variables. Inference over graphical models corresponds to finding marginal probability distributions given joint probability…

Machine Learning · Statistics 2013-04-02 Divyanshu Vats , José M. F. Moura

The burgeoning volume of graph data presents significant computational challenges in training graph neural networks (GNNs), critically impeding their efficiency in various applications. To tackle this challenge, graph condensation (GC) has…

Machine Learning · Computer Science 2024-06-13 Xinyi Gao , Tong Chen , Wentao Zhang , Yayong Li , Xiangguo Sun , Hongzhi Yin

Training Graph Neural Networks (GNNs) on large graphs presents unique challenges due to the large memory and computing requirements. Distributed GNN training, where the graph is partitioned across multiple machines, is a common approach to…

Machine Learning · Computer Science 2024-06-26 Juan Cervino , Md Asadullah Turja , Hesham Mostafa , Nageen Himayat , Alejandro Ribeiro

This paper considers a general data-fitting problem over a networked system, in which many computing nodes are connected by an undirected graph. This kind of problem can find many real-world applications and has been studied extensively in…

Machine Learning · Computer Science 2017-04-14 Ying Zhang

We develop a new approach for distributed distance computation in planar graphs that is based on a variant of the metric compression problem recently introduced by Abboud et al. [SODA'18]. One of our key technical contributions is in…

Data Structures and Algorithms · Computer Science 2019-12-30 Jason Li , Merav Parter

Graph embedding is a popular algorithmic approach for creating vector representations for individual vertices in networks. Training these algorithms at scale is important for creating embeddings that can be used for classification, ranking,…

Machine Learning · Computer Science 2019-07-04 C. Bayan Bruss , Anish Khazane , Jonathan Rider , Richard Serpe , Saurabh Nagrecha , Keegan E. Hines

In this work, we describe a method that determines an exact map from a finite set of subgraph densities to the parameters of a stochastic block model (SBM) matching these densities. Given a number $K$ of blocks, the subgraph densities of a…

Discrete Mathematics · Computer Science 2024-02-02 Lee M Gunderson , Gecia Bravo-Hermsdorff , Peter Orbanz

The inference and training stages of Graph Neural Networks (GNNs) are often dominated by the time required to compute a long sequence of matrix multiplications between the sparse graph adjacency matrix and its embedding. To accelerate these…

Data Structures and Algorithms · Computer Science 2024-09-05 João N. F. Alves , Samir Moustafa , Siegfried Benkner , Alexandre P. Francisco , Wilfried N. Gansterer , Luís M. S. Russo

Graph algorithms applied in many applications, including social networks, communication networks, VLSI design, graphics, and several others, require dynamic modifications -- addition and removal of vertices and/or edges -- in the graph.…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-16 Bapi Chatterjee , Sathya Peri , Muktikanta Sa , Nandini Singhal

Communication is one of the key bottlenecks in the distributed training of large-scale machine learning models, and lossy compression of exchanged information, such as stochastic gradients or models, is one of the most effective instruments…

Machine Learning · Computer Science 2022-06-22 Egor Shulgin , Peter Richtárik

Graph condensation (GC) has recently garnered considerable attention due to its ability to reduce large-scale graph datasets while preserving their essential properties. The core concept of GC is to create a smaller, more manageable graph…

Machine Learning · Computer Science 2024-11-25 Qingyun Sun , Ziying Chen , Beining Yang , Cheng Ji , Xingcheng Fu , Sheng Zhou , Hao Peng , Jianxin Li , Philip S. Yu

Many real-world datasets can be naturally represented as graphs, spanning a wide range of domains. However, the increasing complexity and size of graph datasets present significant challenges for analysis and computation. In response, graph…

Social and Information Networks · Computer Science 2024-07-02 Mohammad Hashemi , Shengbo Gong , Juntong Ni , Wenqi Fan , B. Aditya Prakash , Wei Jin

By taking the semantic object parsing task as an exemplar application scenario, we propose the Graph Long Short-Term Memory (Graph LSTM) network, which is the generalization of LSTM from sequential data or multi-dimensional data to general…

Computer Vision and Pattern Recognition · Computer Science 2016-03-24 Xiaodan Liang , Xiaohui Shen , Jiashi Feng , Liang Lin , Shuicheng Yan

This paper considers the problem of community detection on multiple potentially correlated graphs from an information-theoretical perspective. We first put forth a random graph model, called the multi-view stochastic block model (MVSBM),…

Social and Information Networks · Computer Science 2024-01-19 Yexin Zhang , Zhongtian Ma , Qiaosheng Zhang , Zhen Wang , Xuelong Li

Graph clustering becomes an important problem due to emerging applications involving the web, social networks and bio-informatics. Recently, many such applications generate data in the form of streams. Clustering massive, dynamic graph…

Databases · Computer Science 2013-01-30 Yuchen Zhao , Philip S. Yu