English
Related papers

Related papers: VQ-GNN: A Universal Framework to Scale up Graph Ne…

200 papers

Geometric deep learning has made great strides towards generalizing the design of structure-aware neural networks from traditional domains to non-Euclidean ones, giving rise to graph neural networks (GNN) that can be applied to…

Machine Learning · Statistics 2024-10-28 Frederik Wenkel , Yimeng Min , Matthew Hirn , Michael Perlmutter , Guy Wolf

Training Graph Neural Networks (GNNs) on real-world graphs consisting of billions of nodes and edges is quite challenging, primarily due to the substantial memory needed to store the graph and its intermediate node and edge features, and…

Machine Learning · Computer Science 2023-08-08 Kaidi Cao , Rui Deng , Shirley Wu , Edward W Huang , Karthik Subbian , Jure Leskovec

Graph neural networks (GNNs) have achieved strong performance in various applications. In the real world, network data is usually formed in a streaming fashion. The distributions of patterns that refer to neighborhood information of nodes…

Machine Learning · Computer Science 2020-12-07 Junshan Wang , Guojie Song , Yi Wu , Liang Wang

Previous studies have demonstrated the strong performance of Graph Neural Networks (GNNs) in node classification. However, most existing GNNs adopt a node-centric perspective and rely on global message passing, leading to high computational…

Machine Learning · Computer Science 2026-01-14 Qian Zeng , Xin Lin , Jingyi Gao , Yang Yu

Graph convolutional neural networks (GCNs) generalize tradition convolutional neural networks (CNNs) from low-dimensional regular graphs (e.g., image) to high dimensional irregular graphs (e.g., text documents on word embeddings). Due to…

Machine Learning · Computer Science 2021-03-30 Mehrnaz Najafi , Philip S. Yu

While graph neural networks (GNNs) are widely used for node and graph representation learning tasks, the reliability of GNN uncertainty estimates under distribution shifts remains relatively under-explored. Indeed, while post-hoc…

Machine Learning · Computer Science 2024-12-16 Puja Trivedi , Mark Heimann , Rushil Anirudh , Danai Koutra , Jayaraman J. Thiagarajan

Quadratic programming (QP) is the most widely applied category of problems in nonlinear programming. Many applications require real-time/fast solutions, though not necessarily with high precision. Existing methods either involve matrix…

Machine Learning · Computer Science 2025-09-23 Ziang Chen , Xiaohan Chen , Jialin Liu , Xinshang Wang , Wotao Yin

Graph neural networks (GNNs) have significantly improved the representation power for graph-structured data. Despite of the recent success of GNNs, the graph convolution in most GNNs have two limitations. Since the graph convolution is…

Machine Learning · Computer Science 2021-12-30 Jinyoung Park , Sungdong Yoo , Jihwan Park , Hyunwoo J. Kim

Graph neural networks (GNNs) use graph convolutions to exploit network invariances and learn meaningful feature representations from network data. However, on large-scale graphs convolutions incur in high computational cost, leading to…

Machine Learning · Computer Science 2022-06-29 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

Quantized Neural Networks (QNNs), which use low bitwidth numbers for representing parameters and performing computations, have been proposed to reduce the computation complexity, storage size and memory usage. In QNNs, parameters and…

Computer Vision and Pattern Recognition · Computer Science 2017-06-23 Shuchang Zhou , Yuzhi Wang , He Wen , Qinyao He , Yuheng Zou

Graph neural networks (GNNs) have been applied into a variety of graph tasks. Most existing work of GNNs is based on the assumption that the given graph data is optimal, while it is inevitable that there exists missing or incomplete edges…

Machine Learning · Computer Science 2022-05-13 Qianggang Ding , Deheng Ye , Tingyang Xu , Peilin Zhao

Large-scale graph training is a notoriously challenging problem for graph neural networks (GNNs). Due to the nature of evolving graph structures into the training process, vanilla GNNs usually fail to scale up, limited by the GPU memory…

Machine Learning · Computer Science 2023-03-02 Keyu Duan , Zirui Liu , Peihao Wang , Wenqing Zheng , Kaixiong Zhou , Tianlong Chen , Xia Hu , Zhangyang Wang

Deploying graph neural networks (GNNs) on whole-graph classification or regression tasks is known to be challenging: it often requires computing node features that are mindful of both local interactions in their neighbourhood and the global…

Machine Learning · Computer Science 2022-12-22 Andreea Deac , Marc Lackenby , Petar Veličković

Graph Neural Networks (GNNs) have emerged as a prominent research topic in the field of machine learning. Existing GNN models are commonly categorized into two types: spectral GNNs, which are designed based on polynomial graph filters, and…

Machine Learning · Computer Science 2023-09-01 Guanyu Cui , Zhewei Wei

Message passing is a core mechanism in Graph Neural Networks (GNNs), enabling the iterative update of node embeddings by aggregating information from neighboring nodes. Graph Convolutional Networks (GCNs) exemplify this approach by adapting…

Machine Learning · Computer Science 2026-03-26 Mayssa Soussia , Gita Ayu Salsabila , Mohamed Ali Mahjoub , Islem Rekik

A major problem of making friend suggestions in social networks is the large size of social graphs, which can have hundreds of millions of people and tens of billions of connections. Classic methods based on heuristics or factorizations are…

Social and Information Networks · Computer Science 2024-12-17 Evgeny Zamyatin

Graph Neural Networks (GNNs) suffer from Oversquashing, which occurs when tasks require long-range interactions. The problem arises from the presence of bottlenecks that limit the propagation of messages among distant nodes. Recently, graph…

Machine Learning · Computer Science 2025-09-09 Kushal Bose , Swagatam Das

Deep learning-based approaches have been developed to solve challenging problems in wireless communications, leading to promising results. Early attempts adopted neural network architectures inherited from applications such as computer…

Information Theory · Computer Science 2022-11-07 Yifei Shen , Jun Zhang , S. H. Song , Khaled B. Letaief

Small subgraphs (graphlets) are important features to describe fundamental units of a large network. The calculation of the subgraph frequency distributions has a wide application in multiple domains including biology and engineering.…

Machine Learning · Computer Science 2022-07-15 Zhongren Chen , Xinyue Xu , Shengyi Jiang , Hao Wang , Lu Mi

Graph neural networks (GNNs) are a powerful solution for various structure learning applications due to their strong representation capabilities for graph data. However, traditional GNNs, relying on message-passing mechanisms that gather…

Machine Learning · Computer Science 2024-03-19 Wei Duan , Jie Lu , Yu Guang Wang , Junyu Xuan