English
Related papers

Related papers: Neighbor2Seq: Deep Learning on Massive Graphs by T…

200 papers

Graph Neural Networks (GNNs) have attracted increasing attention in recent years and have achieved excellent performance in semi-supervised node classification tasks. The success of most GNNs relies on one fundamental assumption, i.e., the…

Machine Learning · Computer Science 2024-12-03 Junchao Lin , Yuan Wan , Jingwen Xu , Xingchen Qi

Subgraph representation learning has emerged as an important problem, but it is by default approached with specialized graph neural networks on a large global graph. These models demand extensive memory and computational resources but…

Machine Learning · Computer Science 2024-05-24 Dongkwan Kim , Alice Oh

As graph data size increases, the vast latency and memory consumption during inference pose a significant challenge to the real-world deployment of Graph Neural Networks (GNNs). While quantization is a powerful approach to reducing GNNs…

Machine Learning · Computer Science 2023-02-02 Zeyu Zhu , Fanrong Li , Zitao Mo , Qinghao Hu , Gang Li , Zejian Liu , Xiaoyao Liang , Jian Cheng

Graph neural networks (GNNs) have achieved tremendous success on multiple graph-based learning tasks by fusing network structure and node features. Modern GNN models are built upon iterative aggregation of neighbor's/proximity features by…

Machine Learning · Computer Science 2021-06-15 Susheel Suresh , Vinith Budde , Jennifer Neville , Pan Li , Jianzhu Ma

Graph Neural Networks (GNNs) rely on graph convolutions to exploit meaningful patterns in networked data. Based on matrix multiplications, convolutions incur in high computational costs leading to scalability limitations in practice. To…

Machine Learning · Computer Science 2022-10-28 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

Graph Neural Networks (GNNs) have been widely applied to various fields for learning over graph-structured data. They have shown significant improvements over traditional heuristic methods in various tasks such as node classification and…

Machine Learning · Computer Science 2022-06-10 Seongjun Yun , Seoyoon Kim , Junhyun Lee , Jaewoo Kang , Hyunwoo J. Kim

In this paper, we propose an end-to-end graph learning framework, namely Deep Iterative and Adaptive Learning for Graph Neural Networks (DIAL-GNN), for jointly learning the graph structure and graph embeddings simultaneously. We first cast…

Machine Learning · Computer Science 2019-12-18 Yu Chen , Lingfei Wu , Mohammed J. Zaki

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

Machine Learning · Computer Science 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

Network representation learning and node classification in graphs got significant attention due to the invent of different types graph neural networks. Graph convolution network (GCN) is a popular semi-supervised technique which aggregates…

Social and Information Networks · Computer Science 2020-02-11 Sambaran Bandyopadhyay , Kishalay Das , M. Narasimha Murty

Graph neural networks (GNNs) have achieved strong performance in various applications. In the real world, network data is usually formed in a streaming fashion. The distributions of patterns that refer to neighborhood information of nodes…

Machine Learning · Computer Science 2020-12-07 Junshan Wang , Guojie Song , Yi Wu , Liang Wang

Dynamic graph learning (DGL) aims to learn informative and temporally-evolving node embeddings to support downstream tasks such as link prediction. A fundamental challenge in DGL lies in effectively modeling both the temporal dynamics and…

Social and Information Networks · Computer Science 2025-06-10 Ling Wang

Graph Neural Networks (GNNs) have led to state-of-the-art performance on a variety of machine learning tasks such as recommendation, node classification and link prediction. Graph neural network models generate node embeddings by merging…

Machine Learning · Computer Science 2020-11-04 Yunpeng Weng , Xu Chen , Liang Chen , Wei Liu

Transformers have recently emerged as powerful neural networks for graph learning, showcasing state-of-the-art performance on several graph property prediction tasks. However, these results have been limited to small-scale graphs, where the…

Machine Learning · Computer Science 2023-12-19 Vijay Prakash Dwivedi , Yozen Liu , Anh Tuan Luu , Xavier Bresson , Neil Shah , Tong Zhao

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Graph convolutional networks (GCNs) are powerful deep neural networks for graph-structured data. However, GCN computes the representation of a node recursively from its neighbors, making the receptive field size grow exponentially with the…

Machine Learning · Statistics 2018-03-02 Jianfei Chen , Jun Zhu , Le Song

Graph Neural Networks (GNNs) are exemplary deep models designed for graph data. Message passing mechanism enables GNNs to effectively capture graph topology and push the performance boundaries across various graph tasks. However, the trend…

Neural and Evolutionary Computing · Computer Science 2025-09-29 Huizhe Zhang , Jintang Li , Yuchang Zhu , Liang Chen , Li Kuang

Recently popularized graph neural networks achieve the state-of-the-art accuracy on a number of standard benchmark datasets for graph-based semi-supervised learning, improving significantly over existing approaches. These architectures…

Machine Learning · Statistics 2018-03-13 Kiran K. Thekumparampil , Chong Wang , Sewoong Oh , Li-Jia Li

Message Passing Neural Networks (MPNNs) are a staple of graph machine learning. MPNNs iteratively update each node's representation in an input graph by aggregating messages from the node's neighbors, which necessitates a memory complexity…

Machine Learning · Computer Science 2024-12-24 Ben Finkelshtein , İsmail İlkan Ceylan , Michael Bronstein , Ron Levie

Consistency training is a popular method to improve deep learning models in computer vision and natural language processing. Graph neural networks (GNNs) have achieved remarkable performance in a variety of network science learning tasks,…

Machine Learning · Computer Science 2021-10-14 Cole Hawkins , Vassilis N. Ioannidis , Soji Adeshina , George Karypis

A widely studied non-deterministic polynomial time (NP) hard problem lies in finding a route between the two nodes of a graph. Often meta-heuristics algorithms such as $A^{*}$ are employed on graphs with a large number of nodes. Here, we…

Machine Learning · Computer Science 2018-01-18 Alessandro Bay , Biswa Sengupta