English
Related papers

Related papers: Enhanced Soups for Graph Neural Networks

200 papers

Graph-structured data is ubiquitous in the real world, and Graph Neural Networks (GNNs) have become increasingly popular in various fields due to their ability to process such irregular data directly. However, as data scale, GNNs become…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-10 Xianfeng Song , Yi Zou , Zheng Shi

Several distributed frameworks have been developed to scale Graph Neural Networks (GNNs) on billion-size graphs. On several benchmarks, we observe that the graph partitions generated by these frameworks have heterogeneous data distributions…

Machine Learning · Computer Science 2023-11-07 Dhruv Deshmukh , Gagan Raj Gupta , Manisha Chawla , Vishwesh Jatala , Anirban Haldar

Graph Neural Networks (GNNs) are widely used to perform different machine learning tasks on graphs. As the size of the graphs grows, and the GNNs get deeper, training and inference time become costly in addition to the memory requirement.…

Machine Learning · Computer Science 2022-08-09 Md. Khaledur Rahman , Ariful Azad

Graph Neural Networks (GNNs) have been extensively used for mining graph-structured data with impressive performance. However, because these traditional GNNs do not distinguish among various downstream tasks, embeddings embedded by them are…

Machine Learning · Computer Science 2024-09-20 Jianpeng Chen , Yujing Wang , Ming Zeng , Zongyi Xiang , Bitan Hou , Yunhai Tong , Ole J. Mengshoel , Yazhou Ren

Consistency training is a popular method to improve deep learning models in computer vision and natural language processing. Graph neural networks (GNNs) have achieved remarkable performance in a variety of network science learning tasks,…

Machine Learning · Computer Science 2021-10-14 Cole Hawkins , Vassilis N. Ioannidis , Soji Adeshina , George Karypis

Graph Neural Networks (GNNs) have demonstrated remarkable performance in a wide range of tasks, such as node classification, link prediction, and graph classification, by exploiting the structural information in graph-structured data.…

Machine Learning · Computer Science 2026-01-09 Oscar Llorente , Jaime Boal , Eugenio F. Sánchez-Úbeda , Antonio Diaz-Cano , Miguel Familiar

The best performing learning algorithms devised for event cameras work by first converting events into dense representations that are then processed using standard CNNs. However, these steps discard both the sparsity and high temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Simon Schaefer , Daniel Gehrig , Davide Scaramuzza

Graph neural networks (GNNs) have achieved strong performance in various applications. In the real world, network data is usually formed in a streaming fashion. The distributions of patterns that refer to neighborhood information of nodes…

Machine Learning · Computer Science 2020-12-07 Junshan Wang , Guojie Song , Yi Wu , Liang Wang

Graph Neural Networks (GNNs) have been widely adopted for their ability to compute expressive node representations in graph datasets. However, serving GNNs on large graphs is challenging due to the high communication, computation, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-16 Geon-Woo Kim , Donghyun Kim , Jeongyoon Moon , Henry Liu , Tarannum Khan , Anand Iyer , Daehyeok Kim , Aditya Akella

Traffic flow forecasting is a critical spatio-temporal data mining task with wide-ranging applications in intelligent route planning and dynamic traffic management. Recent advancements in deep learning, particularly through Graph Neural…

Machine Learning · Computer Science 2025-05-14 Weiyang Kong , Kaiqi Wu , Sen Zhang , Yubao Liu

Graph Convolutional Networks (GCNs) are powerful for processing graph-structured data and have achieved state-of-the-art performance in several tasks such as node classification, link prediction, and graph classification. However, it is…

Machine Learning · Computer Science 2021-10-19 Langzhang Liang , Cuiyun Gao , Shiyi Chen , Shishi Duan , Yu pan , Junjin Zheng , Lei Wang , Zenglin Xu

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and…

Machine Learning · Computer Science 2022-02-03 Nishai Kooverjee , Steven James , Terence van Zyl

While Graph Neural Networks (GNNs) are powerful models for learning representations on graphs, most state-of-the-art models do not have significant accuracy gain beyond two to three layers. Deep GNNs fundamentally need to address: 1).…

Graph neural networks (GNNs) are widely used for learning node embeddings in graphs, typically adopting a message-passing scheme. This approach, however, leads to the neighbor explosion problem, with exponentially growing computational and…

Machine Learning · Computer Science 2025-07-08 Zichao Yue , Chenhui Deng , Zhiru Zhang

Graph representation learning has attracted much attention in supporting high quality candidate search at scale. Despite its effectiveness in learning embedding vectors for objects in the user-item interaction network, the computational…

Information Retrieval · Computer Science 2020-03-05 Qiaoyu Tan , Ninghao Liu , Xing Zhao , Hongxia Yang , Jingren Zhou , Xia Hu

The Graph Neural Network (GNN) has been widely used for graph data representation. However, the existing researches only consider the ideal balanced dataset, and the imbalanced dataset is rarely considered. Traditional methods such as…

Machine Learning · Computer Science 2022-05-10 S. Shi , Kai Qiao , Shuai Yang , L. Wang , J. Chen , Bin Yan

Sampling is a critical operation in Graph Neural Network (GNN) training that helps reduce the cost. Previous literature has explored improving sampling algorithms via mathematical and statistical methods. However, there is a gap between…

Machine Learning · Computer Science 2022-06-27 Xin Liu , Mingyu Yan , Shuhan Song , Zhengyang Lv , Wenming Li , Guangyu Sun , Xiaochun Ye , Dongrui Fan

Graphs play an important role in many applications. Recently, Graph Neural Networks (GNNs) have achieved promising results in graph analysis tasks. Some state-of-the-art GNN models have been proposed, e.g., Graph Convolutional Networks…

Machine Learning · Computer Science 2021-09-29 Yaoman Li , Irwin King

Graph Neural Networks (GNNs) have emerged as highly successful tools for graph-related tasks. However, real-world problems involve very large graphs, and the compute resources needed to fit GNNs to those problems grow rapidly. Moreover, the…

Machine Learning · Computer Science 2021-11-11 Eitan Kosman , Joel Oren , Dotan Di Castro

Due to the significant computational challenge of training large-scale graph neural networks (GNNs), various sparse learning techniques have been exploited to reduce memory and storage costs. Examples include \textit{graph sparsification}…

Machine Learning · Computer Science 2023-02-07 Shuai Zhang , Meng Wang , Pin-Yu Chen , Sijia Liu , Songtao Lu , Miao Liu