English
Related papers

Related papers: Aggregation Buffer: Revisiting DropEdge with a New…

200 papers

Graph convolutional networks (GCNs) and their variants have achieved great success in dealing with graph-structured data. Nevertheless, it is well known that deep GCNs suffer from the over-smoothing problem, where node representations tend…

Machine Learning · Computer Science 2022-04-22 Wei Huang , Yayong Li , Weitao Du , Jie Yin , Richard Yi Da Xu , Ling Chen , Miao Zhang

As the emerging trend of graph-based deep learning, Graph Neural Networks (GNNs) excel for their capability to generate high-quality node feature vectors (embeddings). However, the existing one-size-fits-all GNN implementations are…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-22 Yuke Wang , Boyuan Feng , Gushu Li , Shuangchen Li , Lei Deng , Yuan Xie , Yufei Ding

Ensembles of artificial neural networks show improved generalization capabilities that outperform those of single networks. However, for aggregation to be effective, the individual networks must be as accurate and diverse as possible. An…

Artificial Intelligence · Computer Science 2007-05-23 P. M. Granitto , P. F. Verdes , H. A. Ceccatto

Various Graph Neural Networks (GNNs) have been successful in analyzing data in non-Euclidean spaces, however, they have limitations such as oversmoothing, i.e., information becomes excessively averaged as the number of hidden layers…

Machine Learning · Computer Science 2024-01-23 Jaeyoon Sim , Sooyeon Jeon , InJun Choi , Guorong Wu , Won Hwa Kim

Graph neural networks (GNNs) are powerful models that have been successful in various graph representation learning tasks. Whereas gradient boosted decision trees (GBDT) often outperform other machine learning methods when faced with…

Machine Learning · Computer Science 2021-04-01 Sergei Ivanov , Liudmila Prokhorenkova

Distributed training of graph neural networks (GNNs) has become a crucial technique for processing large graphs. Prevalent GNN frameworks are model-centric, necessitating the transfer of massive graph vertex features to GNN models, which…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-10 Weijian Chen , Shuibing He , Haoyang Qu , Xuechen Zhang

Graph Neural Networks (GNNs) have achieved remarkable performance on graph-based tasks. The key idea for GNNs is to obtain informative representation through aggregating information from local neighborhoods. However, it remains an open…

Machine Learning · Computer Science 2022-06-29 Songtao Liu , Rex Ying , Hanze Dong , Lanqing Li , Tingyang Xu , Yu Rong , Peilin Zhao , Junzhou Huang , Dinghao Wu

Recently, Graph Neural Networks (GNNs) have become state-of-the-art algorithms for analyzing non-euclidean graph data. However, to realize efficient GNN training is challenging, especially on large graphs. The reasons are many-folded: 1)…

Machine Learning · Computer Science 2022-08-17 Zhe Zhou , Cong Li , Xuechao Wei , Xiaoyang Wang , Guangyu Sun

An important problem in training deep networks with high capacity is to ensure that the trained network works well when presented with new inputs outside the training dataset. Dropout is an effective regularization technique to boost the…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Mostafa Rahmani , George Atia

Graph diffusion models have recently been proposed to synthesize entire graphs, such as molecule graphs. Although existing methods have shown great performance in generating entire graphs for graph-level learning tasks, no graph diffusion…

Machine Learning · Computer Science 2025-03-18 Yancheng Wang , Changyu Liu , Yingzhen Yang

Cooperative beamforming design has been recognized as an effective approach in modern wireless networks to meet the dramatically increasing demand of various wireless data traffics. It is formulated as an optimization problem in…

Networking and Internet Architecture · Computer Science 2022-12-16 Yunqi Wang , Yang Li , Qingjiang Shi , Yik-Chung Wu

Graph contrastive learning (GCL) has been widely used as an effective self-supervised learning method for graph representation learning. However, how to apply adequate and stable graph augmentation to generating proper views for contrastive…

Machine Learning · Computer Science 2025-01-09 Yanchen Xu , Siqi Huang , Hongyuan Zhang , Xuelong Li

Graph neural networks (GNNs) have received much attention recently because of their excellent performance on graph-based tasks. However, existing research on GNNs focuses on designing more effective models without considering much about the…

Machine Learning · Computer Science 2021-04-20 Han Yang , Xiao Yan , Xinyan Dai , Yongqiang Chen , James Cheng

Graph neural networks (GNNs) are conventionally trained on a per-domain, per-task basis. It creates a significant barrier in transferring the acquired knowledge to different, heterogeneous data setups. This paper introduces GraphBridge, a…

Machine Learning · Computer Science 2025-03-04 Li Ju , Xingyi Yang , Qi Li , Xinchao Wang

Previous studies have demonstrated the strong performance of Graph Neural Networks (GNNs) in node classification. However, most existing GNNs adopt a node-centric perspective and rely on global message passing, leading to high computational…

Machine Learning · Computer Science 2026-01-14 Qian Zeng , Xin Lin , Jingyi Gao , Yang Yu

Graph convolutional networks (GCNs) have been employed as a kind of significant tool on many graph-based applications recently. Inspired by convolutional neural networks (CNNs), GCNs generate the embeddings of nodes by aggregating the…

Machine Learning · Computer Science 2020-11-20 Tao Huang , Yihan Zhang , Jiajing Wu , Junyuan Fang , Zibin Zheng

Graph neural networks (GNNs) are designed to process data associated with graphs. They are finding an increasing range of applications; however, as with other modern machine learning techniques, their theoretical understanding is limited.…

Disordered Systems and Neural Networks · Physics 2026-02-23 O. Duranthon , L. Zdeborová

Graph Neural Networks (GNNs) are powerful tools for learning from graph-structured data, but their scalability is increasingly strained by the size of real-world graphs in domains like recommender systems, fraud detection, and molecular…

Machine Learning · Computer Science 2026-05-22 Mridul Gupta , Samyak Jain , Vansh Ramani , Hariprasad Kodamana , Sayan Ranu

Learning graph-structured data with graph neural networks (GNNs) has been recently emerging as an important field because of its wide applicability in bioinformatics, chemoinformatics, social network analysis and data mining. Recent GNN…

Machine Learning · Computer Science 2021-12-16 Cheolhyeong Kim , Haeseong Moon , Hyung Ju Hwang

Training high-quality deep models necessitates vast amounts of data, resulting in overwhelming computational and memory demands. Recently, data pruning, distillation, and coreset selection have been developed to streamline data volume by…

Machine Learning · Computer Science 2024-10-18 Guibin Zhang , Haonan Dong , Yuchen Zhang , Zhixun Li , Dingshuo Chen , Kai Wang , Tianlong Chen , Yuxuan Liang , Dawei Cheng , Kun Wang