English
Related papers

Related papers: Deep Ensembles for Graphs with Higher-order Depend…

200 papers

While many systems have been developed to train Graph Neural Networks (GNNs), efficient model inference and evaluation remain to be addressed. For instance, using the widely adopted node-wise approach, model evaluation can account for up to…

Machine Learning · Computer Science 2022-11-29 Peiqi Yin , Xiao Yan , Jinjing Zhou , Qiang Fu , Zhenkun Cai , James Cheng , Bo Tang , Minjie Wang

Graph Neural Networks (GNNs) have enjoyed wide spread applications in graph-structured data. However, existing graph based applications commonly lack annotated data. GNNs are required to learn latent patterns from a limited amount of…

Machine Learning · Computer Science 2023-03-22 Wenqi Wei , Mu Qiao , Divyesh Jadav

Graph neural networks (GNNs) are a popular class of machine learning models whose major advantage is their ability to incorporate a sparse and discrete dependency structure between data points. Unfortunately, GNNs can only be used when such…

Machine Learning · Computer Science 2020-06-22 Luca Franceschi , Mathias Niepert , Massimiliano Pontil , Xiao He

We introduce the framework of continuous-depth graph neural networks (GNNs). Neural graph differential equations (Neural GDEs) are formalized as the counterpart to GNNs where the input-output relationship is determined by a continuum of GNN…

Machine Learning · Computer Science 2021-06-23 Michael Poli , Stefano Massaroli , Clayton M. Rabideau , Junyoung Park , Atsushi Yamashita , Hajime Asama , Jinkyoo Park

Graph Neural Network (GNN) based recommender systems have been attracting more and more attention in recent years due to their excellent performance in accuracy. Representing user-item interactions as a bipartite graph, a GNN model…

Information Retrieval · Computer Science 2022-11-29 Liangwei Yang , Shengjie Wang , Yunzhe Tao , Jiankai Sun , Xiaolong Liu , Philip S. Yu , Taiqing Wang

Graph Neural Networks (GNNs) have emerged as powerful tools for learning representations of graph-structured data, demonstrating remarkable performance across various tasks. Recognising their importance, there has been extensive research…

Machine Learning · Computer Science 2025-01-06 Akshit Sinha , Sreeram Vennam , Charu Sharma , Ponnurangam Kumaraguru

Graph neural networks (GNNs) have shown advantages in graph-based analysis tasks. However, most existing methods have the homogeneity assumption and show poor performance on heterophilic graphs, where the linked nodes have dissimilar…

Machine Learning · Computer Science 2024-04-16 Tianhao Peng , Wenjun Wu , Haitao Yuan , Zhifeng Bao , Zhao Pengrui , Xin Yu , Xuetao Lin , Yu Liang , Yanjun Pu

Graph Neural Networks (GNNs) are an emerging research field. This specialized Deep Neural Network (DNN) architecture is capable of processing graph structured data and bridges the gap between graph processing and Deep Learning (DL). As…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-24 Jana Vatter , Ruben Mayer , Hans-Arno Jacobsen

Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Transformers. Previous work has identified issues such as…

Machine Learning · Computer Science 2023-12-19 Ameen Ali , Hakan Cevikalp , Lior Wolf

Graph Neural Networks (GNNs) have attracted increasing attention in recent years and have achieved excellent performance in semi-supervised node classification tasks. The success of most GNNs relies on one fundamental assumption, i.e., the…

Machine Learning · Computer Science 2024-12-03 Junchao Lin , Yuan Wan , Jingwen Xu , Xingchen Qi

Learning useful node and graph representations with graph neural networks (GNNs) is a challenging task. It is known that deep GNNs suffer from over-smoothing where, as the number of layers increases, node representations become nearly…

Machine Learning · Computer Science 2022-02-28 Pantelis Elinas , Edwin V. Bonilla

Graph neural networks (GNNs) have been widely used in representation learning on graphs and achieved state-of-the-art performance in tasks such as node classification and link prediction. However, most existing GNNs are designed to learn…

Machine Learning · Computer Science 2020-02-06 Seongjun Yun , Minbyul Jeong , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Graph Neural Networks (GNNs) are gaining extensive attention for their application in graph data. However, the black-box nature of GNNs prevents users from understanding and trusting the models, thus hampering their applicability. Whereas…

Machine Learning · Computer Science 2023-05-23 Qizhang Feng , Ninghao Liu , Fan Yang , Ruixiang Tang , Mengnan Du , Xia Hu

Deep learning's performance has been extensively recognized recently. Graph neural networks (GNNs) are designed to deal with graph-structural data that classical deep learning does not easily manage. Since most GNNs were created using…

Machine Learning · Computer Science 2023-09-20 Zhiqian Chen , Fanglan Chen , Lei Zhang , Taoran Ji , Kaiqun Fu , Liang Zhao , Feng Chen , Lingfei Wu , Charu Aggarwal , Chang-Tien Lu

Deep Graph Networks (DGNs) currently dominate the research landscape of learning from graphs, due to their efficiency and ability to implement an adaptive message-passing scheme between the nodes. However, DGNs are typically limited in…

Machine Learning · Computer Science 2023-02-09 Alessio Gravina , Davide Bacciu , Claudio Gallicchio

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

Machine Learning · Computer Science 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

Graph Neural Networks (GNNs) have recently been used for node and graph classification tasks with great success, but GNNs model dependencies among the attributes of nearby neighboring nodes rather than dependencies among observed node…

Machine Learning · Computer Science 2020-09-30 Mengyue Hang , Jennifer Neville , Bruno Ribeiro

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and…

Machine Learning · Computer Science 2022-02-03 Nishai Kooverjee , Steven James , Terence van Zyl

Modern graph neural networks (GNNs) use a message passing scheme and have achieved great success in many fields. However, this recursive design inherently leads to excessive computation and memory requirements, making it not applicable to…

Machine Learning · Computer Science 2022-02-08 Meng Liu , Shuiwang Ji

Deep neural networks have enabled researchers to create powerful generalized frameworks, such as transformers, that can be used to solve well-studied problems in various application domains, such as text and image. However, such generalized…

Machine Learning · Computer Science 2025-02-12 Rudrajit Dawn , Madhusudan Ghosh , Partha Basuchowdhuri , Sudip Kumar Naskar