English
Related papers

Related papers: On the Unreasonable Effectiveness of Feature propa…

200 papers

Graph machine learning has enjoyed a meteoric rise in popularity since the introduction of deep learning in graph contexts. This is no surprise due to the ubiquity of graph data in large scale industrial settings. Tacitly assumed in all…

Machine Learning · Computer Science 2024-12-10 Isay Katsman , Ethan Lou , Anna Gilbert

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by additionally making use of graph structure based on the relational inductive bias (edge bias), rather than treating the nodes as collections of independent and identically…

Machine Learning · Computer Science 2023-11-07 Sitao Luan , Chenqing Hua , Qincheng Lu , Jiaqi Zhu , Xiao-Wen Chang , Doina Precup

Despite the recent success of Graph Neural Networks, it remains challenging to train a GNN on large graphs with millions of nodes and billions of edges, which are prevalent in many graph-based applications. Traditional sampling-based…

Machine Learning · Computer Science 2022-10-04 Zheng Chai , Guangji Bai , Liang Zhao , Yue Cheng

Graph neural networks (GNNs) are the dominant paradigm for classifying nodes in a graph, but they have several undesirable attributes stemming from their message passing architecture. Recently, distillation methods succeeded in eliminating…

Machine Learning · Computer Science 2024-02-09 Daniel Winter , Niv Cohen , Yedid Hoshen

Graph neural networks (GNNs) are powerful machine learning models for various graph learning tasks. Recently, the limitations of the expressive power of various GNN models have been revealed. For example, GNNs cannot distinguish some…

Machine Learning · Computer Science 2021-01-19 Ryoma Sato , Makoto Yamada , Hisashi Kashima

Towards the challenging problem of semi-supervised node classification, there have been extensive studies. As a frontier, Graph Neural Networks (GNNs) have aroused great interest recently, which update the representation of each node by…

Machine Learning · Computer Science 2020-05-12 Huaxiu Yao , Chuxu Zhang , Ying Wei , Meng Jiang , Suhang Wang , Junzhou Huang , Nitesh V. Chawla , Zhenhui Li

Graph Neural Networks have emerged as a useful tool to learn on the data by applying additional constraints based on the graph structure. These graphs are often created with assumed intrinsic relations between the entities. In recent years,…

Machine Learning · Statistics 2021-05-18 Sunil Kumar Maurya , Xin Liu , Tsuyoshi Murata

Most graph-network-based meta-learning approaches model instance-level relation of examples. We extend this idea further to explicitly model the distribution-level relation of one example to all other examples in a 1-vs-N manner. We propose…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Ling Yang , Liangliang Li , Zilun Zhang , Xinyu Zhou , Erjin Zhou , Yu Liu

Graph Neural Networks (GNNs) have received increasing attention for representation learning in various machine learning tasks. However, most existing GNNs applying neighborhood aggregation usually perform poorly on the graph with…

Machine Learning · Computer Science 2024-10-29 Wei Zhuo , Guang Tan

Although most graph neural networks (GNNs) can operate on graphs of any size, their classification performance often declines on graphs larger than those encountered during training. Existing methods insufficiently address the removal of…

Machine Learning · Computer Science 2024-06-13 Zheng Huang , Qihui Yang , Dawei Zhou , Yujun Yan

Graph neural networks (GNNs) have shown promising results across various graph learning tasks, but they often assume homophily, which can result in poor performance on heterophilic graphs. The connected nodes are likely to be from different…

Machine Learning · Computer Science 2023-05-31 Kai Zhao , Qiyu Kang , Yang Song , Rui She , Sijie Wang , Wee Peng Tay

Graph Neural Networks (GNNs) have shown great power in learning node representations on graphs. However, they may inherit historical prejudices from training data, leading to discriminatory bias in predictions. Although some work has…

Machine Learning · Computer Science 2022-06-13 Yu Wang , Yuying Zhao , Yushun Dong , Huiyuan Chen , Jundong Li , Tyler Derr

Semi-supervised learning on graphs is a widely applicable problem in network science and machine learning. Two standard algorithms -- label propagation and graph neural networks -- both operate by repeatedly passing information along edges,…

Machine Learning · Computer Science 2021-02-02 Junteng Jia , Austin R. Benson

Graph Neural Networks (GNNs) have emerged as potent models for graph learning. Distributing the training process across multiple computing nodes is the most promising solution to address the challenges of ever-growing real-world graphs.…

Machine Learning · Computer Science 2024-05-13 Yuxiang Zhang , Xin Liu , Meng Wu , Wei Yan , Mingyu Yan , Xiaochun Ye , Dongrui Fan

Graph neural networks (GNNs) and label propagation represent two interrelated modeling strategies designed to exploit graph structure in tasks such as node property prediction. The former is typically based on stacked message-passing layers…

Machine Learning · Computer Science 2021-10-15 Yangkun Wang , Jiarui Jin , Weinan Zhang , Yongyi Yang , Jiuhai Chen , Quan Gan , Yong Yu , Zheng Zhang , Zengfeng Huang , David Wipf

While there exists a wide variety of graph neural networks (GNN) for node classification, only a minority of them adopt mechanisms that effectively target noise propagation during the message-passing procedure. Additionally, a very…

Machine Learning · Computer Science 2022-04-26 Steph-Yves Louis , Alireza Nasiri , Fatima J. Rolland , Cameron Mitro , Jianjun Hu

Graph Neural Networks have become one of the indispensable tools to learn from graph-structured data, and their usefulness has been shown in wide variety of tasks. In recent years, there have been tremendous improvements in architecture…

Machine Learning · Statistics 2021-11-15 Sunil Kumar Maurya , Xin Liu , Tsuyoshi Murata

Graph Neural Networks (GNNs) have achieved tremendous success in a variety of real-world applications by relying on the fixed graph data as input. However, the initial input graph might not be optimal in terms of specific downstream tasks,…

Machine Learning · Computer Science 2023-09-22 Beidi Zhao , Boxin Du , Zhe Xu , Liangyue Li , Hanghang Tong

In recent years, Graph Convolutional Networks (GCNs) and their variants have been widely utilized in learning tasks that involve graphs. These tasks include recommendation systems, node classification, among many others. In node…

Machine Learning · Computer Science 2019-12-23 Mustafa Coskun , Burcu Bakir Gungor , Mehmet Koyuturk

The first provably efficient algorithm for learning graph neural networks (GNNs) with one hidden layer for node information convolution is provided in this paper. Two types of GNNs are investigated, depending on whether labels are attached…

Machine Learning · Computer Science 2020-12-08 Qunwei Li , Shaofeng Zou , Wenliang Zhong