English
Related papers

Related papers: Memorization in Graph Neural Networks

200 papers

Graph Neural Networks (GNNs) excel at analyzing graph-structured data but struggle on heterophilic graphs, where connected nodes often belong to different classes. While this challenge is commonly addressed with specialized GNN…

Machine Learning · Computer Science 2025-05-20 Harel Mendelman , Haggai Maron , Ronen Talmon

Homophily principle, i.e., nodes with the same labels are more likely to be connected, has been believed to be the main reason for the performance superiority of Graph Neural Networks (GNNs) over Neural Networks on node classification…

Social and Information Networks · Computer Science 2024-01-03 Sitao Luan , Chenqing Hua , Minkai Xu , Qincheng Lu , Jiaqi Zhu , Xiao-Wen Chang , Jie Fu , Jure Leskovec , Doina Precup

Graph neural networks (GNNs) have achieved great success in various graph problems. However, most GNNs are Message Passing Neural Networks (MPNNs) based on the homophily assumption, where nodes with the same label are connected in graphs.…

Machine Learning · Computer Science 2022-10-18 Junjie Xu , Enyan Dai , Xiang Zhang , Suhang Wang

Graph Neural Networks (GNNs) have achieved remarkable performance in modeling graphs for various applications. However, most existing GNNs assume the graphs exhibit strong homophily in node labels, i.e., nodes with similar labels are…

Machine Learning · Computer Science 2023-02-20 Enyan Dai , Shijie Zhou , Zhimeng Guo , Suhang Wang

Graph Neural Networks (GNNs) have been predominant for graph learning tasks; however, recent studies showed that a well-known graph algorithm, Label Propagation (LP), combined with a shallow neural network can achieve comparable performance…

Machine Learning · Computer Science 2022-12-01 Zhiqiang Zhong , Sergey Ivanov , Jun Pang

Homophily principle, \ie{} nodes with the same labels or similar attributes are more likely to be connected, has been commonly believed to be the main reason for the superiority of Graph Neural Networks (GNNs) over traditional Neural…

Graph Neural Networks (GNNs) bring the power of deep representation learning to graph and relational data and achieve state-of-the-art performance in many applications. GNNs compute node representations by taking into account the topology…

Machine Learning · Computer Science 2021-09-10 Maria Kalantzi , George Karypis

Graph Neural Network (GNN) research has highlighted a relationship between high homophily (i.e., the tendency of nodes of the same class to connect) and strong predictive performance in node classification. However, recent work has found…

Social and Information Networks · Computer Science 2023-11-22 Donald Loveland , Jiong Zhu , Mark Heimann , Benjamin Fish , Michael T. Schaub , Danai Koutra

Graph Neural Networks (GNNs) have been highly successful for the node classification task. GNNs typically assume graphs are homophilic, i.e. neighboring nodes are likely to belong to the same class. However, a number of real-world graphs…

Machine Learning · Computer Science 2024-09-20 Yurui Lai , Taiyan Zhang , Rui Fan

Graph Neural Networks (GNNs) have emerged as a powerful tool for semi-supervised node classification tasks. However, recent studies have revealed various biases in GNNs stemming from both node features and graph topology. In this work, we…

Machine Learning · Computer Science 2023-05-26 Haoyu Han , Xiaorui Liu , Feng Shi , MohamadAli Torkamani , Charu C. Aggarwal , Jiliang Tang

We bridge two research directions on graph neural networks (GNNs), by formalizing the relation between heterophily of node labels (i.e., connected nodes tend to have dissimilar labels) and the robustness of GNNs to adversarial attacks. Our…

Machine Learning · Computer Science 2022-07-26 Jiong Zhu , Junchen Jin , Donald Loveland , Michael T. Schaub , Danai Koutra

Deep neural networks (DNNs) can easily fit a random labeling of the training data with zero training error. What is the difference between DNNs trained with random labels and the ones trained with true labels? Our paper answers this…

Machine Learning · Computer Science 2019-11-22 Jindong Gu , Volker Tresp

Graph Neural Networks (GNNs) are popular machine learning methods for modeling graph data. A lot of GNNs perform well on homophily graphs while having unsatisfactory performance on heterophily graphs. Recently, some researchers turn their…

Machine Learning · Computer Science 2022-09-20 Wendong Bi , Lun Du , Qiang Fu , Yanlin Wang , Shi Han , Dongmei Zhang

We investigate the representation power of graph neural networks in the semi-supervised node classification task under heterophily or low homophily, i.e., in networks where connected nodes may have different class labels and dissimilar…

Machine Learning · Computer Science 2020-10-26 Jiong Zhu , Yujun Yan , Lingxiao Zhao , Mark Heimann , Leman Akoglu , Danai Koutra

Label propagation is a powerful and flexible semi-supervised learning technique on graphs. Neural networks, on the other hand, have proven track records in many supervised learning tasks. In this work, we propose a training framework with a…

Machine Learning · Computer Science 2017-03-16 Thang D. Bui , Sujith Ravi , Vivek Ramavajjala

Node classification on graphs is a significant task with a wide range of applications, including social analysis and anomaly detection. Even though graph neural networks (GNNs) have produced promising results on this task, current…

Machine Learning · Computer Science 2023-06-16 Jingyang Yuan , Xiao Luo , Yifang Qin , Yusheng Zhao , Wei Ju , Ming Zhang

Graph Neural Networks (GNNs) often assume strong homophily for graph classification, seldom considering heterophily, which means connected nodes tend to have different class labels and dissimilar features. In real-world scenarios, graphs…

Machine Learning · Computer Science 2024-05-10 Jiayi Yang , Sourav Medya , Wei Ye

Graph representation learning aim at integrating node contents with graph structure to learn nodes/graph representations. Nevertheless, it is found that many existing graph learning methods do not work well on data with high heterophily…

Machine Learning · Computer Science 2023-10-13 Jincheng Huang , Ping Li , Rui Huang , Chen Na , Acong Zhang

Under circumstances of heterophily, where nodes with different labels tend to be connected based on semantic meanings, Graph Neural Networks (GNNs) often exhibit suboptimal performance. Current studies on graph heterophily mainly focus on…

Machine Learning · Computer Science 2024-11-13 Yilun Zheng , Jiahao Xu , Lihui Chen

Graph Neural Networks have shown excellent performance on semi-supervised classification tasks. However, they assume access to a graph that may not be often available in practice. In the absence of any graph, constructing k-Nearest Neighbor…

Machine Learning · Computer Science 2021-02-23 Vijay Lingam , Arun Iyer , Rahul Ragesh
‹ Prev 1 2 3 10 Next ›