English
Related papers

Related papers: Training Robust Graph Neural Networks with Topolog…

200 papers

Graph Neural Networks (GNNs) face a fundamental adaptability challenge: their fixed message-passing architectures struggle with the immense diversity of real-world graphs, where optimal computational strategies vary by local structure and…

Machine Learning · Computer Science 2025-10-27 Yunlong Chu , Minglai Shao , Zengyi Wo , Bing Hao , Yuhang Liu , Ruijie Wang , Jianxin Li

Graph unlearning methods aim to efficiently remove the impact of sensitive data from trained GNNs without full retraining, assuming that deleted information cannot be recovered. In this work, we challenge this assumption by introducing the…

Machine Learning · Computer Science 2025-12-09 Jiahao Zhang , Yilong Wang , Zhiwei Zhang , Xiaorui Liu , Suhang Wang

Catastrophic forgetting refers to the tendency that a neural network "forgets" the previous learned knowledge upon learning new tasks. Prior methods have been focused on overcoming this problem on convolutional neural networks (CNNs), where…

Machine Learning · Computer Science 2020-12-14 Huihui Liu , Yiding Yang , Xinchao Wang

Previous studies have demonstrated the strong performance of Graph Neural Networks (GNNs) in node classification. However, most existing GNNs adopt a node-centric perspective and rely on global message passing, leading to high computational…

Machine Learning · Computer Science 2026-01-14 Qian Zeng , Xin Lin , Jingyi Gao , Yang Yu

Recently emerged Topological Deep Learning (TDL) methods aim to extend current Graph Neural Networks (GNN) by naturally processing higher-order interactions, going beyond the pairwise relations and local neighborhoods defined by graph…

Data augmentation helps neural networks generalize better by enlarging the training set, but it remains an open question how to effectively augment graph data to enhance the performance of GNNs (Graph Neural Networks). While most existing…

Machine Learning · Computer Science 2022-03-30 Kezhi Kong , Guohao Li , Mucong Ding , Zuxuan Wu , Chen Zhu , Bernard Ghanem , Gavin Taylor , Tom Goldstein

Graph neural networks (GNNs), which learn the representation of a node by aggregating its neighbors, have become an effective computational tool in downstream applications. Over-smoothing is one of the key issues which limit the performance…

Machine Learning · Computer Science 2020-06-15 Kaixiong Zhou , Xiao Huang , Yuening Li , Daochen Zha , Rui Chen , Xia Hu

Graph neural network (GNN) has shown convincing performance in learning powerful node representations that preserve both node attributes and graph structural information. However, many GNNs encounter problems in effectiveness and efficiency…

Machine Learning · Computer Science 2022-01-03 Jiyang Bai , Yuxiang Ren , Jiawei Zhang

Learning-based methods have become increasingly popular for solving vehicle routing problems due to their near-optimal performance and fast inference speed. Among them, the combination of deep reinforcement learning and graph representation…

Machine Learning · Computer Science 2024-05-22 Zhenwei Wang , Ruibin Bai , Fazlullah Khan , Ender Ozcan , Tiehua Zhang

Geometric deep learning (GDL) models have demonstrated a great potential for the analysis of non-Euclidian data. They are developed to incorporate the geometric and topological information of non-Euclidian data into the end-to-end deep…

Machine Learning · Computer Science 2023-06-26 Cong Shen , Xiang Liu , Jiawei Luo , Kelin Xia

Recently, fine-tuning large-scale pre-trained GNNs has yielded remarkable attention in adapting pre-trained GNN models for downstream graph learning tasks. One representative fine-tuning method is to exploit adapter (termed AdapterGNN)…

Machine Learning · Computer Science 2025-11-25 Bo Jiang , Weijun Zhao , Beibei Wang , Xiao Wang , Jin Tang

Neural networks often struggle with high-dimensional but small sample-size tabular datasets. One reason is that current weight initialisation methods assume independence between weights, which can be problematic when there are insufficient…

Machine Learning · Computer Science 2024-08-20 Andrei Margeloiu , Nikola Simidjievski , Pietro Lio , Mateja Jamnik

Graph Neural Networks (GNNs) have demonstrated commendable performance for graph-structured data. Yet, GNNs are often vulnerable to adversarial structural attacks as embedding generation relies on graph topology. Existing efforts are…

Machine Learning · Computer Science 2024-09-04 Xing Ai , Guanyu Zhu , Yulin Zhu , Yu Zheng , Gaolei Li , Jianhua Li , Kai Zhou

Graph Neural Networks (GNNs) have led to state-of-the-art performance on a variety of machine learning tasks such as recommendation, node classification and link prediction. Graph neural network models generate node embeddings by merging…

Machine Learning · Computer Science 2020-11-04 Yunpeng Weng , Xu Chen , Liang Chen , Wei Liu

Graph-based data present unique challenges and opportunities for machine learning. Graph Neural Networks (GNNs), and especially those algorithms that capture graph topology through message passing for neighborhood aggregation, have been a…

Machine Learning · Computer Science 2024-04-19 Zheyi Qin , Randy Paffenroth , Anura P. Jayasumana

Graph neural networks frequently encounter significant performance degradation when confronted with structural noise or non-homophilous topologies. To address these systemic vulnerabilities, we present AdvSynGNN, a comprehensive…

Machine Learning · Computer Science 2026-04-14 Rong Fu , Muge Qi , Chunlei Meng , Shuo Yin , Kun Liu , Zhaolu Kang , Simon Fong

Graph Attention Networks (GATs) are the state-of-the-art neural architecture for representation learning with graphs. GATs learn attention functions that assign weights to nodes so that different nodes have different influences in the…

Machine Learning · Computer Science 2019-10-29 Guangtao Wang , Rex Ying , Jing Huang , Jure Leskovec

We present a novel set of rigorous and computationally efficient topology-based complexity notions that exhibit a strong correlation with the generalization gap in modern deep neural networks (DNNs). DNNs show remarkable generalization…

Machine Learning · Computer Science 2024-12-17 Rayna Andreeva , Benjamin Dupuis , Rik Sarkar , Tolga Birdal , Umut Şimşekli

Artificial Neural Networks (ANNs) require significant amounts of data and computational resources to achieve high effectiveness in performing the tasks for which they are trained. To reduce resource demands, various techniques, such as…

Neural and Evolutionary Computing · Computer Science 2024-12-04 A. Stolarek , W. Jaworek

Graph neural networks (GNNs) have demonstrated great success in representation learning for graph-structured data. The layer-wise graph convolution in GNNs is shown to be powerful at capturing graph topology. During this process, GNNs are…

Machine Learning · Computer Science 2021-12-10 Mingxuan Ju , Shifu Hou , Yujie Fan , Jianan Zhao , Liang Zhao , Yanfang Ye