English
Related papers

Related papers: ROD: Reception-aware Online Distillation for Spars…

200 papers

The increased amount of multi-modal medical data has opened the opportunities to simultaneously process various modalities such as imaging and non-imaging data to gain a comprehensive insight into the disease prediction domain. Recent…

Machine Learning · Computer Science 2021-11-24 Mahsa Ghorbani , Mojtaba Bahrami , Anees Kazi , Mahdieh SoleymaniBaghshah , Hamid R. Rabiee , Nassir Navab

Open-set graph learning is a practical task that aims to classify the known class nodes and to identify unknown class samples as unknowns. Conventional node classification methods usually perform unsatisfactorily in open-set scenarios due…

Machine Learning · Computer Science 2024-03-01 Qin Zhang , Xiaowei Li , Jiexin Lu , Liping Qiu , Shirui Pan , Xiaojun Chen , Junyang Chen

Recently, the teacher-student knowledge distillation framework has demonstrated its potential in training Graph Neural Networks (GNNs). However, due to the difficulty of training over-parameterized GNN models, one may not easily obtain a…

Machine Learning · Computer Science 2021-05-03 Yuzhao Chen , Yatao Bian , Xi Xiao , Yu Rong , Tingyang Xu , Junzhou Huang

Graph diffusion models have recently been proposed to synthesize entire graphs, such as molecule graphs. Although existing methods have shown great performance in generating entire graphs for graph-level learning tasks, no graph diffusion…

Machine Learning · Computer Science 2025-03-18 Yancheng Wang , Changyu Liu , Yingzhen Yang

Graph Neural Networks (GNNs) have been successfully applied to many real-world static graphs. However, the success of static graphs has not fully translated to dynamic graphs due to the limitations in model design, evaluation settings, and…

Machine Learning · Computer Science 2022-08-16 Jiaxuan You , Tianyu Du , Jure Leskovec

There has been a recent surge of interest in designing Graph Neural Networks (GNNs) for semi-supervised learning tasks. Unfortunately this work has assumed that the nodes labeled for use in training were selected uniformly at random (i.e.…

Machine Learning · Computer Science 2021-10-28 Qi Zhu , Natalia Ponomareva , Jiawei Han , Bryan Perozzi

Graph neural networks (GNNs) achieve strong performance on homophilic graphs but often struggle under heterophily, where adjacent nodes frequently belong to different classes. We propose an interpretable and adaptive framework for…

Machine Learning · Computer Science 2025-12-30 Soroush Vahidi

Few-shot node classification poses a significant challenge for Graph Neural Networks (GNNs) due to insufficient supervision and potential distribution shifts between labeled and unlabeled nodes. Self-training has emerged as a widely popular…

Machine Learning · Computer Science 2024-01-22 Fali Wang , Tianxiang Zhao , Suhang Wang

Graph Neural Networks (GNNs) are versatile, powerful machine learning methods that enable graph structure and feature representation learning, and have applications across many domains. For applications critically requiring interpretation,…

Machine Learning · Computer Science 2020-07-02 Chris Lin , Gerald J. Sun , Krishna C. Bulusu , Jonathan R. Dry , Marylens Hernandez

Graph convolutional networks have made great progress in graph-based semi-supervised learning. Existing methods mainly assume that nodes connected by graph edges are prone to have similar attributes and labels, so that the features smoothed…

Machine Learning · Computer Science 2022-06-13 Yating Ren , Junzhong Ji , Lingfeng Niu , Minglong Lei

Despite the recent success of Graph Neural Networks, it remains challenging to train a GNN on large graphs with millions of nodes and billions of edges, which are prevalent in many graph-based applications. Traditional sampling-based…

Machine Learning · Computer Science 2022-10-04 Zheng Chai , Guangji Bai , Liang Zhao , Yue Cheng

Graph Neural Networks (GNNs) with numerical node features and graph structure as inputs have demonstrated superior performance on various supervised learning tasks with graph data. However the numerical node features utilized by GNNs are…

Machine Learning · Computer Science 2022-06-20 Jiuhai Chen , Jonas Mueller , Vassilis N. Ioannidis , Tom Goldstein , David Wipf

Graph neural networks (GNNs) are one of the most popular research topics for deep learning. GNN methods typically have been designed on top of the graph signal processing theory. In particular, diffusion equations have been widely used for…

Machine Learning · Computer Science 2023-06-16 Jeongwhan Choi , Seoyoung Hong , Noseong Park , Sung-Bae Cho

Despite graph neural networks' (GNNs) great success in modelling graph-structured data, out-of-distribution (OOD) test instances still pose a great challenge for current GNNs. One of the most effective techniques to detect OOD nodes is to…

Machine Learning · Computer Science 2025-04-11 Danny Wang , Ruihong Qiu , Guangdong Bai , Zi Huang

Existing knowledge distillation methods focus on convolutional neural networks (CNNs), where the input samples like images lie in a grid domain, and have largely overlooked graph convolutional networks (GCN) that handle non-grid data. In…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Yiding Yang , Jiayan Qiu , Mingli Song , Dacheng Tao , Xinchao Wang

In this paper, we provide a theory of using graph neural networks (GNNs) for multi-node representation learning (where we are interested in learning a representation for a set of more than one node, such as link). We know that GNN is…

Machine Learning · Computer Science 2022-01-19 Muhan Zhang , Pan Li , Yinglong Xia , Kai Wang , Long Jin

Signed Graph Neural Networks (SGNNs) are widely adopted to analyze complex patterns in signed graphs with both positive and negative links. Given the noisy nature of real-world connections, the robustness of SGNN has also emerged as a…

Machine Learning · Computer Science 2025-10-28 Junran Wu , Beng Chin Ooi , Ke Xu

Node representation learning by using Graph Neural Networks (GNNs) has been widely explored. However, in recent years, compelling evidence has revealed that GNN-based node representation learning can be substantially deteriorated by…

Machine Learning · Computer Science 2023-12-19 Jun Zhuang , Mohammad Al Hasan

Deep graph neural networks (GNNs) have been shown to be expressive for modeling graph-structured data. Nevertheless, the over-stacked architecture of deep graph models makes it difficult to deploy and rapidly test on mobile or embedded…

Machine Learning · Computer Science 2022-05-25 Huarui He , Jie Wang , Zhanqiu Zhang , Feng Wu

Graph Neural Networks (GNNs) are the go-to model for graph data analysis. However, GNNs rely on two key operations - aggregation and update, which can pose challenges for low-latency inference tasks or resource-constrained scenarios. Simple…

Machine Learning · Computer Science 2026-01-14 Amir Eskandari , Aman Anand , Elyas Rashno , Farhana Zulkernine