English
Related papers

Related papers: Extract the Knowledge of Graph Neural Networks and…

200 papers

The number of traffic accidents has been continuously increasing in recent years worldwide. Many accidents are caused by distracted drivers, who take their attention away from driving. Motivated by the success of Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Dichao Liu , Toshihiko Yamasaki , Yu Wang , Kenji Mase , Jien Kato

Graph neural networks (GNNs) have been applied into a variety of graph tasks. Most existing work of GNNs is based on the assumption that the given graph data is optimal, while it is inevitable that there exists missing or incomplete edges…

Machine Learning · Computer Science 2022-05-13 Qianggang Ding , Deheng Ye , Tingyang Xu , Peilin Zhao

We present a logic based interpretable model for learning on graphs and an algorithm to distill this model from a Graph Neural Network (GNN). Recent results have shown connections between the expressivity of GNNs and the two-variable…

Machine Learning · Computer Science 2024-08-22 Alexander Pluska , Pascal Welke , Thomas Gärtner , Sagar Malhotra

GNN-to-MLP distillation aims to utilize knowledge distillation (KD) to learn computationally-efficient multi-layer perceptron (student MLP) on graph data by mimicking the output representations of teacher GNN. Existing methods mainly make…

Machine Learning · Computer Science 2024-03-07 Ling Yang , Ye Tian , Minkai Xu , Zhongyi Liu , Shenda Hong , Wei Qu , Wentao Zhang , Bin Cui , Muhan Zhang , Jure Leskovec

Graphs serve as fundamental descriptors for systems composed of interacting elements, capturing a wide array of data types, from molecular interactions to social networks and knowledge graphs. In this paper, we present an exhaustive review…

Machine Learning · Computer Science 2024-11-13 Chenqing Hua

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and…

Machine Learning · Computer Science 2022-02-03 Nishai Kooverjee , Steven James , Terence van Zyl

We propose to study the problem of few shot graph classification in graph neural networks (GNNs) to recognize unseen classes, given limited labeled graph examples. Despite several interesting GNN variants being proposed recently for node…

Machine Learning · Computer Science 2022-05-03 Jatin Chauhan , Deepak Nathani , Manohar Kaul

Graph Neural Networks (GNNs) are proficient in graph representation learning and achieve promising performance on versatile tasks such as node classification and link prediction. Usually, a comprehensive hyperparameter tuning is essential…

Machine Learning · Computer Science 2024-10-10 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

Although graph neural networks (GNNs) have made great progress recently on learning from graph-structured data in practice, their theoretical guarantee on generalizability remains elusive in the literature. In this paper, we provide a…

Machine Learning · Computer Science 2020-06-26 Shuai Zhang , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

Graph neural networks (GNNs) have been attracting increasing popularity due to their simplicity and effectiveness in a variety of fields. However, a large number of labeled data is generally required to train these networks, which could be…

Machine Learning · Computer Science 2020-10-26 Shengding Hu , Zheng Xiong , Meng Qu , Xingdi Yuan , Marc-Alexandre Côté , Zhiyuan Liu , Jian Tang

Recent advances in research have demonstrated the effectiveness of knowledge graphs (KG) in providing valuable external knowledge to improve recommendation systems (RS). A knowledge graph is capable of encoding high-order relations that…

Information Retrieval · Computer Science 2020-04-02 Yang Gao , Yi-Fan Li , Yu Lin , Hang Gao , Latifur Khan

The message-passing mechanism helps Graph Neural Networks (GNNs) achieve remarkable results on various node classification tasks. Nevertheless, the recursive nodes fetching and aggregation in message-passing cause inference latency when…

Machine Learning · Computer Science 2022-10-19 Jie Chen , Shouzhen Chen , Mingyuan Bai , Junbin Gao , Junping Zhang , Jian Pu

Fraud detection problems are usually formulated as a machine learning problem on a graph. Recently, Graph Neural Networks (GNNs) have shown solid performance on fraud detection. The successes of most previous methods heavily rely on rich…

Machine Learning · Computer Science 2021-10-05 Chen Wang , Yingtong Dou , Min Chen , Jia Chen , Zhiwei Liu , Philip S. Yu

The knowledge of a well-trained deep neural network (a.k.a. the "teacher") is valuable for learning similar tasks. Knowledge distillation extracts knowledge from the teacher and integrates it with the target model (a.k.a. the "student"),…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Han-Jia Ye , Su Lu , De-Chuan Zhan

Graph neural networks (GNNs) are widely used for learning node embeddings in graphs, typically adopting a message-passing scheme. This approach, however, leads to the neighbor explosion problem, with exponentially growing computational and…

Machine Learning · Computer Science 2025-07-08 Zichao Yue , Chenhui Deng , Zhiru Zhang

The task of graph node classification is often approached by utilizing a local Graph Neural Network (GNN), that learns only local information from the node input features and their adjacency. In this paper, we propose to improve the…

Machine Learning · Computer Science 2024-06-18 Moshe Eliasof , Eran Treister

Recently, research efforts have been concentrated on revealing how pre-trained model makes a difference in neural network performance. Self-supervision and semi-supervised learning technologies have been extensively explored by the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Cheng Cui , Ruoyu Guo , Yuning Du , Dongliang He , Fu Li , Zewu Wu , Qiwen Liu , Shilei Wen , Jizhou Huang , Xiaoguang Hu , Dianhai Yu , Errui Ding , Yanjun Ma

Benefiting from the injection of human prior knowledge, graphs, as derived discrete data, are semantically dense so that models can efficiently learn the semantic information from such data. Accordingly, graph neural networks (GNNs) indeed…

Machine Learning · Computer Science 2023-05-25 Hang Gao , Jiangmeng Li , Wenwen Qiang , Lingyu Si , Xingzhe Su , Fengge Wu , Changwen Zheng , Fuchun Sun

Graph neural networks (GNNs) have received massive attention in the field of machine learning on graphs. Inspired by the success of neural networks, a line of research has been conducted to train GNNs to deal with various tasks, such as…

Machine Learning · Computer Science 2022-04-11 Manh Tuan Do , Noseong Park , Kijung Shin

Graph neural networks (GNNs) have gained traction over the past few years for their superior performance in numerous machine learning tasks. Graph Convolutional Neural Networks (GCN) are a common variant of GNNs that are known to have high…

Machine Learning · Computer Science 2022-07-06 Sannat Singh Bhasin , Vaibhav Holani , Divij Sanjanwala