中文
相关论文

相关论文: Teaching Yourself: Graph Self-Distillation on Neig…

200 篇论文

Knowledge distillation, a technique recently gaining popularity for enhancing model generalization in Convolutional Neural Networks (CNNs), operates under the assumption that both teacher and student models are trained on identical data…

机器学习 · 计算机科学 2024-12-06 Can Wang , Zhe Wang , Defang Chen , Sheng Zhou , Yan Feng , Chun Chen

To bridge the gaps between powerful Graph Neural Networks (GNNs) and lightweight Multi-Layer Perceptron (MLPs), GNN-to-MLP Knowledge Distillation (KD) proposes to distill knowledge from a well-trained teacher GNN into a student MLP. In this…

机器学习 · 计算机科学 2024-07-23 Lirong Wu , Yunfan Liu , Haitao Lin , Yufei Huang , Stan Z. Li

Recent works have introduced GNN-to-MLP knowledge distillation (KD) frameworks to combine both GNN's superior performance and MLP's fast inference speed. However, existing KD frameworks are primarily designed for node classification within…

机器学习 · 计算机科学 2024-07-01 Tianjun Yao , Jiaqi Sun , Defu Cao , Kun Zhang , Guangyi Chen

Semi-supervised node classification on graphs is an important research problem, with many real-world applications in information retrieval such as content classification on a social network and query intent classification on an e-commerce…

机器学习 · 计算机科学 2022-03-29 Zhihao Wen , Yuan Fang , Zemin Liu

Machine learning frameworks such as graph neural networks typically rely on a given, fixed graph to exploit relational inductive biases and thus effectively learn from network data. However, when said graphs are (partially) unobserved,…

机器学习 · 计算机科学 2022-05-20 Max Wasserman , Saurabh Sihag , Gonzalo Mateos , Alejandro Ribeiro

Graph neural networks (GNNs) are a popular class of machine learning models whose major advantage is their ability to incorporate a sparse and discrete dependency structure between data points. Unfortunately, GNNs can only be used when such…

机器学习 · 计算机科学 2020-06-22 Luca Franceschi , Mathias Niepert , Massimiliano Pontil , Xiao He

Despite the success of Graph Neural Networks (GNNs) on various applications, GNNs encounter significant performance degradation when the amount of supervision signals, i.e., number of labeled nodes, is limited, which is expected as GNNs are…

机器学习 · 计算机科学 2022-04-29 Junseok Lee , Yunhak Oh , Yeonjun In , Namkyeong Lee , Dongmin Hyun , Chanyoung Park

Graph neural networks (GNNs) demonstrate a robust capability for representation learning on graphs with complex structures, showcasing superior performance in various applications. The majority of existing GNNs employ a graph convolution…

机器学习 · 计算机科学 2025-02-19 Jinlu Wang , Jipeng Guo , Yanfeng Sun , Junbin Gao , Shaofan Wang , Yachao Yang , Baocai Yin

Graph neural networks (GNNs) have demonstrated superior performance for semi-supervised node classification on graphs, as a result of their ability to exploit node features and topological information simultaneously. However, most GNNs…

机器学习 · 计算机科学 2022-06-24 Guoji Fu , Peilin Zhao , Yatao Bian

The recent introduction of Graph Neural Networks (GNNs) and their growing popularity in the past few years has enabled the application of deep learning algorithms to non-Euclidean, graph-structured data. GNNs have achieved state-of-the-art…

机器学习 · 计算机科学 2020-10-27 Tuomas P. Oikarinen , Daniel C. Hannah , Sohrob Kazerounian

We propose AGS-GNN, a novel attribute-guided sampling algorithm for Graph Neural Networks (GNNs) that exploits node features and connectivity structure of a graph while simultaneously adapting for both homophily and heterophily in graphs.…

机器学习 · 计算机科学 2024-05-27 Siddhartha Shankar Das , S M Ferdous , Mahantesh M Halappanavar , Edoardo Serra , Alex Pothen

Graph convolutional networks (GCNs) have recently become one of the most powerful tools for graph analytics tasks in numerous applications, ranging from social networks and natural language processing to bioinformatics and chemoinformatics,…

机器学习 · 计算机科学 2019-04-05 Fengwen Chen , Shirui Pan , Jing Jiang , Huan Huo , Guodong Long

Improving the training and inference performance of graph neural networks (GNNs) is faced with a challenge uncommon in general neural networks: creating mini-batches requires a lot of computation and data movement due to the exponential…

One of the most challenging problems in graph machine learning is generalizing across graphs with diverse properties. Graph neural networks (GNNs) face a fundamental limitation: they require separate training for each new graph, preventing…

机器学习 · 计算机科学 2026-04-22 Jeongwhan Choi , Jongwoo Kim , Woosung Kang , Noseong Park

Graph Neural Networks (GNNs) combine node attributes over a fixed granularity of the local graph structure around a node to predict its label. However, different nodes may relate to a node-level property with a different granularity of its…

机器学习 · 计算机科学 2025-06-19 Kartik Sharma , Vineeth Rakesh , Yingtong Dou , Srijan Kumar , Mahashweta Das

Graph structure learning (GSL), which aims to learn the adjacency matrix for graph neural networks (GNNs), has shown great potential in boosting the performance of GNNs. Most existing GSL works apply a joint learning framework where the…

机器学习 · 计算机科学 2023-03-02 Jianan Zhao , Qianlong Wen , Mingxuan Ju , Chuxu Zhang , Yanfang Ye

Graph neural networks (GNNs) are widely applied in graph data modeling. However, existing GNNs are often trained in a task-driven manner that fails to fully capture the intrinsic nature of the graph structure, resulting in sub-optimal node…

机器学习 · 计算机科学 2024-07-17 Zhenhua Huang , Kunhao Li , Shaojie Wang , Zhaohong Jia , Wentao Zhu , Sharad Mehrotra

Graph Neural Networks (GNNs) have recently been applied to graph learning tasks and achieved state-of-the-art (SOTA) results. However, many competitive methods run GNNs multiple times with subgraph extraction and customized labeling to…

机器学习 · 计算机科学 2023-02-14 Lecheng Kong , Yixin Chen , Muhan Zhang

Graph neural networks (GNNs) are able to achieve promising performance on multiple graph downstream tasks such as node classification and link prediction. Comparatively lesser work has been done to design GNNs which can operate directly for…

社会与信息网络 · 计算机科学 2021-10-20 Sambaran Bandyopadhyay , Vishal Peter

The decoupled Graph Convolutional Network (GCN), a recent development of GCN that decouples the neighborhood aggregation and feature transformation in each convolutional layer, has shown promising performance for graph representation…

机器学习 · 计算机科学 2022-11-16 Jinsong Chen , Boyu Li , Kun He