English
Related papers

Related papers: Graph Distillation with Eigenbasis Matching

200 papers

Although the convolutional neural network (CNN) has achieved excellent performance in vision tasks by extracting the intra-sample representation, it will take a higher training expense because of stacking numerous convolutional layers.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ziheng Jiao , Hongyuan Zhang , Xuelong Li

Even pruned by the state-of-the-art network compression methods, Graph Neural Networks (GNNs) training upon non-Euclidean graph data often encounters relatively higher time costs, due to its irregular and nasty density properties, compared…

Machine Learning · Computer Science 2022-10-04 Chunhui Zhang , Chao Huang , Yijun Tian , Qianlong Wen , Zhongyu Ouyang , Youhuan Li , Yanfang Ye , Chuxu Zhang

Knowledge distillation (KD) transfers knowledge from a teacher network to a student by enforcing the student to mimic the outputs of the pretrained teacher on training data. However, data samples are not always accessible in many cases due…

Machine Learning · Computer Science 2021-11-30 Xiang Deng , Zhongfei Zhang

The network embedding problem that maps nodes in a graph to vectors in Euclidean space can be very useful for addressing several important tasks on a graph. Recently, graph neural networks (GNNs) have been proposed for solving such a…

Machine Learning · Computer Science 2020-09-23 Ping-En Lu , Cheng-Shang Chang

Despite the recent success of Graph Neural Networks, it remains challenging to train a GNN on large graphs with millions of nodes and billions of edges, which are prevalent in many graph-based applications. Traditional sampling-based…

Machine Learning · Computer Science 2022-10-04 Zheng Chai , Guangji Bai , Liang Zhao , Yue Cheng

As graph data grows increasingly complicate, training graph neural networks (GNNs) on large-scale datasets presents significant challenges, including computational resource constraints, data redundancy, and transmission inefficiencies.…

Machine Learning · Computer Science 2025-12-05 Liangliang Zhang , Haoran Bao , Yao Ma

The Graph Convolutional Network (GCN) model and its variants are powerful graph embedding tools for facilitating classification and clustering on graphs. However, a major challenge is to reduce the complexity of layered GCNs and make them…

Machine Learning · Computer Science 2020-08-06 Hanqing Zeng , Hongkuan Zhou , Ajitesh Srivastava , Rajgopal Kannan , Viktor Prasanna

Graph condensation (GC) is an emerging technique designed to learn a significantly smaller graph that retains the essential information of the original graph. This condensed graph has shown promise in accelerating graph neural networks…

Machine Learning · Computer Science 2025-11-11 Shengbo Gong , Juntong Ni , Noveen Sachdeva , Carl Yang , Wei Jin

Most real-world networks are noisy and incomplete samples from an unknown target distribution. Refining them by correcting corruptions or inferring unobserved regions typically improves downstream performance. Inspired by the impressive…

Graph Neural Networks (GNNs) have shown satisfying performance on various graph learning tasks. To achieve better fitting capability, most GNNs are with a large number of parameters, which makes these GNNs computationally expensive.…

Machine Learning · Computer Science 2023-01-05 Yushun Dong , Binchi Zhang , Yiling Yuan , Na Zou , Qi Wang , Jundong Li

The advent of Graph Neural Networks (GNNs) has revolutionized the field of machine learning, offering a novel paradigm for learning on graph-structured data. Unlike traditional neural networks, GNNs are capable of capturing complex…

Hardware Architecture · Computer Science 2024-06-26 Kaustubh Shivdikar

Graph-level anomaly detection (GAD) describes the problem of detecting graphs that are abnormal in their structure and/or the features of their nodes, as compared to other graphs. One of the challenges in GAD is to devise graph…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Rongrong Ma , Guansong Pang , Ling Chen , Anton van den Hengel

Recent advances in event-based research prioritize sparsity and temporal precision. Approaches using dense frame-based representations processed via well-pretrained CNNs are being replaced by the use of sparse point-based representations…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yongjian Deng , Hao Chen , Bochen Xie , Hai Liu , Youfu Li

This paper presents a spectral framework for quantifying the differentiation between graph data samples by introducing a novel metric named Graph Geodesic Distance (GGD). For two different graphs with the same number of nodes, our framework…

Machine Learning · Computer Science 2025-08-18 Soumen Sikder Shuvo , Ali Aghdaei , Zhuo Feng

Node classifiers are required to comprehensively reduce prediction errors, training resources, and inference latency in the industry. However, most graph neural networks (GNN) concentrate only on one or two of them. The compromised aspects…

Machine Learning · Computer Science 2023-06-01 Yi Luo , Guangchun Luo , Ke Qin , Aiguo Chen

Graph neural networks (GNNs) have been widely used in modeling graph structured data, owing to its impressive performance in a wide range of practical applications. Recently, knowledge distillation (KD) for GNNs has enabled remarkable…

Machine Learning · Computer Science 2022-06-17 Yuanxin Zhuang , Lingjuan Lyu , Chuan Shi , Carl Yang , Lichao Sun

Graph neural networks (GNNs) have shown remarkable performance on diverse graph mining tasks. Although different GNNs can be unified as the same message passing framework, they learn complementary knowledge from the same graph. Knowledge…

Machine Learning · Computer Science 2023-04-06 Zhichun Guo , Chunhui Zhang , Yujie Fan , Yijun Tian , Chuxu Zhang , Nitesh Chawla

Graph Similarity Computation (GSC) is a fundamental graph related task where Graph Edit Distance (GED) serves as a prevalent metric. GED is determined by an optimal alignment between a pair of graphs that partitions each into aligned…

Machine Learning · Computer Science 2025-11-26 Zhentao Zhan , Xiaoliang Xu , Jingjing Wang , Junmei Wang

Graph neural networks (GNNs) integrate deep architectures and topological structure modeling in an effective way. However, the performance of existing GNNs would decrease significantly when they stack many layers, because of the…

Machine Learning · Computer Science 2021-07-07 Kaixiong Zhou , Xiao Huang , Daochen Zha , Rui Chen , Li Li , Soo-Hyun Choi , Xia Hu

Graph condensation (GC) aims to distill the original graph into a small-scale graph, mitigating redundancy and accelerating GNN training. However, conventional GC approaches heavily rely on rigid GNNs and task-specific supervision. Such a…

Machine Learning · Computer Science 2025-09-19 Yeyu Yan , Shuai Zheng , Wenjun Hui , Xiangkai Zhu , Dong Chen , Zhenfeng Zhu , Yao Zhao , Kunlun He