English
Related papers

Related papers: Graph Distillation with Eigenbasis Matching

200 papers

Graph domain adaptation (GDA) aims to transfer knowledge from a labeled source graph to an unlabeled target graph under distribution shifts. However, existing methods are largely feature-centric and overlook structural discrepancies, which…

Machine Learning · Computer Science 2026-04-06 Yingxu Wang , Kunyu Zhang , Jiaxin Huang , Mengzhu Wang , Mingyan Xiao , Siyang Gao , Nan Yin

As training deep learning models on large dataset takes a lot of time and resources, it is desired to construct a small synthetic dataset with which we can train deep learning models sufficiently. There are recent works that have explored…

Machine Learning · Computer Science 2022-09-12 Wei Jin , Xianfeng Tang , Haoming Jiang , Zheng Li , Danqing Zhang , Jiliang Tang , Bing Yin

Graph Neural Networks (GNNs) are pivotal in graph-based learning, particularly excelling in node classification. However, their scalability is hindered by the need for multi-hop data during inference, limiting their application in…

Machine Learning · Computer Science 2025-05-30 Ziang Zhou , Zhihao Ding , Jieming Shi , Qing Li , Shiqi Shen

Graph similarity computation (GSC) aims to quantify the similarity score between two graphs. Although recent GSC methods based on graph neural networks (GNNs) take advantage of intra-graph structures in message passing, few of them fully…

Machine Learning · Computer Science 2024-11-07 Wenjun Wang , Jiacheng Lu , Kejia Chen , Zheng Liu , Shilong Sang

Recently, motivated by real applications, a major research direction in graph neural networks (GNNs) is to explore deeper structures. For instance, the graph connectivity is not always consistent with the label distribution (e.g., the…

Machine Learning · Computer Science 2022-10-26 Lecheng Zheng , Dongqi Fu , Ross Maciejewski , Jingrui He

Graph similarity computation is one of the core operations in many graph-based applications, such as graph similarity search, graph database analysis, graph clustering, etc. Since computing the exact distance/similarity between two graphs…

Machine Learning · Computer Science 2021-05-18 Yunsheng Bai , Hao Ding , Yizhou Sun , Wei Wang

Graph Convolutional Networks (GCN) is a pioneering model for graph-based semi-supervised learning. However, GCN does not perform well on sparsely-labeled graphs. Its two-layer version cannot effectively propagate the label information to…

Machine Learning · Computer Science 2025-02-24 Wei Ye , Zexi Huang , Yunqi Hong , Ambuj Singh

Graph Neural Networks (GNNs) have gained considerable prominence in semi-supervised learning tasks in processing graph-structured data, primarily owing to their message-passing mechanism, which largely relies on the availability of clean…

Machine Learning · Computer Science 2024-11-07 Shuangjie Li , Baoming Zhang , Jianqing Song , Gaoli Ruan , Chongjun Wang , Junyuan Xie

Graph Neural Networks (GNNs) have led to state-of-the-art performance on a variety of machine learning tasks such as recommendation, node classification and link prediction. Graph neural network models generate node embeddings by merging…

Machine Learning · Computer Science 2020-11-04 Yunpeng Weng , Xu Chen , Liang Chen , Wei Liu

Graph classification is a challenging problem owing to the difficulty in quantifying the similarity between graphs or representing graphs as vectors, though there have been a few methods using graph kernels or graph neural networks (GNNs).…

Machine Learning · Computer Science 2024-08-22 Zixiao Wang , Jicong Fan

Existing knowledge distillation methods focus on convolutional neural networks (CNNs), where the input samples like images lie in a grid domain, and have largely overlooked graph convolutional networks (GCN) that handle non-grid data. In…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Yiding Yang , Jiayan Qiu , Mingli Song , Dacheng Tao , Xinchao Wang

Graph neural networks (GNNs) are commonly described as being permutation equivariant with respect to node relabeling in the graph. This symmetry of GNNs is often compared to the translation equivariance of Euclidean convolution neural…

Machine Learning · Statistics 2023-11-20 Ningyuan Huang , Ron Levie , Soledad Villar

Graph embedding techniques have been increasingly deployed in a multitude of different applications that involve learning on non-Euclidean data. However, existing graph embedding models either fail to incorporate node attribute information…

Machine Learning · Computer Science 2021-06-22 Chenhui Deng , Zhiqiang Zhao , Yongyu Wang , Zhiru Zhang , Zhuo Feng

Dynamical systems consisting of a set of autonomous agents face the challenge of having to accomplish a global task, relying only on local information. While centralized controllers are readily available, they face limitations in terms of…

Machine Learning · Computer Science 2022-03-24 Fernando Gama , Qingbiao Li , Ekaterina Tolstaya , Amanda Prorok , Alejandro Ribeiro

Graph data, with its structurally variable nature, represents complex real-world phenomena like chemical compounds, protein structures, and social networks. Traditional Graph Neural Networks (GNNs) primarily utilize the message-passing…

Machine Learning · Computer Science 2025-02-05 Jianming Huang , Hiroyuki Kasai

The development of robust Document AI models has been constrained by limited access to high-quality, labeled datasets, primarily due to data privacy concerns, scarcity, and the high cost of manual annotation. Traditional methods of…

Computation and Language · Computer Science 2024-12-06 Amit Agarwal , Hitesh Patel , Priyaranjan Pattnayak , Srikant Panda , Bhargava Kumar , Tejaswini Kumar

How can we subsample graph data so that a graph neural network (GNN) trained on the subsample achieves performance comparable to training on the full dataset? This question is of fundamental interest, as smaller datasets reduce labeling…

Machine Learning · Computer Science 2025-02-25 Mika Sarkin Jain , Stefanie Jegelka , Ishani Karmarkar , Luana Ruiz , Ellen Vitercik

The pre-train then fine-tune approach has advanced GNNs by enabling general knowledge capture without task-specific labels. However, an objective gap between pre-training and downstream tasks limits its effectiveness. Recent graph prompting…

Machine Learning · Computer Science 2025-01-28 Qin Chen , Liang Wang , Bo Zheng , Guojie Song

We propose an adaptive graph coarsening method to jointly learn graph neural network (GNN) parameters and merge nodes via K-means clustering during training. As real-world graphs grow larger, processing them directly becomes increasingly…

Machine Learning · Computer Science 2025-10-01 Rostyslav Olshevskyi , Madeline Navarro , Santiago Segarra

Graph neural networks (GNNs) have emerged as a promising solution to deal with unstructured data, outperforming traditional deep learning architectures. However, most of the current GNN models are designed to work with a single graph, which…

Machine Learning · Computer Science 2024-11-11 Victor M. Tenorio , Antonio G. Marques