English
Related papers

Related papers: Train Your Own GNN Teacher: Graph-Aware Distillati…

200 papers

Representation learning on text-attributed graphs (TAGs), where nodes are represented by textual descriptions, is crucial for textual and relational knowledge systems and recommendation systems. Currently, state-of-the-art embedding methods…

Computation and Language · Computer Science 2024-12-24 Yi Fang , Dongzhe Fan , Sirui Ding , Ninghao Liu , Qiaoyu Tan

Graph Neural Networks (GNNs) have achieved great success among various domains. Nevertheless, most GNN methods are sensitive to the quality of graph structures. To tackle this problem, some studies exploit different graph structure learning…

Machine Learning · Computer Science 2021-08-11 Liping Wang , Fenyu Hu , Shu Wu , Liang Wang

Recently, graph neural networks (GNNs) have proved to be suitable in tasks on unstructured data. Particularly in tasks as community detection, node classification, and link prediction. However, most GNN models still operate with static…

Machine Learning · Computer Science 2019-06-07 Darwin Saire Pilco , Adín Ramírez Rivera

Leveraging Graph Neural Networks (GNNs) as graph encoders and aligning the resulting representations with Large Language Models (LLMs) through alignment instruction tuning has become a mainstream paradigm for constructing Graph Language…

Machine Learning · Computer Science 2026-05-13 Haibo Chen , Xin Wang , Jiaheng Chao , Ling Feng , Wenwu Zhu

Contemporary segmentation methods are usually based on deep fully convolutional networks (FCNs). However, the layer-by-layer convolutions with a growing receptive field is not good at capturing long-range contexts such as lane markers in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Zhikang Liu , Lanyun Zhu

Graph classification is an important learning task for graph-structured data. Graph neural networks (GNNs) have recently gained growing attention in graph learning and have shown significant improvements in many important graph problems.…

Machine Learning · Computer Science 2024-01-31 Tao Wen , Elynn Chen , Yuzhou Chen

The increased amount of multi-modal medical data has opened the opportunities to simultaneously process various modalities such as imaging and non-imaging data to gain a comprehensive insight into the disease prediction domain. Recent…

Machine Learning · Computer Science 2021-11-24 Mahsa Ghorbani , Mojtaba Bahrami , Anees Kazi , Mahdieh SoleymaniBaghshah , Hamid R. Rabiee , Nassir Navab

Heterogeneous Graph Neural Networks (HGNNs) have achieved promising results in various heterogeneous graph learning tasks, owing to their superiority in capturing the intricate relationships and diverse relational semantics inherent in…

Machine Learning · Computer Science 2025-07-15 Yunhui Liu , Xinyi Gao , Tieke He , Jianhua Zhao , Hongzhi Yin

Temporal knowledge graphs (TKGs) support reasoning over time-evolving facts, yet state-of-the-art models are often computationally heavy and costly to deploy. Existing compression and distillation techniques are largely designed for static…

Computation and Language · Computer Science 2026-02-17 Wang Xing , Wei Song , Siyu Lin , Chen Wu , Man Wang

Given the success of Graph Neural Networks (GNNs) for structure-aware machine learning, many studies have explored their use for text classification, but mostly in specific domains with limited data characteristics. Moreover, some…

Computation and Language · Computer Science 2024-01-23 Margarita Bugueño , Gerard de Melo

Nowadays, Graph Neural Networks (GNNs) following the Message Passing paradigm become the dominant way to learn on graphic data. Models in this paradigm have to spend extra space to look up adjacent nodes with adjacency matrices and extra…

Machine Learning · Computer Science 2021-06-17 Yi Luo , Aiguo Chen , Ke Yan , Ling Tian

Graph neural networks (GNNs) have become the preferred models for node classification in graph data due to their robust capabilities in integrating graph structures and attributes. However, these models heavily depend on a substantial…

Machine Learning · Computer Science 2025-05-19 Taiyan Zhang , Renchi Yang , Yurui Lai , Mingyu Yan , Xiaochun Ye , Dongrui Fan

The first provably efficient algorithm for learning graph neural networks (GNNs) with one hidden layer for node information convolution is provided in this paper. Two types of GNNs are investigated, depending on whether labels are attached…

Machine Learning · Computer Science 2020-12-08 Qunwei Li , Shaofeng Zou , Wenliang Zhong

The integration of Large Language Models (LLMs) with Graph Neural Networks (GNNs) has recently been explored to enhance the capabilities of Text Attribute Graphs (TAGs). Most existing methods feed textual descriptions of the graph structure…

Computation and Language · Computer Science 2025-04-03 Zhaoxing Li , Xiaoming Zhang , Haifeng Zhang , Chengxiang Liu

Simulating complex dynamics like fluids with traditional simulators is computationally challenging. Deep learning models have been proposed as an efficient alternative, extending or replacing parts of traditional simulators. We investigate…

Machine Learning · Computer Science 2022-03-16 Jonathan Klimesch , Philipp Holl , Nils Thuerey

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

Machine Learning · Computer Science 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

Time, cost, and energy efficiency are critical considerations in Deep-Learning (DL), particularly when processing long texts. Transformers, which represent the current state of the art, exhibit quadratic computational complexity relative to…

Computation and Language · Computer Science 2025-07-11 Fardin Rastakhiz

Graph Neural Networks (GNNs) have evolved to understand graph structures through recursive exchanges and aggregations among nodes. To enhance robustness, self-supervised learning (SSL) has become a vital tool for data augmentation.…

Computation and Language · Computer Science 2024-05-08 Jiabin Tang , Yuhao Yang , Wei Wei , Lei Shi , Lixin Su , Suqi Cheng , Dawei Yin , Chao Huang

Graph neural networks (GNNs) have been demonstrated to be powerful in modeling graph-structured data. However, training GNNs usually requires abundant task-specific labeled data, which is often arduously expensive to obtain. One effective…

Machine Learning · Computer Science 2020-06-30 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Kai-Wei Chang , Yizhou Sun

Graph neural networks (GNNs) have become one of the most popular research topics in both academia and industry communities for their strong ability in handling irregular graph data. However, large-scale datasets are posing great challenges…

Machine Learning · Computer Science 2022-10-26 Jiongyu Guo , Defang Chen , Can Wang