English
Related papers

Related papers: Learning a Mini-batch Graph Transformer via Two-st…

200 papers

Graph convolutional networks (GCNs) have been employed as a kind of significant tool on many graph-based applications recently. Inspired by convolutional neural networks (CNNs), GCNs generate the embeddings of nodes by aggregating the…

Machine Learning · Computer Science 2020-11-20 Tao Huang , Yihan Zhang , Jiajing Wu , Junyuan Fang , Zibin Zheng

Graph pre-training has been concentrated on graph-level tasks involving small graphs (e.g., molecular graphs) or learning node representations on a fixed graph. Extending graph pre-trained models to web-scale graphs with billions of nodes…

Machine Learning · Computer Science 2025-11-07 Yufei He , Zhenyu Hou , Yukuo Cen , Jun Hu , Feng He , Xu Cheng , Jie Tang , Bryan Hooi

Neural machine translation (NMT) usually works in a seq2seq learning way by viewing either source or target sentence as a linear sequence of words, which can be regarded as a special case of graph, taking words in the sequence as nodes and…

Computation and Language · Computer Science 2020-09-17 Sufeng Duan , Hai Zhao , Rui Wang

While the celebrated graph neural networks yield effective representations for individual nodes of a graph, there has been relatively less success in extending to the task of graph similarity learning. Recent work on graph similarity…

Machine Learning · Computer Science 2021-08-20 Xiang Ling , Lingfei Wu , Saizhuo Wang , Tengfei Ma , Fangli Xu , Alex X. Liu , Chunming Wu , Shouling Ji

Graph convolutional networks have been widely used for skeleton-based action recognition due to their excellent modeling ability of non-Euclidean data. As the graph convolution is a local operation, it can only utilize the short-range joint…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Zhan Chen , Sicheng Li , Bing Yang , Qinghan Li , Hong Liu

Multimodal pre-training breaks down the modality barriers and allows the individual modalities to be mutually augmented with information, resulting in significant advances in representation learning. However, graph modality, as a very…

Multimedia · Computer Science 2022-11-01 Xuan Yang , Quanjin Tao , Xiao Feng , Donghong Cai , Xiang Ren , Yang Yang

The message passing-based graph neural networks (GNNs) have achieved great success in many real-world applications. However, training GNNs on large-scale graphs suffers from the well-known neighbor explosion problem, i.e., the exponentially…

Machine Learning · Computer Science 2025-03-18 Zhihao Shi , Xize Liang , Jie Wang

Graph Transformers (GTs) have emerged as a promising graph learning tool, leveraging their all-pair connected property to effectively capture global information. To address the over-smoothing problem in deep GNNs, global attention was…

Machine Learning · Computer Science 2025-12-17 Chaohao Yuan , Zhenjie Song , Ercan Engin Kuruoglu , Kangfei Zhao , Yang Liu , Deli Zhao , Hong Cheng , Yu Rong

Capturing the long-range dependencies has empirically proven to be effective on a wide range of computer vision tasks. The progressive advances on this topic have been made through the employment of the transformer framework with the help…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Dong Zhang , Jinhui Tang , Kwang-Ting Cheng

Heterogeneous graph learning aims to capture complex relationships and diverse relational semantics among entities in a heterogeneous graph to obtain meaningful representations for nodes and edges. Recent advancements in heterogeneous graph…

Computation and Language · Computer Science 2024-05-21 Jiabin Tang , Yuhao Yang , Wei Wei , Lei Shi , Long Xia , Dawei Yin , Chao Huang

In this study, we propose GITSR, an effective framework for Graph Interaction Transformer-based Scene Representation for multi-vehicle collaborative decision-making in intelligent transportation system. In the context of mixed traffic where…

Machine Learning · Computer Science 2024-11-05 Xingyu Hu , Lijun Zhang , Dejian Meng , Ye Han , Lisha Yuan

Graph Neural Networks (GNNs) have emerged as powerful tools for various graph mining tasks, yet existing scalable solutions often struggle to balance execution efficiency with prediction accuracy. These difficulties stem from iterative…

Machine Learning · Computer Science 2026-04-02 Xu Cheng , Liang Yao , Feng He , Yukuo Cen , Yufei He , Chenhui Zhang , Wenzheng Feng , Hongyun Cai , Jie Tang

Online continual learning for image classification is crucial for models to adapt to new data while retaining knowledge of previously learned tasks. This capability is essential to address real-world challenges involving dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Adjovi Sim , Zhengkui Wang , Aik Beng Ng , Shalini De Mello , Simon See , Wonmin Byeon

Graph neural networks (GNNs) are powerful tools for learning from graph data and are widely used in various applications such as social network recommendation, fraud detection, and graph search. The graphs in these applications are…

Machine Learning · Computer Science 2021-06-14 Jialin Dong , Da Zheng , Lin F. Yang , Geroge Karypis

Despite the success of Transformer models in vision and language tasks, they often learn knowledge from enormous data implicitly and cannot utilize structured input data directly. On the other hand, structured learning approaches such as…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Xuehai He , Xin Eric Wang

With the tremendous expansion of graphs data, node classification shows its great importance in many real-world applications. Existing graph neural network based methods mainly focus on classifying unlabeled nodes within fixed classes with…

Artificial Intelligence · Computer Science 2022-06-06 Bin Lu , Xiaoying Gan , Lina Yang , Weinan Zhang , Luoyi Fu , Xinbing Wang

In heterogeneous graphs, we can observe complex structures such as tree-like or hierarchical structures. Recently, the hyperbolic space has been widely adopted in many studies to effectively learn these complex structures. Although these…

Machine Learning · Computer Science 2026-01-14 Jongmin Park , Seunghoon Han , Hyewon Lee , Won-Yong Shin , Sungsu Lim

To alleviate the local receptive issue of GCN, Transformers have been exploited to capture the long range dependences of nodes for graph data representation and learning. However, existing graph Transformers generally employ regular…

Machine Learning · Computer Science 2023-05-15 Bo Jiang , Fei Xu , Ziyan Zhang , Jin Tang , Feiping Nie

Federated graph learning (FGL) enables multiple clients to collaboratively train powerful graph neural networks without sharing their private, decentralized graph data. Inherited from generic federated learning, FGL is critically challenged…

Machine Learning · Computer Science 2025-08-15 Xinrui Li , Qilin Fan , Tianfu Wang , Kaiwen Wei , Ke Yu , Xu Zhang

Incorporating Knowledge Graphs (KG) into recommeder system has attracted considerable attention. Recently, the technical trend of Knowledge-aware Recommendation (KGR) is to develop end-to-end models based on graph neural networks (GNNs).…

Information Retrieval · Computer Science 2022-08-23 Ding Zou , Wei Wei , Ziyang Wang , Xian-Ling Mao , Feida Zhu , Rui Fang , Dangyang Chen