English
Related papers

Related papers: Learning a Mini-batch Graph Transformer via Two-st…

200 papers

Collaborative recommendation fundamentally involves learning high-quality user and item representations from interaction data. Recently, graph convolution networks (GCNs) have advanced the field by utilizing high-order connectivity patterns…

Information Retrieval · Computer Science 2024-12-30 Jiajia Chen , Jiancan Wu , Jiawei Chen , Chongming Gao , Yong Li , Xiang Wang

In the landscape of contemporary recommender systems, user-item interactions are inherently dynamic and sequential, often characterized by various behaviors. Prior research has explored the modeling of user preferences through sequential…

Information Retrieval · Computer Science 2026-02-12 Jingsong Su , Xuetao Ma , Mingming Li , Qiannan Zhu , Yu Guo

Graph Neural Networks (GNNs) have shown expressive performance on graph representation learning by aggregating information from neighbors. Recently, some studies have discussed the importance of modeling neighborhood distribution on the…

Machine Learning · Computer Science 2023-01-31 Wendong Bi , Lun Du , Qiang Fu , Yanlin Wang , Shi Han , Dongmei Zhang

Graph Transformer shows remarkable potential in brain network analysis due to its ability to model graph structures and complex node relationships. Most existing methods typically model the brain as a flat network, ignoring its modular…

Machine Learning · Computer Science 2025-11-25 Jiajun Ma , Yongchao Zhang , Chao Zhang , Zhao Lv , Shengbing Pei

We present a novel graph Transformer generative adversarial network (GTGAN) to learn effective graph node relations in an end-to-end fashion for the challenging graph-constrained house generation task. The proposed graph-Transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Hao Tang , Zhenyu Zhang , Humphrey Shi , Bo Li , Ling Shao , Nicu Sebe , Radu Timofte , Luc Van Gool

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

Information Retrieval · Computer Science 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh

Graph Neural Networks (GNNs) are recently proposed neural network structures for the processing of graph-structured data. Due to their employed neighbor aggregation strategy, existing GNNs focus on capturing node-level information and…

Machine Learning · Computer Science 2022-01-05 Xing Ai , Chengyu Sun , Zhihong Zhang , Edwin R Hancock

We propose an extension to the transformer neural network architecture for general-purpose graph learning by adding a dedicated pathway for pairwise structural information, called edge channels. The resultant framework - which we call…

Machine Learning · Computer Science 2022-06-06 Md Shamim Hussain , Mohammed J. Zaki , Dharmashankar Subramanian

Graph learning has attracted significant attention due to its widespread real-world applications. Current mainstream approaches rely on text node features and obtain initial node embeddings through shallow embedding learning using GNNs,…

Artificial Intelligence · Computer Science 2025-02-13 Chuanqi Shi , Yiyi Tao , Hang Zhang , Lun Wang , Shaoshuai Du , Yixian Shen , Yanxin Shen

We propose the Soft Graph Transformer (SGT), a soft-input-soft-output neural architecture designed for MIMO detection. While Maximum Likelihood (ML) detection achieves optimal accuracy, its exponential complexity makes it infeasible in…

Machine Learning · Computer Science 2026-04-14 Jiadong Hong , Lei Liu , Xinyu Bian , Wenjie Wang , Zhaoyang Zhang

Message Passing Neural Networks have recently become the most popular approach to graph machine learning tasks; however, their receptive field is limited by the number of message passing layers. To increase the receptive field, Graph…

Machine Learning · Computer Science 2026-04-10 Oleg Platonov , Liudmila Prokhorenkova

Recent years have witnessed the emerging success of graph neural networks (GNNs) for modeling structured data. However, most GNNs are designed for homogeneous graphs, in which all nodes and edges belong to the same types, making them…

Machine Learning · Computer Science 2020-03-04 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Yizhou Sun

Recently Transformer-based hyperspectral image (HSI) change detection methods have shown remarkable performance. Nevertheless, existing attention mechanisms in Transformers have limitations in local feature representation. To address this…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Ziyi Wang , Feng Gao , Junyu Dong , Qian Du

Graphs are pervasive in the real-world, such as social network analysis, bioinformatics, and knowledge graphs. Graph neural networks (GNNs) have great ability in node classification, a fundamental task on graphs. Unfortunately, conventional…

Machine Learning · Computer Science 2024-09-05 Quan Li , Tianxiang Zhao , Lingwei Chen , Junjie Xu , Suhang Wang

Aiming at expanding few-shot relations' coverage in knowledge graphs (KGs), few-shot knowledge graph completion (FKGC) has recently gained more research interests. Some existing models employ a few-shot relation's multi-hop neighbor…

Artificial Intelligence · Computer Science 2021-06-08 Guanglin Niu , Yang Li , Chengguang Tang , Ruiying Geng , Jian Dai , Qiao Liu , Hao Wang , Jian Sun , Fei Huang , Luo Si

We present a new approach for learning unsupervised node representations in community graphs. We significantly extend the Interferometric Graph Transform (IGT) to community labeling: this non-linear operator iteratively extracts features…

Machine Learning · Computer Science 2021-06-11 Nathan Grinsztajn , Louis Leconte , Philippe Preux , Edouard Oyallon

Large language models (LLMs) have shown promise in simulating human-like social behaviors. Social graphs provide high-quality supervision signals that encode both local interactions and global network structure, yet they remain…

Social and Information Networks · Computer Science 2026-04-14 Jiarui Ji , Zehua Zhang , Zhewei Wei , Bin Tong , Guan Wang , Bo Zheng

We present MeshGraphNet-Transformer (MGN-T), a novel architecture that combines the global modeling capabilities of Transformers with the geometric inductive bias of MeshGraphNets, while preserving a mesh-based graph representation. MGN-T…

Machine Learning · Computer Science 2026-02-06 Mikel M. Iparraguirre , Iciar Alfaro , David Gonzalez , Elias Cueto

Graph Transformer (GT) has recently emerged as a promising neural network architecture for learning graph-structured data. However, its global attention mechanism with quadratic complexity concerning the graph scale prevents wider…

Machine Learning · Computer Science 2024-12-09 Ningyi Liao , Zihao Yu , Siqiang Luo

Transformers have become widely used in various tasks, such as natural language processing and machine vision. This paper proposes Gransformer, an algorithm based on Transformer for generating graphs. We modify the Transformer encoder to…

Machine Learning · Computer Science 2024-06-03 Ahmad Khajenezhad , Seyed Ali Osia , Mahmood Karimian , Hamid Beigy