English
Related papers

Related papers: Graph-Aware Transformer: Is Attention All Graphs N…

200 papers

Encoding a driving scene into vector representations has been an essential task for autonomous driving that can benefit downstream tasks e.g. trajectory prediction. The driving scene often involves heterogeneous elements such as the…

Artificial Intelligence · Computer Science 2023-07-21 Xiaosong Jia , Penghao Wu , Li Chen , Yu Liu , Hongyang Li , Junchi Yan

We present a novel graph Transformer generative adversarial network (GTGAN) to learn effective graph node relations in an end-to-end fashion for the challenging graph-constrained house generation task. The proposed graph-Transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Hao Tang , Zhenyu Zhang , Humphrey Shi , Bo Li , Ling Shao , Nicu Sebe , Radu Timofte , Luc Van Gool

Graph Neural Networks (GNNs) have emerged as the de facto standard for modeling graph data, with attention mechanisms and transformers significantly enhancing their performance on graph-based tasks. Despite these advancements, the…

Machine Learning · Computer Science 2025-04-07 Nikhil Shivakumar Nayak

While it is crucial to capture global information for effective image restoration (IR), integrating such cues into transformer-based methods becomes computationally expensive, especially with high input resolution. Furthermore, the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Bin Ren , Yawei Li , Jingyun Liang , Rakesh Ranjan , Mengyuan Liu , Rita Cucchiara , Luc Van Gool , Nicu Sebe

Graph Neural Networks (GNNs) have emerged as promising solutions for collaborative filtering (CF) through the modeling of user-item interaction graphs. The nucleus of existing GNN-based recommender systems involves recursive message passing…

Machine Learning · Computer Science 2024-05-21 Peiyan Zhang , Yuchen Yan , Xi Zhang , Chaozhuo Li , Senzhang Wang , Feiran Huang , Sunghun Kim

Distinguishing the automorphic equivalence of nodes in a graph plays an essential role in many scientific domains, e.g., computational biologist and social network analysis. However, existing graph neural networks (GNNs) fail to capture…

Machine Learning · Computer Science 2021-11-10 Fengli Xu , Quanming Yao , Pan Hui , Yong Li

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

We propose the Interferometric Graph Transform (IGT), which is a new class of deep unsupervised graph convolutional neural network for building graph representations. Our first contribution is to propose a generic, complex-valued spectral…

Machine Learning · Computer Science 2020-06-11 Edouard Oyallon

Graphs are a powerful tool for representing and analyzing unstructured, non-Euclidean data ubiquitous in the healthcare domain. Two prominent examples are molecule property prediction and brain connectome analysis. Importantly, recent works…

Machine Learning · Computer Science 2022-04-04 Kamilia Mullakaeva , Luca Cosmo , Anees Kazi , Seyed-Ahmad Ahmadi , Nassir Navab , Michael M. Bronstein

Graph learning has rapidly evolved into a critical subfield of machine learning and artificial intelligence (AI). Its development began with early graph-theoretic methods, gaining significant momentum with the advent of graph neural…

Machine Learning · Computer Science 2025-11-10 Feng Xia , Ciyuan Peng , Jing Ren , Falih Gozi Febrinanto , Renqiang Luo , Vidya Saikrishna , Shuo Yu , Xiangjie Kong

Traffic forecasting is a significant part of intelligent transportation systems. One of the critical challenges of traffic forecasting is to find spatio-temporal correlations. In recent years, graph convolutional networks and graph…

Artificial Intelligence · Computer Science 2026-05-19 Tianchi Zhang

This paper proposes a Video Graph Transformer (VGT) model for Video Quetion Answering (VideoQA). VGT's uniqueness are two-fold: 1) it designs a dynamic graph transformer module which encodes video by explicitly capturing the visual objects,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Junbin Xiao , Pan Zhou , Tat-Seng Chua , Shuicheng Yan

Graph representation learning has many real-world applications, from super-resolution imaging, 3D computer vision to drug repurposing, protein classification, social networks analysis. An adequate representation of graph data is vital to…

Machine Learning · Computer Science 2021-12-17 Xuebin Zheng , Bingxin Zhou , Yu Guang Wang , Xiaosheng Zhuang

Transformers have achieved great success in several domains, including Natural Language Processing and Computer Vision. However, its application to real-world graphs is less explored, mainly due to its high computation cost and its poor…

Machine Learning · Computer Science 2023-01-31 Weilin Cong , Yanhong Wu , Yuandong Tian , Mengting Gu , Yinglong Xia , Chun-cheng Jason Chen , Mehrdad Mahdavi

Graph learning plays a pivotal role and has gained significant attention in various application scenarios, from social network analysis to recommendation systems, for its effectiveness in modeling complex data relations represented by graph…

Machine Learning · Computer Science 2024-03-08 Man Wu , Xin Zheng , Qin Zhang , Xiao Shen , Xiong Luo , Xingquan Zhu , Shirui Pan

Ever since neural models were adopted in data-to-text language generation, they have invariably been reliant on extrinsic components to improve their semantic accuracy, because the models normally do not exhibit the ability to generate text…

Computation and Language · Computer Science 2021-09-16 Juraj Juraska , Marilyn Walker

We demonstrate that graph-based models are fully capable of representing higher-order interactions, and have a long history of being used for precisely this purpose. This stands in contrast to a common claim in the recent literature on…

Physics and Society · Physics 2026-02-20 Tiago P. Peixoto , Leto Peel , Thilo Gross , Manlio De Domenico

We introduce GraViti, a transformer-based graph-level variational autoencoder that maps entire graphs to compact latent vectors. This design produces a true graph-level latent space that supports smooth interpolation, property-guided…

Machine Learning · Computer Science 2026-05-19 Roman Bresson , Konstantinos Divriotis , Johannes F. Lutzeyer , Iakovos Evdaimon , Michalis Vazirgiannis

Despite the success of Transformer models in vision and language tasks, they often learn knowledge from enormous data implicitly and cannot utilize structured input data directly. On the other hand, structured learning approaches such as…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Xuehai He , Xin Eric Wang

Transformers, renowned for their self-attention mechanism, have achieved state-of-the-art performance across various tasks in natural language processing, computer vision, time-series modeling, etc. However, one of the challenges with deep…

Machine Learning · Computer Science 2024-11-04 Jeongwhan Choi , Hyowon Wi , Jayoung Kim , Yehjin Shin , Kookjin Lee , Nathaniel Trask , Noseong Park