English
Related papers

Related papers: DAM-GT: Dual Positional Encoding-Based Attention M…

200 papers

The combination of the traditional convolutional network (i.e., an auto-encoder) and the graph convolutional network has attracted much attention in clustering, in which the auto-encoder extracts the node attribute feature and the graph…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Zhihao Peng , Hui Liu , Yuheng Jia , Junhui Hou

Cross-network node classification (CNNC), which aims to classify nodes in a label-deficient target network by transferring the knowledge from a source network with abundant labels, draws increasing attention recently. To address CNNC, we…

Machine Learning · Computer Science 2023-10-18 Xiao Shen , Shirui Pan , Kup-Sze Choi , Xi Zhou

2D convolutional neural networks (CNNs) have attracted significant attention for hyperspectral image super-resolution tasks. However, a key limitation is their reliance on local neighborhoods, which leads to a lack of global contextual…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Usman Muhammad , Jorma Laaksonen

We introduce Quantum Graph Attention Networks (QGATs) as trainable quantum encoders for inductive learning on graphs, extending the Quantum Graph Neural Networks (QGNN) framework. QGATs leverage parameterized quantum circuits to encode node…

Quantum Physics · Physics 2025-09-16 Arthur M. Faria , Mehdi Djellabi , Igor O. Sokolov , Savvas Varsamopoulos

Despite recent successes in natural language processing and computer vision, Transformer suffers from the scalability problem when dealing with graphs. The computational complexity is unacceptable for large-scale graphs, e.g., knowledge…

Machine Learning · Computer Science 2022-02-23 Lingbing Guo , Qiang Zhang , Huajun Chen

Recently Transformer-based hyperspectral image (HSI) change detection methods have shown remarkable performance. Nevertheless, existing attention mechanisms in Transformers have limitations in local feature representation. To address this…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Ziyi Wang , Feng Gao , Junyu Dong , Qian Du

Long-context understanding is crucial for many NLP applications, yet transformers struggle with efficiency due to the quadratic complexity of self-attention. Sparse attention methods alleviate this cost but often impose static, predefined…

Computation and Language · Computer Science 2025-06-16 Hanzhi Zhang , Heng Fan , Kewei Sha , Yan Huang , Yunhe Feng

In recent years, attention mechanisms have significantly enhanced the performance of object detection by focusing on key feature information. However, prevalent methods still encounter difficulties in effectively balancing local and global…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Yifan Shao

Auto-encoders have emerged as a successful framework for unsupervised learning. However, conventional auto-encoders are incapable of utilizing explicit relations in structured data. To take advantage of relations in graph-structured data,…

Machine Learning · Computer Science 2019-05-28 Amin Salehi , Hasan Davulcu

Graph Transformers (GTs) show considerable potential in graph representation learning. The architecture of GTs typically integrates Graph Neural Networks (GNNs) with global attention mechanisms either in parallel or as a precursor to…

Machine Learning · Computer Science 2026-02-04 Gang Wu , Zhengwei Wang

Text-attributed graphs integrate semantic information of node texts with topological structure, offering significant value in various applications such as document classification and information extraction. Existing approaches typically…

Computation and Language · Computer Science 2026-04-21 Lexuan Liang , Tao Zou , Xuxiang Ta , Zekun Qiu

Community detection on attributed graphs with rich semantic and topological information offers great potential for real-world network analysis, especially user matching in online games. Graph Neural Networks (GNNs) have recently enabled…

Social and Information Networks · Computer Science 2025-02-21 Chang Liu , Yuwen Yang , Yue Ding , Hongtao Lu , Wenqing Lin , Ziming Wu , Wendong Bi

Descriptive region features extracted by object detection networks have played an important role in the recent advancements of image captioning. However, they are still criticized for the lack of contextual information and fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Yunpeng Luo , Jiayi Ji , Xiaoshuai Sun , Liujuan Cao , Yongjian Wu , Feiyue Huang , Chia-Wen Lin , Rongrong Ji

The Transformer architecture has gained growing attention in graph representation learning recently, as it naturally overcomes several limitations of graph neural networks (GNNs) by avoiding their strict structural inductive biases and…

Machine Learning · Statistics 2022-06-14 Dexiong Chen , Leslie O'Bray , Karsten Borgwardt

Multi-label classification aims to recognize multiple objects or attributes from images. However, it is challenging to learn from proper label graphs to effectively characterize such inter-label correlations or dependencies. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Jin Yuan , Shikai Chen , Yao Zhang , Zhongchao Shi , Xin Geng , Jianping Fan , Yong Rui

Clustering high-dimensional multivariate spatiotemporal climate data is challenging due to complex temporal dependencies, evolving spatial interactions, and non-stationary dynamics. Conventional clustering methods, including recurrent and…

Machine Learning · Computer Science 2025-09-17 Francis Ndikum Nji , Vandana Janaja , Jianwu Wang

Deep learning-based crowd counting methods have achieved remarkable progress in recent years. However, in complex crowd scenarios, existing models still face challenges when adapting to significant density distribution differences between…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yihong Wu , Jinqiao Wei , Xionghui Zhao , Yidi Li , Shaoyi Du , Bin Ren , Nicu Sebe

The Transformer architecture has become widely adopted due to its demonstrated success, attributed to the attention mechanism at its core. Despite these successes, the attention mechanism of Transformers is associated with two well-known…

Machine Learning · Computer Science 2024-10-22 DongNyeong Heo , Heeyoul Choi

Graph Neural Networks (GNNs) have shown remarkable success in graph representation learning. Unfortunately, current weight assignment schemes in standard GNNs, such as the calculation based on node degrees or pair-wise representations, can…

Machine Learning · Computer Science 2024-07-02 Junfu Wang , Yuanfang Guo , Liang Yang , Yunhong Wang

Traffic forecasting is a significant part of intelligent transportation systems. One of the critical challenges of traffic forecasting is to find spatio-temporal correlations. In recent years, graph convolutional networks and graph…

Artificial Intelligence · Computer Science 2026-05-19 Tianchi Zhang