English
Related papers

Related papers: SAAT: Synergistic Alternating Aggregation Transfor…

200 papers

Recently, Transformer-based methods have achieved impressive results in single image super-resolution (SISR). However, the lack of locality mechanism and high complexity limit their application in the field of super-resolution (SR). To…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ling Zheng , Jinchen Zhu , Jinpeng Shi , Shizhuang Weng

CNNs and Self attention have achieved great success in multimedia applications for dynamic association learning of self-attention and convolution in image restoration. However, CNNs have at least two shortcomings: 1) limited receptive…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Kui Jiang , Xuemei Jia , Wenxin Huang , Wenbin Wang , Zheng Wang , Junjun Jiang

Self-attention module shows outstanding competence in capturing long-range relationships while enhancing performance on vision tasks, such as image classification and image captioning. However, the self-attention module highly relies on the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Guangyang Zhu , Jianfeng Zhang , Yuanzhi Feng , Hai Lan

The computational demands of self-attention mechanisms pose a critical challenge for transformer-based video generation, particularly in synthesizing ultra-long sequences. Current approaches, such as factorized attention and fixed sparse…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Qirui Li , Guangcong Zheng , Qi Zhao , Jie Li , Bin Dong , Yiwu Yao , Xi Li

Transformer-based Super-Resolution (SR) methods have demonstrated superior performance compared to convolutional neural network (CNN)-based SR approaches due to their capability to capture long-range dependencies. However, their high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Karam Park , Jae Woong Soh , Nam Ik Cho

Stereo image quality assessment (SIQA) plays a crucial role in evaluating and improving the visual experience of 3D content. Existing visual properties-based methods for SIQA have achieved promising performance. However, these approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Huilin Zhang , Sumei Li , Haoxiang Chang , Peiming Lin

Graph Attention Network (GAT) and GraphSAGE are neural network architectures that operate on graph-structured data and have been widely studied for link prediction and node classification. One challenge raised by GraphSAGE is how to smartly…

Machine Learning · Computer Science 2020-06-09 Anderson de Andrade , Chen Liu

Attention mechanisms have become of crucial importance in deep learning in recent years. These non-local operations, which are similar to traditional patch-based methods in image processing, complement local convolutions. However, computing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Nicolas Cherel , Andrés Almansa , Yann Gousseau , Alasdair Newson

Transformers, with their self-attention mechanisms for modeling long-range dependencies, have become a dominant paradigm in image restoration tasks. However, the high computational cost of self-attention limits scalability to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Hanzhou Liu , Binghan Li , Chengkai Liu , Mi Lu

In recent years, transformer structures have been widely applied in image captioning with impressive performance. For good captioning results, the geometry and position relations of different visual objects are often thought of as crucial…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Chi Wang , Yulin Shen , Luping Ji

We propose CAST, a dual-stream architecture that utilizes channel-aware spatial transfer learning for isolated sign language recognition addressing the challenges of magnitude-only 60~GHz radar Range-Time Maps (RTM). The proposed framework…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Md. Shakhoyat Rahman Shujon , Sheikh Md. Galib Mahim , Md. Milon Islam , Md Rezwanul Haque , Md Rabiul Islam , Hamdi Altaheri , Fakhri Karray

Despite the impressive representation capacity of vision transformer models, current light-weight vision transformer models still suffer from inconsistent and incorrect dense predictions at local regions. We suspect that the power of their…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Chenglin Yang , Yilin Wang , Jianming Zhang , He Zhang , Zijun Wei , Zhe Lin , Alan Yuille

In recent years, significant progress has been made on the research of crowd counting. However, as the challenging scale variations and complex scenes existed in crowds, neither traditional convolution networks nor recent Transformer…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Xing Wei , Yuanrui Kang , Jihao Yang , Yunfeng Qiu , Dahu Shi , Wenming Tan , Yihong Gong

Self-attention mechanisms, especially multi-head self-attention (MSA), have achieved great success in many fields such as computer vision and natural language processing. However, many existing vision transformer (ViT) works simply inherent…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Leijie Wu , Song Guo , Yaohong Ding , Junxiao Wang , Wenchao Xu , Richard Yida Xu , Jie Zhang

We introduce a self-attending task generative adversarial network (SATGAN) and apply it to the problem of augmenting synthetic high contrast scientific imagery of resident space objects with realistic noise patterns and sensor…

Machine Learning · Computer Science 2021-11-19 Nathan Toner , Justin Fletcher

Humans can effectively find salient regions in complex scenes. Self-attention mechanisms were introduced into Computer Vision (CV) to achieve this. Attention Augmented Convolutional Network (AANet) is a mixture of convolution and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Runqing Zhang , Tianshu Zhu

In the field of multimedia, single image deraining is a basic pre-processing work, which can greatly improve the visual effect of subsequent high-level tasks in rainy conditions. In this paper, we propose an effective algorithm, called…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Cong Wang , Yutong Wu , Zhixun Su , Junyang Chen

The transformer architecture has catalyzed revolutionary advances in language modeling. However, recent architectural recipes, such as state-space models, have bridged the performance gap. Motivated by this, we examine the benefits of…

Machine Learning · Computer Science 2024-07-09 Mingchen Li , Xuechen Zhang , Yixiao Huang , Samet Oymak

In many applications, including surveillance, entertainment, and restoration, there is a need to increase both the spatial resolution and the frame rate of a video sequence. The aim is to improve visual quality, refine details, and create a…

Image and Video Processing · Electrical Eng. & Systems 2024-07-25 Congrui Fu , Hui Yuan , Liquan Shen , Raouf Hamzaoui , Hao Zhang

Synthetic aperture radar (SAR) image change detection is critical in remote sensing image analysis. Recently, the attention mechanism has been widely used in change detection tasks. However, existing attention mechanisms often employ…

Image and Video Processing · Electrical Eng. & Systems 2024-07-19 Jiangwei Xie , Feng Gao , Xiaowei Zhou , Junyu Dong