English
Related papers

Related papers: DARTS: Double Attention Reference-based Transforme…

200 papers

Vision Transformers (ViTs) have revolutionized computer vision, yet their self-attention mechanism lacks explicit spatial inductive biases, leading to suboptimal performance on spatially-structured tasks. Existing approaches introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Yuxin Mao , Zhen Qin , Jinxing Zhou , Bin Fan , Jing Zhang , Yiran Zhong , Yuchao Dai

We present an attention-based modular neural framework for computer vision. The framework uses a soft attention mechanism allowing models to be trained with gradient descent. It consists of three modules: a recurrent attention module…

Machine Learning · Computer Science 2016-04-29 Samira Ebrahimi Kahou , Vincent Michalski , Roland Memisevic

Recently, Transformer architecture has been introduced into image restoration to replace convolution neural network (CNN) with surprising results. Considering the high computational complexity of Transformer with global attention, some…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zheng Chen , Yulun Zhang , Jinjin Gu , Yongbing Zhang , Linghe Kong , Xin Yuan

Transformers have had tremendous impact for several sequence related tasks, largely due to their ability to retrieve from any part of the sequence via softmax based dot-product attention. This mechanism plays a crucial role in Transformer's…

Machine Learning · Computer Science 2025-07-15 Sai Surya Duvvuri , Inderjit S. Dhillon

Since Transformer has found widespread use in NLP, the potential of Transformer in CV has been realized and has inspired many new approaches. However, the computation required for replacing word tokens with image patches for Transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Hezheng Lin , Xing Cheng , Xiangyu Wu , Fan Yang , Dong Shen , Zhongyuan Wang , Qing Song , Wei Yuan

Over parameterization is a common technique in deep learning to help models learn and generalize sufficiently to the given task; nonetheless, this often leads to enormous network structures and consumes considerable computing resources…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Yuanchu Liang , Saeed Anwar , Yang Liu

The performance of deep learning based image super-resolution (SR) methods depend on how accurately the paired low and high resolution images for training characterize the sampling process of real cameras. Low and high resolution…

Image and Video Processing · Electrical Eng. & Systems 2022-06-22 Yanhui Guo , Xiaolin Wu , Xiao Shu

Fast MRI aims to reconstruct a high fidelity image from partially observed measurements. Exuberant development in fast MRI using deep learning has been witnessed recently. Meanwhile, novel deep learning paradigms, e.g., Transformer based…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Jiahao Huang , Xiaodan Xing , Zhifan Gao , Guang Yang

Transformer-based models have significantly advanced natural language processing and computer vision in recent years. However, due to the irregular and disordered structure of point cloud data, transformer-based models for 3D deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Xincheng Yang , Mingze Jin , Weiji He , Qian Chen

In this work, we introduce Dual Attention Vision Transformers (DaViT), a simple yet effective vision transformer architecture that is able to capture global context while maintaining computational efficiency. We propose approaching the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Mingyu Ding , Bin Xiao , Noel Codella , Ping Luo , Jingdong Wang , Lu Yuan

Gradient-based attention modeling has been used widely as a way to visualize and understand convolutional neural networks. However, exploiting these visual explanations during the training of generative adversarial networks (GANs) is an…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Runze Li , Tomaso Fontanini , Luca Donati , Andrea Prati , Bir Bhanu

Recently, deep convolutional neural networks (CNNs) have been widely explored in single image super-resolution (SISR) and contribute remarkable progress. However, most of the existing CNNs-based SISR methods do not adequately explore…

Image and Video Processing · Electrical Eng. & Systems 2021-04-22 Jiqing Zhang , Chengjiang Long , Yuxin Wang , Haiyin Piao , Haiyang Mei , Xin Yang , Baocai Yin

This work aims to improve the efficiency of vision transformers (ViT). While ViTs use computationally expensive self-attention operations in every layer, we identify that these operations are highly correlated across layers -- a key…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Shashanka Venkataramanan , Amir Ghodrati , Yuki M. Asano , Fatih Porikli , Amirhossein Habibian

Outdoor images often suffer from severe degradation due to rain, haze, and noise, impairing image quality and challenging high-level tasks. Current image restoration methods struggle to handle complex degradation while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Huan Zhang , Xu Zhang , Nian Cai , Jianglei Di , Yun Zhang

Single-image super-resolution refers to the reconstruction of a high-resolution image from a single low-resolution observation. Although recent deep learning-based methods have demonstrated notable success on simulated datasets -- with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Maciej Zyrek , Tomasz Tarasiewicz , Jakub Sadel , Aleksandra Krzywon , Michal Kawulok

We study on image super-resolution (SR), which aims to recover realistic textures from a low-resolution (LR) image. Recent progress has been made by taking high-resolution images as references (Ref), so that relevant textures can be…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Fuzhi Yang , Huan Yang , Jianlong Fu , Hongtao Lu , Baining Guo

Object detection has recently seen an interesting trend in terms of the most innovative research work, this task being of particular importance in the field of remote sensing, given the consistency of these images in terms of geographical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Anasse Boutayeb , Iyad Lahsen-cherif , Ahmed El Khadimi

Table detection within document images is a crucial task in document processing, involving the identification and localization of tables. Recent strides in deep learning have substantially improved the accuracy of this task, but it still…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Tahira Shehzadi , Shalini Sarode , Didier Stricker , Muhammad Zeshan Afzal

Deep Convolutional Neural Networks (CNN) have drawn great attention in image super-resolution (SR). Recently, visual attention mechanism, which exploits both of the feature importance and contextual cues, has been introduced to image SR and…

Image and Video Processing · Electrical Eng. & Systems 2019-10-01 Huapeng Wu , Zhengxia Zou , Jie Gui , Wen-Jun Zeng , Jieping Ye , Jun Zhang , Hongyi Liu , Zhihui Wei

The Transformer architecture model, based on self-attention and multi-head attention, has achieved remarkable success in offline end-to-end Automatic Speech Recognition (ASR). However, self-attention and multi-head attention cannot be…

Computation and Language · Computer Science 2022-10-03 Chendong Zhao , Jianzong Wang , Wen qi Wei , Xiaoyang Qu , Haoqian Wang , Jing Xiao