English
Related papers

Related papers: RSRWKV: A Linear-Complexity 2D Attention Mechanism…

200 papers

Objective image quality evaluation is a challenging task, which aims to measure the quality of a given image automatically. According to the availability of the reference images, there are Full-Reference and No-Reference IQA tasks,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Chao Zeng , Sam Kwong

As is known, hybrid quadratic and subquadratic attention models in multi-head architectures have surpassed both Transformer and Linear RNN models , with these works primarily focusing on reducing KV complexity and improving efficiency. For…

Computation and Language · Computer Science 2025-01-28 Lin Yueyu , Li Zhiyuan , Peter Yue , Liu Xiao

Recently, Transformers (e.g., Audio Spectrogram Transformers, AST) and state-space models (e.g., Audio Mamba, AuM) have achieved remarkable progress in audio modeling. However, the O(L^2) computational complexity of the Transformer…

Sound · Computer Science 2025-09-03 Jiayu Xiong , Jun Xue , Jianlong Kwan , Jing Wang

In recent years, there have been attempts to increase the kernel size of Convolutional Neural Nets (CNNs) to mimic the global receptive field of Vision Transformers' (ViTs) self-attention blocks. That approach, however, quickly hit an upper…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Shahaf E. Finder , Roy Amoyal , Eran Treister , Oren Freifeld

Vision-Language Models (VLMs) face significant challenges when dealing with the diverse resolutions and aspect ratios of real-world images, as most existing models rely on fixed, low-resolution inputs. While recent studies have explored…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Junbo Niu , Yuanhong Zheng , Ziyang Miao , Hejun Dong , Chunjiang Ge , Hao Liang , Ma Lu , Bohan Zeng , Qiahao Zheng , Conghui He , Wentao Zhang

Remote Sensing Image Captioning (RSIC) presents unique challenges and plays a critical role in applications. Traditional RSIC methods often struggle to produce rich and diverse descriptions. Recently, with advancements in VLMs, efforts have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Hui Lin , Danfeng Hong , Shuhang Ge , Chuyao Luo , Kai Jiang , Hao Jin , Congcong Wen

Learning powerful feature representations for image retrieval has always been a challenging task in the field of remote sensing. Traditional methods focus on extracting low-level hand-crafted features which are not only time-consuming but…

Computer Vision and Pattern Recognition · Computer Science 2017-05-22 Weixun Zhou , Shawn Newsam , Congmin Li , Zhenfeng Shao

Transformer-based deep models for single image super-resolution (SISR) have greatly improved the performance of lightweight SISR tasks in recent years. However, they often suffer from heavy computational burden and slow inference due to the…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Xiaole Zhao , Linze Li , Chengxing Xie , Xiaoming Zhang , Ting Jiang , Wenjie Lin , Shuaicheng Liu , Tianrui Li

Remote sensing image classification forms the foundation of various understanding tasks, serving a crucial function in remote sensing image interpretation. The recent advancements of Convolutional Neural Networks (CNNs) and Transformers…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Keyan Chen , Bowen Chen , Chenyang Liu , Wenyuan Li , Zhengxia Zou , Zhenwei Shi

The remote sensing image intelligence understanding model is undergoing a new profound paradigm shift which has been promoted by multi-modal large language model (MLLM), i.e. from the paradigm learning a domain model (LaDM) shifts to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Linrui Xu , Ling Zhao , Wang Guo , Qiujun Li , Kewang Long , Kaiqi Zou , Yuhan Wang , Haifeng Li

Remote sensing change detection (RSCD), a complex multi-image inference task, traditionally uses pixel-based operators or encoder-decoder networks that inadequately capture high-level semantics and are vulnerable to non-semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Xingwei Ma , Shiyang Feng , Bo Zhang , Bin Wang

Deep convolutional neural networks (CNNs) with strong expressive ability have achieved impressive performances on single image super-resolution (SISR). However, their excessive amounts of convolutions and parameters usually consume high…

Image and Video Processing · Electrical Eng. & Systems 2020-07-22 Chunwei Tian , Ruibin Zhuge , Zhihao Wu , Yong Xu , Wangmeng Zuo , Chen Chen , Chia-Wen Lin

Although Faster R-CNN and its variants have shown promising performance in object detection, they only exploit simple first-order representation of object proposals for final classification and regression. Recent classification methods…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Hao Wang , Qilong Wang , Mingqi Gao , Peihua Li , Wangmeng Zuo

Aiming at answering questions based on the content of remotely sensed images, visual question answering for remote sensing data (RSVQA) has attracted much attention nowadays. However, previous works in RSVQA have focused little on the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Zhenghang Yuan , Lichao Mou , Xiao Xiang Zhu

We present Recurrent Vision Transformers (RVTs), a novel backbone for object detection with event cameras. Event cameras provide visual information with sub-millisecond latency at a high-dynamic range and with strong robustness against…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Mathias Gehrig , Davide Scaramuzza

Recent advances in vision transformers (ViTs) have demonstrated the advantage of global modeling capabilities, prompting widespread integration of large-kernel convolutions for enlarging the effective receptive field (ERF). However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Mingshu Zhao , Yi Luo , Yong Ouyang

The application of the context-adaptive entropy model significantly improves the rate-distortion (R-D) performance, in which hyperpriors and autoregressive models are jointly utilized to effectively capture the spatial redundancy of the…

Image and Video Processing · Electrical Eng. & Systems 2022-09-09 Haisheng Fu , Feng Liang

How do two deep neural networks differ in how they arrive at a decision? Measuring the similarity of deep networks has been a long-standing open question. Most existing methods provide a single number to measure the similarity of two…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Neehar Kondapaneni , Oisin Mac Aodha , Pietro Perona

Transformer architectures have exhibited remarkable performance in image super-resolution (SR). Since the quadratic computational complexity of the self-attention (SA) in Transformer, existing methods tend to adopt SA in a local region to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Zheng Chen , Yulun Zhang , Jinjin Gu , Linghe Kong , Xiaokang Yang

In the field of medical CT image processing, convolutional neural networks (CNNs) have been the dominant technique.Encoder-decoder CNNs utilise locality for efficiency, but they cannot simulate distant pixel interactions properly.Recent…

Image and Video Processing · Electrical Eng. & Systems 2022-11-03 Hongyang He , Feng Ziliang , Yuanhang Zheng , Shudong Huang , HaoBing Gao