English
Related papers

Related papers: Towards Remote Sensing Change Detection with Neura…

200 papers

Transformers have been widely used in numerous vision problems especially for visual recognition and detection. Detection transformers are the first fully end-to-end learning systems for object detection, while vision transformers are the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Hwanjun Song , Deqing Sun , Sanghyuk Chun , Varun Jampani , Dongyoon Han , Byeongho Heo , Wonjae Kim , Ming-Hsuan Yang

Vision-transformers (ViTs) and large-scale convolution-neural-networks (CNNs) have reshaped computer vision through pretrained feature representations that enable strong transfer learning for diverse tasks. However, their efficiency as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Alon Kaya , Igal Bilik , Inna Stainvas

Transformer has achieved great success in the NLP field by composing various advanced models like BERT and GPT. However, Transformer and its existing variants may not be optimal in capturing token distances because the position or distance…

Computation and Language · Computer Science 2021-04-13 Chuhan Wu , Fangzhao Wu , Yongfeng Huang

The synergy of long-range dependencies from transformers and local representations of image content from convolutional neural networks (CNNs) has led to advanced architectures and increased performance for various medical image analysis…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Yiqing Shen , Pengfei Guo , Jingpu Wu , Qianqi Huang , Nhat Le , Jinyuan Zhou , Shanshan Jiang , Mathias Unberath

Instance segmentation performance in remote sensing images (RSIs) is significantly affected by two issues: how to extract accurate boundaries of objects from remote imaging through the dynamic atmosphere, and how to integrate the mutual…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Dawen Yu , Shunping Ji

Change detection (CD) aims to identify surface changes from multi-temporal remote sensing imagery. In real-world scenarios, Pixel-level change labels are expensive to acquire, and existing models struggle to adapt to scenarios with diverse…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Kaixuan Jiang , Chen Wu , Zhenghui Zhao , Chengxi Han , Haonan Guo , Hongruixuan Chen

Large language models (LLMs) now support extremely long context windows, but the quadratic complexity of vanilla attention results in significantly long Time-to-First-Token (TTFT) latency. Existing approaches to address this complexity…

Computation and Language · Computer Science 2025-09-04 Qianchao Zhu , Jiangfei Duan , Chang Chen , Siran Liu , Guanyu Feng , Xin Lv , Xiao Chuanfu , Dahua Lin , Chao Yang

The Vision Transformer (ViT) excels in accuracy when handling high-resolution images, yet it confronts the challenge of significant spatial redundancy, leading to increased computational and memory requirements. To address this, we present…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Youbing Hu , Yun Cheng , Anqi Lu , Zhiqiang Cao , Dawei Wei , Jie Liu , Zhijun Li

Over the past few decades, the hydrology community has witnessed notable advancements in streamflow prediction, particularly with the introduction of cutting-edge machine-learning algorithms. Recurrent neural networks, especially Long…

Machine Learning · Computer Science 2023-05-23 Sinan Rasiya Koya , Tirthankar Roy

Although numerous recent tracking approaches have made tremendous advances in the last decade, achieving high-performance visual tracking remains a challenge. In this paper, we propose an end-to-end network model to learn reinforced…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Peng Gao , Qiquan Zhang , Fei Wang , Liyi Xiao , Hamido Fujita , Yan Zhang

The integration of Unmanned Aerial Vehicles (UAVs) with artificial intelligence (AI) models for aerial imagery processing in disaster assessment, necessitates models that demonstrate exceptional accuracy, computational efficiency, and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Demetris Shianios , Panayiotis Kolios , Christos Kyrkou

Human action recognition is one of the challenging tasks in computer vision. The current action recognition methods use computationally expensive models for learning spatio-temporal dependencies of the action. Models utilizing RGB channels…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Labina Shrestha , Shikha Dubey , Farrukh Olimov , Muhammad Aasim Rafique , Moongu Jeon

Vision transformers (ViTs) have found only limited practical use in processing images, in spite of their state-of-the-art accuracy on certain benchmarks. The reason for their limited use include their need for larger training datasets and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-26 Pranav Jeevan , Amit sethi

Popular Transformer networks have been successfully applied to remote sensing (RS) image change detection (CD) identifications and achieve better results than most convolutional neural networks (CNNs), but they still suffer from two main…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Tao Lei , Yetong Xu , Hailong Ning , Zhiyong Lv , Chongdan Min , Yaochu Jin , Asoke K. Nandi

The quadratic computation complexity of self-attention has been a persistent challenge when applying Transformer models to vision tasks. Linear attention, on the other hand, offers a much more efficient alternative with its linear…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Dongchen Han , Xuran Pan , Yizeng Han , Shiji Song , Gao Huang

Latent fingerprint identification remains a challenging task due to low image quality, background noise, and partial impressions. In this work, we propose a novel identification approach called LatentPrintFormer. The proposed model…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Arnab Maity , Manasa , Pavan Kumar C , Raghavendra Ramachandra

Continual learning is a longstanding research topic due to its crucial role in tackling continually arriving tasks. Up to now, the study of continual learning in computer vision is mainly restricted to convolutional neural networks (CNNs).…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Mengqi Xue , Haofei Zhang , Jie Song , Mingli Song

Remote sensing image change detection aims to identify the differences between images acquired at different times in the same area. It is widely used in land management, environmental monitoring, disaster assessment and other fields.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Huan Zhong , Chen Wu

Capturing global contextual information plays a critical role in breast ultrasound (BUS) image classification. Although convolutional neural networks (CNNs) have demonstrated reliable performance in tumor classification, they have inherent…

Image and Video Processing · Electrical Eng. & Systems 2023-08-07 Bryar Shareef , Min Xian , Aleksandar Vakanski , Haotian Wang

Brain tissue segmentation has demonstrated great utility in quantifying MRI data through Voxel-Based Morphometry and highlighting subtle structural changes associated with various conditions within the brain. However, manual segmentation is…

Image and Video Processing · Electrical Eng. & Systems 2023-02-02 Vishwanatha M. Rao , Zihan Wan , Soroush Arabshahi , David J. Ma , Pin-Yu Lee , Ye Tian , Xuzhe Zhang , Andrew F. Laine , Jia Guo