English
Related papers

Related papers: Advancing Plain Vision Transformer Towards Remote …

200 papers

Remote sensing change detection aims to localize semantic changes between images of the same location captured at different times. In the past few years, newer methods have attributed enhanced performance to the additions of new and complex…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Blaž Rolih , Matic Fučka , Filip Wolf , Luka Čehovin Zajc

The advancement of RS technology has enabled high-resolution Earth observation; however, interpreting these images using modern VFMs remains a significant challenge. Unlike object-centric natural images, RS imagery is fundamentally…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Keyan Chen , Chenyang Liu , Bowen Chen , Wenyuan Li , Zhengxia Zou , Shijian Lu , Zhenwei Shi

Transformers have revolutionized computer vision and natural language processing, but their high computational complexity limits their application in high-resolution image processing and long-context analysis. This paper introduces…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yuchen Duan , Weiyun Wang , Zhe Chen , Xizhou Zhu , Lewei Lu , Tong Lu , Yu Qiao , Hongsheng Li , Jifeng Dai , Wenhai Wang

Vision transformers have shown great success on numerous computer vision tasks. However, its central component, softmax attention, prohibits vision transformers from scaling up to high-resolution images, due to both the computational…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Weixuan Sun , Zhen Qin , Hui Deng , Jianyuan Wang , Yi Zhang , Kaihao Zhang , Nick Barnes , Stan Birchfield , Lingpeng Kong , Yiran Zhong

Context modeling is critical for remote sensing image dense prediction tasks. Nowadays, the growing size of very-high-resolution (VHR) remote sensing images poses challenges in effectively modeling context. While transformer-based models…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Sijie Zhao , Hao Chen , Xueliang Zhang , Pengfeng Xiao , Lei Bai , Wanli Ouyang

Transformers have recently shown promise for medical image applications, leading to an increasing interest in developing such models for medical image registration. Recent advancements in designing registration Transformers have focused on…

Image and Video Processing · Electrical Eng. & Systems 2023-03-14 Junyu Chen , Yihao Liu , Yufan He , Yong Du

We aim to develop a robust yet flexible visual foundation model for Earth observation. It should possess strong capabilities in recognizing and localizing diverse visual targets while providing compatibility with various input-output…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Liang Yao , Fan Liu , Delong Chen , Chuanyi Zhang , Yijun Wang , Ziyun Chen , Wei Xu , Shimin Di , Yuhui Zheng

Vision transformers have achieved remarkable progress in vision tasks such as image classification and detection. However, in instance-level image retrieval, transformers have not yet shown good performance compared to convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Chull Hwan Song , Jooyoung Yoon , Shunghyun Choi , Yannis Avrithis

The intelligent interpretation of buildings plays a significant role in urban planning and management, macroeconomic analysis, population dynamics, etc. Remote sensing image building interpretation primarily encompasses building extraction…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Mingze Wang , Lili Su , Cilin Yan , Sheng Xu , Pengcheng Yuan , Xiaolong Jiang , Baochang Zhang

Quantitative remote sensing inversion plays a critical role in environmental monitoring, enabling the estimation of key ecological variables such as vegetation indices, canopy structure, and carbon stock. Although vision foundation models…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Zhenyu Yu , Mohd. Yamani Idna Idris , Pei Wang

Deep learning has profoundly transformed remote sensing, yet prevailing architectures like Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) remain constrained by critical trade-offs: CNNs suffer from limited receptive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Muyi Bao , Shuchang Lyu , Zhaoyang Xu , Huiyu Zhou , Jinchang Ren , Shiming Xiang , Xiangtai Li , Guangliang Cheng

Deep robot vision models are widely used for recognizing objects from camera images, but shows poor performance when detecting objects at untrained positions. Although such problem can be alleviated by training with large datasets, the…

Robotics · Computer Science 2022-10-26 Hyogo Hiruma , Hiroki Mori , Hiroshi Ito , Tetsuya Ogata

Image Classification is a fundamental task in the field of computer vision that frequently serves as a benchmark for gauging advancements in Computer Vision. Over the past few years, significant progress has been made in image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Mahmoud Khalil , Ahmad Khalil , Alioune Ngom

While deep learning-based general object detection has made significant strides in recent years, the effectiveness and efficiency of small object detection remain unsatisfactory. This is primarily attributed not only to the limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zile Huang , Chong Zhang , Mingyu Jin , Fangyu Wu , Chengzhi Liu , Xiaobo Jin

Foundation models are vital tools in various Computer Vision applications. They take as input a single RGB image and output a deep feature representation that is useful for various applications. However, in case we have multiple views of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Leo Segre , Or Hirschorn , Shai Avidan

Object detection in Remote Sensing Images (RSI) is a critical task for numerous applications in Earth Observation (EO). Differing from object detection in natural images, object detection in remote sensing images faces challenges of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Bissmella Bahaduri , Zuheng Ming , Fangchen Feng , Anissa Mokraou

Large-scale NLP models have been shown to significantly improve the performance on language tasks with no signs of saturation. They also demonstrate amazing few-shot capabilities like that of human beings. This paper aims to explore…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Ze Liu , Han Hu , Yutong Lin , Zhuliang Yao , Zhenda Xie , Yixuan Wei , Jia Ning , Yue Cao , Zheng Zhang , Li Dong , Furu Wei , Baining Guo

Window-based attention has become a popular choice in vision transformers due to its superior performance, lower computational complexity, and less memory footprint. However, the design of hand-crafted windows, which is data-agnostic,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Qiming Zhang , Jing Zhang , Yufei Xu , Dacheng Tao

Deep learning has largely reshaped remote sensing (RS) research for aerial image understanding and made a great success. Nevertheless, most of the existing deep models are initialized with the ImageNet pretrained weights. Since natural…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Di Wang , Jing Zhang , Bo Du , Gui-Song Xia , Dacheng Tao

Transformers are transforming the landscape of computer vision, especially for recognition tasks. Detection transformers are the first fully end-to-end learning systems for object detection, while vision transformers are the first fully…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Hwanjun Song , Deqing Sun , Sanghyuk Chun , Varun Jampani , Dongyoon Han , Byeongho Heo , Wonjae Kim , Ming-Hsuan Yang