English
Related papers

Related papers: An Empirical Study of Remote Sensing Pretraining

200 papers

The task of remote sensing image scene classification (RSISC), which aims at classifying remote sensing images into groups of semantic categories based on their contents, has taken the important role in a wide range of applications such as…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Lam Pham , Khoa Tran , Dat Ngo , Jasmin Lampert , Alexander Schindler

Self-supervised learning (SSL) methods have become a dominant paradigm for creating general purpose models whose capabilities can be transferred to downstream supervised learning tasks. However, most such methods rely on vast amounts of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Lakshay Sharma , Alex Marin

Due to the scarcity of labeled data, using supervised models pre-trained on ImageNet is a de facto standard in remote sensing scene classification. Recently, the availability of larger high resolution remote sensing (HRRS) image datasets…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Vladimir Risojević , Vladan Stojnić

Image set-based visual classification methods have achieved remarkable performance, via characterising the image set in terms of a non-singular covariance matrix on a symmetric positive definite (SPD) manifold. To adapt to complicated…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Rui Wang , Xiao-Jun Wu , Ziheng Chen , Tianyang Xu , Josef Kittler

Supervised deep learning models depend on massive labeled data. Unfortunately, it is time-consuming and labor-intensive to collect and annotate bitemporal samples containing desired changes. Transfer learning from pre-trained models is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Hao Chen , Wenyuan Li , Song Chen , Zhenwei Shi

The past years have witnessed great progress on remote sensing (RS) image interpretation and its wide applications. With RS images becoming more accessible than ever before, there is an increasing demand for the automatic interpretation of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yang Long , Gui-Song Xia , Shengyang Li , Wen Yang , Michael Ying Yang , Xiao Xiang Zhu , Liangpei Zhang , Deren Li

For unsupervised pretraining, mask-reconstruction pretraining (MRP) approaches, e.g. MAE and data2vec, randomly mask input patches and then reconstruct the pixels or semantic features of these masked patches via an auto-encoder. Then for a…

Machine Learning · Computer Science 2023-02-14 Jiachun Pan , Pan Zhou , Shuicheng Yan

Recently, great progress has been made in 3D deep learning with the emergence of deep neural networks specifically designed for 3D point clouds. These networks are often trained from scratch or from pre-trained models learned purely from…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Bach Tran , Binh-Son Hua , Anh Tuan Tran , Minh Hoai

Advances in high resolution remote sensing image analysis are currently hampered by the difficulty of gathering enough annotated data for training deep learning methods, giving rise to a variety of small datasets and associated…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Dimitri Gominski , Valérie Gouet-Brunet , Liming Chen

For semantic segmentation of remote sensing images (RSI), trade-off between representation power and location accuracy is quite important. How to get the trade-off effectively is an open question,where current approaches of utilizing very…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Shuang He , Xia Lu , Jason Gu , Haitong Tang , Qin Yu , Kaiyue Liu , Haozhou Ding , Chunqi Chang , Nizhuan Wang

Radio frequency (RF)-based indoor localization offers significant promise for applications such as indoor navigation, augmented reality, and pervasive computing. While deep learning has greatly enhanced localization accuracy and robustness,…

Information Theory · Computer Science 2025-12-09 Guosheng Wang , Shen Wang , Lei Yang

Recent work on visual representation learning has shown to be efficient for robotic manipulation tasks. However, most existing works pretrained the visual backbone solely on 2D images or egocentric videos, ignoring the fact that robots…

Remote sensing images pose distinct challenges for downstream tasks due to their inherent complexity. While a considerable amount of research has been dedicated to remote sensing classification, object detection and semantic segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Yuxuan Li , Xiang Li , Yimian Dai , Qibin Hou , Li Liu , Yongxiang Liu , Ming-Ming Cheng , Jian Yang

Remote sensing change detection, identifying changes between scenes of the same location, is an active area of research with a broad range of applications. Recent advances in multimodal self-supervised pretraining have resulted in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Isaac Corley , Peyman Najafirad

High-quality images are crucial in remote sensing and UAV applications, but atmospheric haze can severely degrade image quality, making image dehazing a critical research area. Since the introduction of deep convolutional neural networks,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Gao Yu Lee , Jinkuan Chen , Tanmoy Dam , Md Meftahul Ferdaus , Daniel Puiu Poenar , Vu N Duong

Research in self-supervised learning (SSL) with natural images has progressed rapidly in recent years and is now increasingly being applied to and benchmarked with datasets containing remotely sensed imagery. A common benchmark case is to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Isaac Corley , Caleb Robinson , Rahul Dodhia , Juan M. Lavista Ferres , Peyman Najafirad

Deep Neural Networks (DNNs) learn representation from data with an impressive capability, and brought important breakthroughs for processing images, time-series, natural language, audio, video, and many others. In the remote sensing field,…

Recently, deep learning technology have been extensively used in the field of image recognition. However, its main application is the recognition and detection of ordinary pictures and common scenes. It is challenging to effectively and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Guangcun Shan , Hongyu Wang , Wei Liang , Congcong Liu , Qizi Ma , Quan Quan

Deep learning provides a powerful new approach to many computer vision tasks. Height prediction from aerial images is one of those tasks that benefited greatly from the deployment of deep learning which replaced old multi-view geometry…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Elhousni Mahdi , Zhang Ziming , Huang Xinming

Medical imaging tasks are very challenging due to the lack of publicly available labeled datasets. Hence, it is difficult to achieve high performance with existing deep-learning models as they require a massive labeled dataset to be trained…

Image and Video Processing · Electrical Eng. & Systems 2024-07-23 Anubhav Gupta , Islam Osman , Mohamed S. Shehata , John W. Braun