中文
相关论文

相关论文: Lightweight, Pre-trained Transformers for Remote S…

200 篇论文

Many current deep learning approaches make extensive use of backbone networks pre-trained on large datasets like ImageNet, which are then fine-tuned to perform a certain task. In remote sensing, the lack of comparable large annotated…

计算机视觉与模式识别 · 计算机科学 2024-08-22 Konrad Heidler , Lichao Mou , Di Hu , Pu Jin , Guangyao Li , Chuang Gan , Ji-Rong Wen , Xiao Xiang Zhu

Given the abundance of unlabeled Satellite Image Time Series (SITS) and the scarcity of labeled data, contrastive self-supervised pretraining emerges as a natural tool to leverage this vast quantity of unlabeled data. However, designing…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Antoine Saget , Baptiste Lafabregue , Antoine Cornuéjols , Pierre Gançarski

Public remote sensing datasets often face limitations in universality due to resolution variability and inconsistent land cover category definitions. To harness the vast pool of unlabeled remote sensing data, we propose SAMST, a…

计算机视觉与模式识别 · 计算机科学 2025-07-17 Jun Yin , Fei Wu , Yupeng Ren , Jisheng Huang , Qiankun Li , Heng jin , Jianhai Fu , Chanjie Cui

The application of deep neural networks to remote sensing imagery is often constrained by the lack of ground-truth annotations. Adressing this issue requires models that generalize efficiently from limited amounts of labeled data, allowing…

图像与视频处理 · 电气工程与系统科学 2024-10-08 Jules Bourcier , Gohar Dashyan , Jocelyn Chanussot , Karteek Alahari

Spatial-temporal forecasting is crucial and widely applicable in various domains such as traffic, energy, and climate. Benefiting from the abundance of unlabeled spatial-temporal data, self-supervised methods are increasingly adapted to…

机器学习 · 计算机科学 2024-12-20 Qi Zheng , Zihao Yao , Yaying Zhang

Foundation models offer a promising route to transferable remote sensing representations, but many current approaches depend on very large pretraining datasets and fixed sensor configurations, limiting their suitability for ecological and…

Existing deep learning methods for remote sensing image fusion often suffer from poor generalization when applied to unseen datasets due to the limited availability of real training data and the domain gap between different satellite…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Yongchuan Cui , Peng Liu , Yi Zeng

Automatically finding good and general remote sensing representations allows to perform transfer learning on a wide range of applications - improving the accuracy and reducing the required number of training samples. This paper investigates…

计算机视觉与模式识别 · 计算机科学 2020-10-02 Maxim Neumann , André Susano Pinto , Xiaohua Zhai , Neil Houlsby

Self-supervised pretraining in remote sensing is mostly done using mid-spatial resolution (MR) image datasets due to their high availability. Given the release of high-resolution (HR) datasets, we ask how HR datasets can be included in…

计算机视觉与模式识别 · 计算机科学 2026-05-05 John Waithaka , Gustave Bwirayesu , Moise Busogi

Transfer learning with a small amount of target data is an effective and common approach to adapting a pre-trained model to distribution shifts. In some situations, target data labels may be expensive to obtain, so we may only have access…

机器学习 · 计算机科学 2023-05-26 Annie S. Chen , Yoonho Lee , Amrith Setlur , Sergey Levine , Chelsea Finn

With the development of deep learning, supervised learning methods perform well in remote sensing images (RSIs) scene classification. However, supervised learning requires a huge number of annotated data for training. When labeled samples…

计算机视觉与模式识别 · 计算机科学 2020-10-05 Chao Tao , Ji Qi , Weipeng Lu , Hao Wang , Haifeng Li

Leveraging sensing modalities across diverse spatial and temporal resolutions can improve performance of robotic manipulation tasks. Multi-spatial resolution sensing provides hierarchical information captured at different spatial scales and…

机器人学 · 计算机科学 2024-01-29 Saumya Saxena , Mohit Sharma , Oliver Kroemer

Machine learning in remote sensing has matured alongside a proliferation in availability and resolution of geospatial imagery, but its utility is bottlenecked by the need for labeled data. What's more, many labeled geospatial datasets are…

机器学习 · 计算机科学 2021-07-15 Jack Lynch , Sam Wookey

Most approaches in few-shot learning rely on costly annotated data related to the goal task domain during (pre-)training. Recently, unsupervised meta-learning methods have exchanged the annotation requirement for a reduction in few-shot…

机器学习 · 计算机科学 2020-06-23 Carlos Medina , Arnout Devos , Matthias Grossglauser

Compressive sensing is a promising solution for the channel estimation in multiple-input multiple-output (MIMO) systems with large antenna arrays and constrained hardware. Utilizing site-specific channel data from real-world systems, deep…

信号处理 · 电气工程与系统科学 2024-05-14 Hao Luo , Ahmed Alkhateeb

Transfer of pre-trained representations can improve sample efficiency and reduce computational requirements for new tasks. However, representations used for transfer are usually generic, and are not tailored to a particular distribution of…

Unsupervised representation learning for wireless channel state information (CSI)reduces reliance on labeled data, thereby lowering annotation costs, and often improves performance on downstream tasks. However, state-of-the-art approaches…

信号处理 · 电气工程与系统科学 2026-01-29 Jonathan Ott , Maximilian Stahlke , Tobias Feigl , Bjoern M. Eskofier , Christopher Mutschler

Currently, under supervised learning, a model pretrained by a large-scale nature scene dataset and then fine-tuned on a few specific task labeling data is the paradigm that has dominated the knowledge transfer learning. It has reached the…

计算机视觉与模式识别 · 计算机科学 2022-09-15 Tong Zhang , Peng Gao , Hao Dong , Yin Zhuang , Guanqun Wang , Wei Zhang , He Chen

In self-supervised learning, a model is trained to solve a pretext task, using a data set whose annotations are created by a machine. The objective is to transfer the trained weights to perform a downstream task in the target domain. We…

机器学习 · 计算机科学 2021-10-22 Prathamesh Sonawane , Sparsh Drolia , Saqib Shamsi , Bhargav Jain

Learning from Multivariate Time Series (MTS) has attracted widespread attention in recent years. In particular, label shortage is a real challenge for the classification task on MTS, considering its complex dimensional and sequential data…

机器学习 · 计算机科学 2021-10-12 Jingwei Zuo , Karine Zeitouni , Yehia Taher