English
Related papers

Related papers: Revisiting pre-trained remote sensing model benchm…

200 papers

Semi-supervised learning (SSL) has been widely explored in recent years, and it is an effective way of leveraging unlabeled data to reduce the reliance on labeled data. In this work, we adjust neural processes (NPs) to the semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Jianfeng Wang , Xiaolin Hu , Thomas Lukasiewicz

Currently, when reliable training datasets are available, deep learning methods dominate the proposed solutions for image super-resolution. However, for remote sensing benchmarks, it is very expensive to obtain high spatial resolution…

Image and Video Processing · Electrical Eng. & Systems 2021-03-24 Achraf Djerida , Khelifa Djerriri , Moussa Sofiane Karoui , Mohammed El Amin larabi

The cost of head pose labeling is the main challenge of improving the fine-grained Head Pose Estimation (HPE). Although Self-Supervised Learning (SSL) can be a solution to the lack of huge amounts of labeled data, its efficacy for…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Mahdi Pourmirzaei , Farzaneh Esmaili , Ebrahim Mousavi , Sasan Karamizadeh , Seyedehsamaneh Shojaeilangari

Satellites equipped with optical sensors capture high-resolution imagery, providing valuable insights into various environmental phenomena. In recent years, there has been a surge of research focused on addressing some challenges in remote…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Loddo Fabio , Dario Piga , Michelucci Umberto , El Ghazouali Safouane

Optical neural networks are emerging as powerful machine learning and information processing tools because of their potential advantages in speed and energy efficiency. The training methods of these physical models, however, remain…

Optics · Physics 2026-05-11 Xudong Lv , Yuxiang Sun , Shuo Wang , Nanxing Chen , Jun Guan , Jingtian Hu

The current literature on self-supervised learning (SSL) focuses on developing learning objectives to train neural networks more effectively on unlabeled data. The typical development process involves taking well-established architectures,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Sharath Girish , Debadeepta Dey , Neel Joshi , Vibhav Vineet , Shital Shah , Caio Cesar Teodoro Mendes , Abhinav Shrivastava , Yale Song

Recent advances in deep-learning based methods for image matching have demonstrated their superiority over traditional algorithms, enabling correspondence estimation in challenging scenes with significant differences in viewing angles,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Rahul Deshmukh , Avinash Kak

In Self-Supervised Learning (SSL), pre-training and evaluation are resource intensive. In the speech domain, current indicators of the quality of SSL models during pre-training, such as the loss, do not correlate well with downstream…

Sound · Computer Science 2025-06-03 Ryan Whetten , Lucas Maison , Titouan Parcollet , Marco Dinarelli , Yannick Estève

Transfer learning with pre-trained neural networks is a common strategy for training classifiers in medical image analysis. Without proper channel selections, this often results in unnecessarily large models that hinder deployment and…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ken C. L. Wong , Satyananda Kashyap , Mehdi Moradi

In the last few years, unpaired image-to-image translation has witnessed remarkable progress. Although the latest methods are able to generate realistic images, they crucially rely on a large number of labeled images. Recently, some methods…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Yaxing Wang , Salman Khan , Abel Gonzalez-Garcia , Joost van de Weijer , Fahad Shahbaz Khan

Hyperspectral Imaging (HSI) serves as a non-destructive spatial spectroscopy technique with a multitude of potential applications. However, a recurring challenge lies in the limited size of the target datasets, impeding exhaustive…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Hannah Frank , Leon Amadeus Varga , Andreas Zell

Image normalization is a building block in medical image analysis. Conventional approaches are customarily utilized on a per-dataset basis. This strategy, however, prevents the current normalization algorithms from fully exploiting the…

Machine Learning · Computer Science 2020-10-06 Pierre-Luc Delisle , Benoit Anctil-Robitaille , Christian Desrosiers , Herve Lombaert

Semi-Supervised Learning (SSL) is a framework that utilizes both labeled and unlabeled data to enhance model performance. Conventional SSL methods operate under the assumption that labeled and unlabeled data share the same label space.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Noam Fluss , Guy Hacohen , Daphna Weinshall

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Semi-supervised learning (SSL) is a popular setting aiming to effectively utilize unlabelled data to improve model performance in downstream natural language processing (NLP) tasks. Currently, there are two popular approaches to make use of…

Computation and Language · Computer Science 2023-05-23 Zhengxiang Shi , Francesco Tonolini , Nikolaos Aletras , Emine Yilmaz , Gabriella Kazai , Yunlong Jiao

Deep learning-based semi-supervised learning (SSL) algorithms have led to promising results in medical images segmentation and can alleviate doctors' expensive annotations by leveraging unlabeled data. However, most of the existing SSL…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Xiangde Luo , Jieneng Chen , Tao Song , Yinan Chen , Guotai Wang , Shaoting Zhang

Deep learning models are essential for scene classification, change detection, land cover segmentation, and other remote sensing image understanding tasks. Most backbones of existing remote sensing deep learning models are typically…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Ziyue Huang , Mingming Zhang , Yuan Gong , Qingjie Liu , Yunhong Wang

Self-supervised learning (SSL) is the latest breakthrough in speech processing, especially for label-scarce downstream tasks by leveraging massive unlabeled audio data. The noise robustness of the SSL is one of the important challenges to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-25 Hiroshi Sato , Ryo Masumura , Tsubasa Ochiai , Marc Delcroix , Takafumi Moriya , Takanori Ashihara , Kentaro Shinayama , Saki Mizuno , Mana Ihori , Tomohiro Tanaka , Nobukatsu Hojo

Confidence-based pseudo-labeling is among the dominant approaches in semi-supervised learning (SSL). It relies on including high-confidence predictions made on unlabeled data as additional targets to train the model. We propose ProtoCon, a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Islam Nassar , Munawar Hayat , Ehsan Abbasnejad , Hamid Rezatofighi , Gholamreza Haffari

Supervised machine learning provides state-of-the-art solutions to a wide range of computer vision problems. However, the need for copious labelled training data limits the capabilities of these algorithms in scenarios where such input is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 András Kalapos , Bálint Gyires-Tóth