English
Related papers

Related papers: Rethinking Transformers Pre-training for Multi-Spe…

200 papers

Self-supervised pre-training for images without labels has recently achieved promising performance in image classification. The success of transformer-based methods, ViT and MAE, draws the community's attention to the design of backbone…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Jiantao Wu , Shentong Mo

Self-supervised learning has emerged as a powerful tool for remote sensing, where large amounts of unlabeled data are available. In this work, we investigate the use of DINO, a contrastive self-supervised method, for pretraining on remote…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Jakub Straka , Ivan Gruber

Recent advancements in foundation models have significantly impacted various fields, including natural language processing, computer vision, and multi-modal tasks. One area that stands to benefit greatly is Earth observation, where these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Yohei Nakayama , Jiawei Su , Luis M. Pazos-Outón

Recently, the self-supervised pre-training paradigm has shown great potential in leveraging large-scale unlabeled data to improve downstream task performance. However, increasing the scale of unlabeled pre-training data in real-world…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Yiqi Lin , Huabin Zheng , Huaping Zhong , Jinjing Zhu , Weijia Li , Conghui He , Lin Wang

Self-supervised pre-training (SSP) employs random image transformations to generate training data for visual representation learning. In this paper, we first present a modeling framework that unifies existing SSP methods as learning to…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Chunyuan Li , Xiujun Li , Lei Zhang , Baolin Peng , Mingyuan Zhou , Jianfeng Gao

Transformer neural networks require a large amount of labeled data to train effectively. Such data is often scarce in electroencephalography, as annotations made by medical experts are costly. This is why self-supervised training, using…

Signal Processing · Electrical Eng. & Systems 2024-10-11 Tim Bary , Benoit Macq

Semantic segmentation of satellite imagery is crucial for Earth observation applications, but remains constrained by limited labelled training data. While self-supervised pretraining methods like Masked Autoencoders (MAE) have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 John Waithaka , Moise Busogi

A large variety of geospatial data layers is available around the world ranging from remotely-sensed raster data like satellite imagery, digital elevation models, predicted land cover maps, and human-annotated data, to data derived from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Arjun Rao , Esther Rolf

Transformers have shown significant effectiveness for various vision tasks including both high-level vision and low-level vision. Recently, masked autoencoders (MAE) for feature pre-training have further unleashed the potential of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Huiyu Duan , Wei Shen , Xiongkuo Min , Danyang Tu , Long Teng , Jia Wang , Guangtao Zhai

Self-supervised pre-training of image encoders is omnipresent in the literature, particularly following the introduction of Masked autoencoders (MAE). Current efforts attempt to learn object-centric representations from motion in videos. In…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Alexandre Eymaël , Renaud Vandeghen , Anthony Cioppa , Silvio Giancola , Bernard Ghanem , Marc Van Droogenbroeck

In the absence of large labelled datasets, self-supervised learning techniques can boost performance by learning useful representations from unlabelled data, which is often more readily available. However, there is often a domain shift…

Machine Learning · Computer Science 2020-06-23 Linus Ericsson , Henry Gouk , Timothy M. Hospedales

The growth of global consumption has motivated important applications of deep learning to smart manufacturing and machine health monitoring. In particular, analyzing vibration data offers great potential to extract meaningful insights into…

Machine Learning · Computer Science 2024-05-30 Anthony Zhou , Amir Barati Farimani

Automated analysis of surgical videos is crucial for improving surgical training, workflow optimization, and postoperative assessment. We introduce a CSMAE, Masked Autoencoder (MAE)-based pretraining approach, specifically developed for…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Nisarg A. Shah , Wele Gedara Chaminda Bandara , Shameema Skider , S. Swaroop Vedula , Vishal M. Patel

Pre-training a recognition model with contrastive learning on a large dataset of unlabeled data has shown great potential to boost the performance of a downstream task, e.g., image classification. However, in domains such as medical…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jizong Peng , Ping Wang , Chrisitian Desrosiers , Marco Pedersoli

Self-supervised learning has emerged as a powerful approach for leveraging large-scale unlabeled data to improve model performance in various domains. In this paper, we explore masked self-supervised pre-training for text recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Martin Kišš , Michal Hradiš

Machine learning methods for satellite data have a range of societally relevant applications, but labels used to train models can be difficult or impossible to acquire. Self-supervision is a natural solution in settings with limited labeled…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Gabriel Tseng , Ruben Cartuyvels , Ivan Zvonkov , Mirali Purohit , David Rolnick , Hannah Kerner

Supervised deep neural networks are the-state-of-the-art for many tasks in the remote sensing domain, against the fact that such techniques require the dataset consisting of pairs of input and label, which are rare and expensive to collect…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Sarun Gulyanon , Wasit Limprasert , Pokpong Songmuang , Rachada Kongkachandra

Large-scale pretraining of visual representations has led to state-of-the-art performance on a range of benchmark computer vision tasks, yet the benefits of these techniques at extreme scale in complex production systems has been relatively…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Josh Beal , Hao-Yu Wu , Dong Huk Park , Andrew Zhai , Dmitry Kislyuk

Recently, self-supervised pre-training has advanced Vision Transformers on various tasks w.r.t. different data modalities, e.g., image and 3D point cloud data. In this paper, we explore this learning paradigm for 3D mesh data analysis based…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Yaqian Liang , Shanshan Zhao , Baosheng Yu , Jing Zhang , Fazhi He

Semi-supervised learning (SSL) addresses the lack of labeled data by exploiting large unlabeled data through pseudolabeling. However, in the extremely low-label regime, pseudo labels could be incorrect, a.k.a. the confirmation bias, and the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Xun Xu , Jingyi Liao , Lile Cai , Manh Cuong Nguyen , Kangkang Lu , Wanyue Zhang , Yasin Yazici , Chuan Sheng Foo