English
Related papers

Related papers: Self-supervised Learning in Remote Sensing: A Revi…

200 papers

Self-supervised learning, dubbed the dark matter of intelligence, is a promising path to advance machine learning. Yet, much like cooking, training SSL methods is a delicate art with a high barrier to entry. While many components are…

Deep learning is pushing the state-of-the-art in many computer vision applications. However, it relies on large annotated data repositories, and capturing the unconstrained nature of the real-world data is yet to be solved. Semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Mamshad Nayeem Rizve , Navid Kardan , Mubarak Shah

Self-supervised learning (SSL) has enabled the development of vision foundation models for Earth Observation (EO), demonstrating strong transferability across diverse remote sensing tasks. While prior work has focused on network…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Thomas Kerdreux , Alexandre Tuel , Quentin Febvre , Alexis Mouche , Bertrand Chapron

We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding image locations of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Ashraful Islam , Ben Lundell , Harpreet Sawhney , Sudipta Sinha , Peter Morales , Richard J. Radke

Recent advancements in self-supervised learning (SSL) made it possible to learn generalizable visual representations from unlabeled data. The performance of Deep Learning models fine-tuned on pretrained SSL representations is on par with…

Machine Learning · Computer Science 2021-09-21 Atharva Tendle , Mohammad Rashedul Hasan

Self-supervised learning (SSL) has had great success in both computer vision. Most of the current mainstream computer vision SSL frameworks are based on Siamese network architecture. These approaches often rely on cleverly crafted loss…

Machine Learning · Computer Science 2024-01-30 Daesoo Lee , Erlend Aune

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in…

Computer Vision and Pattern Recognition · Computer Science 2018-01-09 Xiao Xiang Zhu , Devis Tuia , Lichao Mou , Gui-Song Xia , Liangpei Zhang , Feng Xu , Friedrich Fraundorfer

The field of surgical computer vision has undergone considerable breakthroughs in recent years with the rising popularity of deep neural network-based methods. However, standard fully-supervised approaches for training such models require…

Self-supervised learning (SSL) has gained widespread attention in the remote sensing (RS) and earth observation (EO) communities owing to its ability to learn task-agnostic representations without human-annotated labels. Nevertheless, most…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Dilxat Muhtar , Xueliang Zhang , Pengfeng Xiao , Zhenshi Li , Feng Gu

Some of the threats in the dynamic environment include the unpredictability of the motion of objects and interferences to the robotic grasp. In such conditions the traditional supervised and reinforcement learning approaches are ill suited…

Robotics · Computer Science 2024-10-18 Ankit Shaw

Self-supervised learning (SSL), in particular contrastive learning, has made great progress in recent years. However, a common theme in these methods is that they inherit the learning paradigm from the supervised deep learning scenario.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Yun-Hao Cao , Jianxin Wu

Remote sensing projects typically generate large amounts of imagery that can be used to train powerful deep neural networks. However, the amount of labeled images is often small, as remote sensing applications generally require expert…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Maximilian Bernhard , Tanveer Hannan , Niklas Strauß , Matthias Schubert

We evaluate the effectiveness of semi-supervised learning (SSL) on a realistic benchmark where data exhibits considerable class imbalance and contains images from novel classes. Our benchmark consists of two fine-grained classification…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Jong-Chyi Su , Zezhou Cheng , Subhransu Maji

In recent years, self-supervised learning (SSL) frameworks have been extensively applied to sensor-based Human Activity Recognition (HAR) in order to learn deep representations without data annotations. While SSL frameworks reach…

Machine Learning · Computer Science 2023-08-01 Bulat Khaertdinov , Stylianos Asteriadis

Self-supervised learning (SSL) has achieved remarkable performance in various medical imaging tasks by dint of priors from massive unlabelled data. However, regarding a specific downstream task, there is still a lack of an instruction book…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Chuyan Zhang , Yun Gu

Semi-supervised learning (SSL) has attracted much attention since it reduces the expensive costs of collecting adequate well-labeled training data, especially for deep learning methods. However, traditional SSL is built upon an assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Lie Ju , Yicheng Wu , Wei Feng , Zhen Yu , Lin Wang , Zhuoting Zhu , Zongyuan Ge

Deep Learning is often depicted as a trio of data-architecture-loss. Yet, recent Self Supervised Learning (SSL) solutions have introduced numerous additional design choices, e.g., a projector network, positive views, or teacher-student…

Machine Learning · Computer Science 2024-06-18 Mark Ibrahim , David Klindt , Randall Balestriero

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

Self-supervised learning (SSL) is a scalable way to learn general visual representations since it learns without labels. However, large-scale unlabeled datasets in the wild often have long-tailed label distributions, where we know little…

Machine Learning · Computer Science 2022-05-24 Hong Liu , Jeff Z. HaoChen , Adrien Gaidon , Tengyu Ma

Self-supervised learning (SSL) is a technique for learning useful representations from unlabeled data. It has been applied effectively to domain adaptation (DA) on images and videos. It is still unknown if and how it can be leveraged for…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Idan Achituve , Haggai Maron , Gal Chechik