English
Related papers

Related papers: Semantic decoupled representation learning for rem…

200 papers

Self-supervised representation learning approaches have grown in popularity due to the ability to train models on large amounts of unlabeled data and have demonstrated success in diverse fields such as natural language processing, computer…

Machine Learning · Computer Science 2023-02-06 John Harvill , Jarred Barber , Arun Nair , Ramin Pishehvar

The success of large-scale pretraining in NLP and computer vision has catalyzed growing efforts to develop analogous foundation models for the physical sciences. However, pretraining strategies using atomistic data remain underexplored. To…

Machine Learning · Computer Science 2026-03-19 Tynan Perez , Rafael Gomez-Bombarelli

Semi-supervised learning (SSL) aims to help reduce the cost of the manual labelling process by leveraging a substantial pool of unlabelled data alongside a limited set of labelled data during the training phase. Since pixel-level manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Wanli Ma , Oktay Karakus , Paul L. Rosin

Remote Sensing Change Detection (RSCD) typically identifies changes in land cover or surface conditions by analyzing multi-temporal images. Currently, most deep learning-based methods primarily focus on learning unimodal visual information,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Yixiao Liu , Yizhou Yang , Jinwen Li , Jun Tao , Ruoyu Li , Xiangkun Wang , Min Zhu , Junlong Cheng

Recent self-supervised models have demonstrated equal or better performance than supervised methods, opening for AI systems to learn visual representations from practically unlimited data. However, these methods are typically…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Robin Karlsson , Tomoki Hayashi , Keisuke Fujii , Alexander Carballo , Kento Ohtani , Kazuya Takeda

Recently, cross domain transfer has been applied for unsupervised image restoration tasks. However, directly applying existing frameworks would lead to domain-shift problems in translated images due to lack of effective supervision.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Wenchao Du , Hu Chen , Hongyu Yang

Dense Self-Supervised Learning (SSL) methods address the limitations of using image-level feature representations when handling images with multiple objects. Although the dense features extracted by employing segmentation maps and bounding…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Congpei Qiu , Tong Zhang , Wei Ke , Mathieu Salzmann , Sabine Süsstrunk

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Huijie Guo , Ying Ba , Jie Hu , Lingyu Si , Wenwen Qiang , Lei Shi

This work proposes a hybrid unsupervised and supervised learning method to pre-train models applied in Earth observation downstream tasks when only a handful of labels denoting very general semantic concepts are available. We combine a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Omar A. Castaño-Idarraga , Raul Ramos-Pollán , Freddie Kalaitzis

Contrastive learning has achieved great success in skeleton-based action recognition. However, most existing approaches encode the skeleton sequences as entangled spatiotemporal representations and confine the contrasts to the same level of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Cong Wu , Xiao-Jun Wu , Josef Kittler , Tianyang Xu , Sara Atito , Muhammad Awais , Zhenhua Feng

Supervised deep learning-based methods yield accurate results for medical image segmentation. However, they require large labeled datasets for this, and obtaining them is a laborious task that requires clinical expertise.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

Instance segmentation of unknown objects from images is regarded as relevant for several robot skills including grasping, tracking and object sorting. Recent results in computer vision have shown that large hand-labeled datasets enable high…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Andreas Eitel , Nico Hauff , Wolfram Burgard

Multimodal representation learning seeks to relate and decompose information inherent in multiple modalities. By disentangling modality-specific information from information that is shared across modalities, we can improve interpretability…

Machine Learning · Computer Science 2025-03-18 Chenyu Wang , Sharut Gupta , Xinyi Zhang , Sana Tonekaboni , Stefanie Jegelka , Tommi Jaakkola , Caroline Uhler

In this paper, we investigate how to learn a suitable representation of satellite image time series in an unsupervised manner by leveraging large amounts of unlabeled data. Additionally , we aim to disentangle the representation of time…

Computer Vision and Pattern Recognition · Computer Science 2019-03-22 Eduardo Sanchez , Mathieu Serrurier , Mathias Ortner

Image-text retrieval in remote sensing aims to provide flexible information for data analysis and application. In recent years, state-of-the-art methods are dedicated to ``scale decoupling'' and ``semantic decoupling'' strategies to further…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Chengyu Zheng , Ning song , Ruoyu Zhang , Lei Huang , Zhiqiang Wei , Jie Nie

A key requirement for the success of supervised deep learning is a large labeled dataset - a condition that is difficult to meet in medical image analysis. Self-supervised learning (SSL) can help in this regard by providing a strategy to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

Most self-supervised learning (SSL) methods learn continuous visual representations by aligning different views of the same input, offering limited control over how information is structured across representation dimensions. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Kawtar Zaher , Ilyass Moummad , Olivier Buisson , Alexis Joly

Remote sensing change detection (RSCD), a complex multi-image inference task, traditionally uses pixel-based operators or encoder-decoder networks that inadequately capture high-level semantics and are vulnerable to non-semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Xingwei Ma , Shiyang Feng , Bo Zhang , Bin Wang

Self-supervised learning (SSL) is a powerful tool in machine learning, but understanding the learned representations and their underlying mechanisms remains a challenge. This paper presents an in-depth empirical analysis of SSL-trained…

Machine Learning · Computer Science 2023-06-01 Ido Ben-Shaul , Ravid Shwartz-Ziv , Tomer Galanti , Shai Dekel , Yann LeCun

Self-supervised learning is showing great promise for monocular depth estimation, using geometry as the only source of supervision. Depth networks are indeed capable of learning representations that relate visual appearance to 3D properties…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Vitor Guizilini , Rui Hou , Jie Li , Rares Ambrus , Adrien Gaidon