English
Related papers

Related papers: Understanding Self-Supervised Features for Learnin…

200 papers

Self-supervised learning (SSL) holds promise in leveraging large amounts of unlabeled data. However, the success of popular SSL methods has limited on single-centric-object images like those in ImageNet and ignores the correlation among the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Zhaowen Li , Yousong Zhu , Fan Yang , Wei Li , Chaoyang Zhao , Yingying Chen , Zhiyang Chen , Jiahao Xie , Liwei Wu , Rui Zhao , Ming Tang , Jinqiao Wang

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

Self-supervised learning (SSL) approaches have brought tremendous success across many tasks and domains. It has been argued that these successes can be attributed to a link between SSL and identifiable representation learning: Temporal…

Machine Learning · Statistics 2025-06-03 Rodrigo González Laiz , Tobias Schmidt , Steffen Schneider

Can we automatically group images into semantically meaningful clusters when ground-truth annotations are absent? The task of unsupervised image classification remains an important, and open challenge in computer vision. Several recent…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Marc Proesmans , Luc Van Gool

Self-supervised learning (SSL) has attracted much interest in remote sensing and earth observation due to its ability to learn task-agnostic representations without human annotation. While most of the existing SSL works in remote sensing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Yi Wang , Conrad M Albrecht , Xiao Xiang Zhu

Text Recognition (TR) refers to the research area that focuses on retrieving textual information from images, a topic that has seen significant advancements in the last decade due to the use of Deep Neural Networks (DNN). However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Carlos Penarrubia , Jose J. Valero-Mas , Jorge Calvo-Zaragoza

While semi-supervised learning (SSL) has received tremendous attentions in many machine learning tasks due to its successful use of unlabeled data, existing SSL algorithms use either all unlabeled examples or the unlabeled examples with a…

Machine Learning · Computer Science 2021-09-03 Yi Xu , Lei Shang , Jinxing Ye , Qi Qian , Yu-Feng Li , Baigui Sun , Hao Li , Rong Jin

The advancement of deep learning has greatly improved supervised image classification. However, labeling data is costly, prompting research into unsupervised learning methods such as contrastive learning. In real-world scenarios, fully…

Artificial Intelligence · Computer Science 2026-01-09 Shogo Nakayama , Masahiro Okuda

The success of deep learning in medical imaging is mostly achieved at the cost of a large labeled data set. Semi-supervised learning (SSL) provides a promising solution by leveraging the structure of unlabeled data to improve learning from…

Machine Learning · Computer Science 2019-07-24 Prashnna Kumar Gyawali , Zhiyuan Li , Sandesh Ghimire , Linwei Wang

Semi-supervised learning (SSL) has attracted much attention since it reduces the expensive costs of collecting adequate well-labeled training data, especially for deep learning methods. However, traditional SSL is built upon an assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Lie Ju , Yicheng Wu , Wei Feng , Zhen Yu , Lin Wang , Zhuoting Zhu , Zongyuan Ge

Recent successes in self-supervised learning (SSL) model spatial co-occurrences of visual features either by masking portions of an image or by aggressively cropping it. Here, we propose a new way to model spatial co-occurrences by aligning…

Machine Learning · Computer Science 2025-01-07 Arthur Aubret , Céline Teulière , Jochen Triesch

Object-centric understanding is fundamental to human vision and required for complex reasoning. Traditional methods define slot-based bottlenecks to learn object properties explicitly, while recent self-supervised vision models like DINO…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Stefan Sylvius Wagner , Stefan Harmeling

Although supervised learning has enabled high performance for image segmentation, it requires a large amount of labeled training data, which can be difficult to obtain in the medical imaging field. Self-supervised learning (SSL) methods…

Remote sensing data has been widely used for various Earth Observation (EO) missions such as land use and cover classification, weather forecasting, agricultural management, and environmental monitoring. Most existing remote sensing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Xin Zhang , Liangxiu Han

Self-supervised learning (SSL) has attracted increased attention for learning meaningful speech representations. Speech SSL models, such as WavLM, employ masked prediction training to encode general-purpose representations. In contrast,…

Computation and Language · Computer Science 2024-02-01 Takanori Ashihara , Marc Delcroix , Takafumi Moriya , Kohei Matsuura , Taichi Asami , Yusuke Ijima

Self-supervised learning (SSL) is a powerful tool in machine learning, but understanding the learned representations and their underlying mechanisms remains a challenge. This paper presents an in-depth empirical analysis of SSL-trained…

Machine Learning · Computer Science 2023-06-01 Ido Ben-Shaul , Ravid Shwartz-Ziv , Tomer Galanti , Shai Dekel , Yann LeCun

Self-supervised learning (SSL) has improved empirical performance by unleashing the power of unlabeled data for practical applications. Specifically, SSL extracts the representation from massive unlabeled data, which will be transferred to…

Machine Learning · Computer Science 2026-02-16 Bo Dai , Na Li , Dale Schuurmans

Semantic segmentation is a crucial step in many Earth observation tasks. Large quantity of pixel-level annotation is required to train deep networks for semantic segmentation. Earth observation techniques are applied to varieties of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Sudipan Saha , Lichao Mou , Muhammad Shahzad , Xiao Xiang Zhu

Semi-supervised learning (SSL) can reduce the need for large labelled datasets by incorporating unlabelled data into the training. This is particularly interesting for semantic segmentation, where labelling data is very costly and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Sebastian Scherer , Robin Schön , Rainer Lienhart

Human adaptability relies crucially on learning and merging knowledge from both supervised and unsupervised tasks: the parents point out few important concepts, but then the children fill in the gaps on their own. This is particularly…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Silvia Bucci , Antonio D'Innocente , Yujun Liao , Fabio Maria Carlucci , Barbara Caputo , Tatiana Tommasi