English
Related papers

Related papers: Do SSL Models Have D\'ej\`a Vu? A Case of Unintend…

200 papers

Masked autoencoders are scalable vision learners, as the title of MAE \cite{he2022masked}, which suggests that self-supervised learning (SSL) in vision might undertake a similar trajectory as in NLP. Specifically, generative pretext tasks…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Chaoning Zhang , Chenshuang Zhang , Junha Song , John Seon Keun Yi , Kang Zhang , In So Kweon

State-of-the-art deep learning models are often trained with a large amount of costly labeled training data. However, requiring exhaustive manual annotations may degrade the model's generalizability in the limited-label regime.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yanbei Chen , Massimiliano Mancini , Xiatian Zhu , Zeynep Akata

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Huijie Guo , Ying Ba , Jie Hu , Lingyu Si , Wenwen Qiang , Lei Shi

Multimodal Large Language Models (MLLMs) trained on massive data may memorize sensitive personal information and photos, posing serious privacy risks. To mitigate this, MLLM unlearning methods are proposed, which fine-tune MLLMs to reduce…

Machine Learning · Computer Science 2025-09-23 Xianren Zhang , Hui Liu , Delvin Ce Zhang , Xianfeng Tang , Qi He , Dongwon Lee , Suhang Wang

Self-supervised learning (SSL) has gained widespread attention in the remote sensing (RS) and earth observation (EO) communities owing to its ability to learn task-agnostic representations without human-annotated labels. Nevertheless, most…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Dilxat Muhtar , Xueliang Zhang , Pengfeng Xiao , Zhenshi Li , Feng Gu

Self-supervised learning (SSL) for speech representation has been successfully applied in various downstream tasks, such as speech and speaker recognition. More recently, speech SSL models have also been shown to be beneficial in advancing…

Computation and Language · Computer Science 2024-08-28 Takanori Ashihara , Takafumi Moriya , Kohei Matsuura , Tomohiro Tanaka , Yusuke Ijima , Taichi Asami , Marc Delcroix , Yukinori Honma

Self-supervised learning (SSL) approaches have shown promising capabilities in learning the representation from unlabeled data. Amongst them, momentum-based frameworks have attracted significant attention. Despite being a great success,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Trung X. Pham , Axi Niu , Zhang Kang , Sultan Rizky Madjid , Ji Woo Hong , Daehyeok Kim , Joshua Tian Jin Tee , Chang D. Yoo

Self-supervised learning (SSL) has recently shown remarkable results in closing the gap between supervised and unsupervised learning. The idea is to learn robust features that are invariant to distortions of the input data. Despite its…

Sound · Computer Science 2023-03-08 Bac Nguyen , Stefan Uhlich , Fabien Cardinaux

Self-supervised learning (SSL) speech models have achieved remarkable performance in various tasks, yet the biased outcomes, especially affecting marginalized groups, raise significant concerns. Social bias refers to the phenomenon where…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-06 Yi-Cheng Lin , Tzu-Quan Lin , Hsi-Che Lin , Andy T. Liu , Hung-yi Lee

Self-supervised learning (SSL) has proven effective in solving various problems by generating internal supervisory signals. Unsupervised anomaly detection, which faces the high cost of obtaining true labels, is an area that can greatly…

Machine Learning · Computer Science 2023-07-14 Jaemin Yoo , Yue Zhao , Lingxiao Zhao , Leman Akoglu

Self-Supervised learning (SSL) with Joint-Embedding Architectures (JEA) has led to outstanding performances. All instantiations of this paradigm were trained using strong and well-established hand-crafted data augmentations, leading to the…

Machine Learning · Computer Science 2024-12-02 Théo Moutakanni , Maxime Oquab , Marc Szafraniec , Maria Vakalopoulou , Piotr Bojanowski

In deep learning research, self-supervised learning (SSL) has received great attention triggering interest within both the computer vision and remote sensing communities. While there has been a big success in computer vision, most of the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Yi Wang , Conrad M Albrecht , Nassim Ait Ali Braham , Lichao Mou , Xiao Xiang Zhu

Inspired by the success of Self-supervised learning (SSL) in learning visual representations from unlabeled data, a few recent works have studied SSL in the context of continual learning (CL), where multiple tasks are learned sequentially,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Li Yang , Sen Lin , Fan Zhang , Junshan Zhang , Deliang Fan

Deep models trained in supervised mode have achieved remarkable success on a variety of tasks. When labeled samples are limited, self-supervised learning (SSL) is emerging as a new paradigm for making use of large amounts of unlabeled…

Machine Learning · Computer Science 2022-04-26 Yaochen Xie , Zhao Xu , Jingtun Zhang , Zhengyang Wang , Shuiwang Ji

Self-supervised learning (SSL) has become the de facto training paradigm of large models, where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Despite demonstrating comparable performance with…

Machine Learning · Computer Science 2024-06-05 Sofia Yfantidou , Dimitris Spathis , Marios Constantinides , Athena Vakali , Daniele Quercia , Fahim Kawsar

Self-supervised learning (SSL) has recently achieved tremendous empirical advancements in learning image representation. However, our understanding of the principle behind learning such a representation is still limited. This work shows…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Yubei Chen , Adrien Bardes , Zengyi Li , Yann LeCun

Image AutoRegressive (IAR) models have achieved state-of-the-art performance in speed and quality of generated images. However, they also raise concerns about memorization of their training data and its implications for privacy. This work…

Machine Learning · Computer Science 2025-09-03 Aditya Kasliwal , Franziska Boenisch , Adam Dziedzic

We consider the problem of semi-supervised 3D action recognition which has been rarely explored before. Its major challenge lies in how to effectively learn motion representations from unlabeled data. Self-supervised learning (SSL) has been…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Chenyang Si , Xuecheng Nie , Wei Wang , Liang Wang , Tieniu Tan , Jiashi Feng

Semi-supervised learning (SSL) has attracted much attention since it reduces the expensive costs of collecting adequate well-labeled training data, especially for deep learning methods. However, traditional SSL is built upon an assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Lie Ju , Yicheng Wu , Wei Feng , Zhen Yu , Lin Wang , Zhuoting Zhu , Zongyuan Ge

Can pretrained models generalize to new datasets without any retraining? We deploy pretrained image models on datasets they were not trained for, and investigate whether their embeddings form meaningful clusters. Our suite of benchmarking…

Machine Learning · Computer Science 2024-06-05 Scott C. Lowe , Joakim Bruslund Haurum , Sageev Oore , Thomas B. Moeslund , Graham W. Taylor