English
Related papers

Related papers: Towards domain-invariant Self-Supervised Learning …

200 papers

When domains, which represent underlying data distributions, vary during training and testing processes, deep neural networks suffer a drop in their performance. Domain generalization allows improvements in the generalization performance…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Toshihiko Matsuura , Tatsuya Harada

Existing unsupervised domain adaptation methods aim to transfer knowledge from a label-rich source domain to an unlabeled target domain. However, obtaining labels for some source domains may be very expensive, making complete labeling as…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Donghyun Kim , Kuniaki Saito , Tae-Hyun Oh , Bryan A. Plummer , Stan Sclaroff , Kate Saenko

Self-supervised learning (SSL) has developed rapidly in recent years. However, most of the mainstream methods are computationally expensive and rely on two (or more) augmentations for each image to construct positive pairs. Moreover, they…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yun-Hao Cao , Jianxin Wu

Recent analyses of self-supervised learning (SSL) find the following data-centric properties to be critical for learning good representations: invariance to task-irrelevant semantics, separability of classes in some latent space, and…

Machine Learning · Computer Science 2023-01-24 Puja Trivedi , Ekdeep Singh Lubana , Mark Heimann , Danai Koutra , Jayaraman J. Thiagarajan

Unsupervised domain adaptation (UDA) aims to transfer and adapt knowledge from a labeled source domain to an unlabeled target domain. Traditionally, subspace-based methods form an important class of solutions to this problem. Despite their…

Machine Learning · Computer Science 2022-01-07 Kowshik Thopalli , Jayaraman J Thiagarajan , Rushil Anirudh , Pavan K Turaga

Semi-supervised learning (SSL) has been widely explored in recent years, and it is an effective way of leveraging unlabeled data to reduce the reliance on labeled data. In this work, we adjust neural processes (NPs) to the semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Jianfeng Wang , Xiaolin Hu , Thomas Lukasiewicz

Self-Supervised Learning (SSL) is an important paradigm for learning representations from unlabelled data, and SSL with neural networks has been highly successful in practice. However current theoretical analysis of SSL is mostly restricted…

Machine Learning · Computer Science 2023-09-06 Pascal Esser , Satyaki Mukherjee , Debarghya Ghoshdastidar

Many self-supervised learning (SSL) methods have been successful in learning semantically meaningful visual representations by solving pretext tasks. However, prior work in SSL focuses on tasks like object recognition or detection, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Donghyun Kim , Kuniaki Saito , Samarth Mishra , Stan Sclaroff , Kate Saenko , Bryan A Plummer

Domain generalization (DG) aims to generalize a model trained on multiple source (i.e., training) domains to a distributionally different target (i.e., test) domain. In contrast to the conventional DG that strictly requires the availability…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Zijian Wang , Yadan Luo , Ruihong Qiu , Zi Huang , Mahsa Baktashmotlagh

Unsupervised domain adaptation (UDA) is to learn classification models that make predictions for unlabeled data on a target domain, given labeled data on a source domain whose distribution diverges from the target one. Mainstream UDA…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Hui Tang , Xiatian Zhu , Ke Chen , Kui Jia , C. L. Philip Chen

In domain generalization (DG), the target domain is unknown when the model is being trained, and the trained model should successfully work on an arbitrary (and possibly unseen) target domain during inference. This is a difficult problem,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Jungwuk Park , Dong-Jun Han , Soyeong Kim , Jaekyun Moon

Self-Supervised Learning (SSL) is a paradigm that leverages unlabeled data for model training. Empirical studies show that SSL can achieve promising performance in distribution shift scenarios, where the downstream and training…

Machine Learning · Computer Science 2023-12-13 Xuyang Zhao , Tianqi Du , Yisen Wang , Jun Yao , Weiran Huang

Unsupervised Domain Adaptation (UDA) refers to the method that utilizes annotated source domain data and unlabeled target domain data to train a model capable of generalizing to the target domain data. Domain discrepancy leads to a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Ting Li , Jianshu Chao , Deyu An

With the progress of sensor technology in wearables, the collection and analysis of PPG signals are gaining more interest. Using Machine Learning, the cardiac rhythm corresponding to PPG signals can be used to predict different tasks such…

Signal Processing · Electrical Eng. & Systems 2022-12-20 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax

Self-Supervised Learning (SSL) methods operate on unlabeled data to learn robust representations useful for downstream tasks. Most SSL methods rely on augmentations obtained by transforming the 2D image pixel map. These augmentations ignore…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Sumukh Aithal , Anirudh Goyal , Alex Lamb , Yoshua Bengio , Michael Mozer

In recent years, deep learning has significantly advanced sound source localization (SSL). However, training such models requires large labeled datasets, and real recordings are costly to annotate in particular if sources move. While…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-17 Bingxiang Zhong , Thomas Dietzen

The paradigm of training models on massive data without label through self-supervised learning (SSL) and finetuning on many downstream tasks has become a trend recently. However, due to the high training costs and the unconsciousness of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Qing Chang , Junran Peng , Lingxie Xie , Jiajun Sun , Haoran Yin , Qi Tian , Zhaoxiang Zhang

Self-supervised learning (SSL) has recently shown notable success in various visual tasks. However, in terms of discriminability, SSL is still not on par with supervised learning (SL). This paper identifies a key issue, the ``crowding…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zeen Song , Wenwen Qiang , Changwen Zheng , Fuchun Sun , Hui Xiong

With diverse presentation attacks emerging continually, generalizable face anti-spoofing (FAS) has drawn growing attention. Most existing methods implement domain generalization (DG) on the complete representations. However, different image…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Zhuo Wang , Zezheng Wang , Zitong Yu , Weihong Deng , Jiahong Li , Tingting Gao , Zhongyuan Wang

We extend semi-supervised learning to the problem of domain adaptation to learn significantly higher-accuracy models that train on one data distribution and test on a different one. With the goal of generality, we introduce AdaMatch, a…

Machine Learning · Computer Science 2022-03-16 David Berthelot , Rebecca Roelofs , Kihyuk Sohn , Nicholas Carlini , Alex Kurakin