English
Related papers

Related papers: Transferrable Contrastive Learning for Visual Doma…

200 papers

Domain adaptation has become a widely adopted approach in machine learning due to the high costs associated with labeling data. It is typically applied when access to a labeled source domain is available. However, in real-world scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Amirfarhad Farhadi , Naser Mozayani , Azadeh Zamanifar

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Multi-domain learning (MDL) refers to simultaneously constructing a model or a set of models on datasets collected from different domains. Conventional approaches emphasize domain-shared information extraction and domain-private information…

Machine Learning · Computer Science 2023-07-31 Rui He , Shengcai Liu , Jiahao Wu , Shan He , Ke Tang

Contrastive Learning (CL) enhances the training of sequential recommendation (SR) models through informative self-supervision signals. Existing methods often rely on data augmentation strategies to create positive samples and promote…

Information Retrieval · Computer Science 2026-04-06 Zhikai Wang , Yanyan Shen , Zexi Zhang , Li He , Yichun Li , Hao Gu , Yinghua Zhang

While contrastive learning is proven to be an effective training strategy in computer vision, Natural Language Processing (NLP) is only recently adopting it as a self-supervised alternative to Masked Language Modeling (MLM) for improving…

Computation and Language · Computer Science 2021-09-16 Hooman Sedghamiz , Shivam Raval , Enrico Santus , Tuka Alhanai , Mohammad Ghassemi

Contrastive learning has been frequently investigated to learn effective representations for text clustering tasks. While existing contrastive learning-based text clustering methods only focus on modeling instance-wise semantic similarity…

Computation and Language · Computer Science 2024-08-27 Qian Yong , Chen Chen , Xiabing Zhou

In semi-supervised domain adaptation (SSDA), a few labeled target samples of each class help the model to transfer knowledge representation from the fully labeled source domain to the target domain. Many existing methods ignore the benefits…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Xinyang Huang , Chuang Zhu , Wenkai Chen

Self-Supervised Learning (SSL) has emerged as a promising approach in computer vision, enabling networks to learn meaningful representations from large unlabeled datasets. SSL methods fall into two main categories: instance discrimination…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Alina Ciocarlan , Sidonie Lefebvre , Sylvie Le Hégarat-Mascle , Arnaud Woiselle

Detecting lane markings in road scenes poses a challenge due to their intricate nature, which is susceptible to unfavorable conditions. While lane markings have strong shape priors, their visibility is easily compromised by lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Ali Zoljodi , Sadegh Abadijou , Mina Alibeigi , Masoud Daneshtalab

Although unsupervised domain adaptation (UDA) is a promising direction to alleviate domain shift, they fall short of their supervised counterparts. In this work, we investigate relatively less explored semi-supervised domain adaptation…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Hritam Basak , Zhaozheng Yin

Deep learning highly relies on the amount of annotated data. However, annotating medical images is extremely laborious and expensive. To this end, self-supervised learning (SSL), as a potential solution for deficient annotated data,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Jiuwen Zhu , Yuexiang Li , Yifan Hu , S. Kevin Zhou

While state-of-the-art contrastive Self-Supervised Learning (SSL) models produce results competitive with their supervised counterparts, they lack the ability to infer latent variables. In contrast, prescribed latent variable (LV) models…

Machine Learning · Computer Science 2021-12-01 Jason Ramapuram , Dan Busbridge , Xavier Suau , Russ Webb

Self-supervised learning (SSL) has rapidly emerged as a transformative approach in computer vision, enabling the extraction of rich feature representations from vast amounts of unlabeled data and reducing reliance on costly manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Nikolaos Giakoumoglou , Tania Stathaki , Athanasios Gkelias

Fault diagnosis under unseen operating conditions remains highly challenging when labeled data are scarce. Semi-supervised domain generalization fault diagnosis (SSDGFD) provides a practical solution by jointly exploiting labeled and…

Machine Learning · Computer Science 2026-04-24 Junyu Ren , Wensheng Gan , Philip S Yu

Deep learning-based AMC methods have achieved remarkable performance, but their practical deployment remains constrained by the high cost of labeled data. Although self-supervised learning (SSL) reduces the reliance on labels, existing…

Signal Processing · Electrical Eng. & Systems 2026-05-13 Chenxu Wang , Shuang Wang , Lirong Han , Xinyu Hu , Hanlin Mo , Hantong Xing , Licheng Jiao

Self-training and contrastive learning have emerged as leading techniques for incorporating unlabeled data, both under distribution shift (unsupervised domain adaptation) and when it is absent (semi-supervised learning). However, despite…

Self-supervised learning (SSL) has emerged as a powerful technique for learning rich representations from unlabeled data. The data representations are able to capture many underlying attributes of data, and be useful in downstream…

Machine Learning · Computer Science 2023-12-01 Weicheng Zhu , Sheng Liu , Carlos Fernandez-Granda , Narges Razavian

Contrastive learning (CL) approaches have gained great recognition as a very successful subset of self-supervised learning (SSL) methods. SSL enables learning from unlabeled data, a crucial step in the advancement of deep learning,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Mohamed Hassan , Mohammad Wasil , Sebastian Houben

It is well known that the success of deep neural networks is greatly attributed to large-scale labeled datasets. However, it can be extremely time-consuming and laborious to collect sufficient high-quality labeled data in most practical…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Yao Yao , Junyi Shen , Jin Xu , Bin Zhong , Li Xiao

Deep neural networks have been widely studied in autonomous driving applications such as semantic segmentation or depth estimation. However, training a neural network in a supervised manner requires a large amount of annotated labels which…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Dongseok Shim , H. Jin Kim