English
Related papers

Related papers: Efficient Pre-trained Features and Recurrent Pseud…

200 papers

Self-training has been shown to be helpful in addressing data scarcity for many domains, including vision, speech, and language. Specifically, self-training, or pseudo-labeling, labels unsupervised data and adds that to the training pool.…

Computation and Language · Computer Science 2022-12-21 Mozhdeh Gheini , Tatiana Likhomanenko , Matthias Sperber , Hendra Setiawan

Self-training emerges as an important research line on domain adaptation. By taking the model's prediction as the pseudo labels of the unlabeled data, self-training bootstraps the model with pseudo instances in the target domain. However,…

Machine Learning · Computer Science 2023-08-08 Menglong Lu , Zhen Huang , Yunxiang Zhao , Zhiliang Tian , Yang Liu , Dongsheng Li

Domain Adaptation (DA), the process of effectively adapting task models learned on one domain, the source, to other related but distinct domains, the targets, with no or minimal retraining, is typically accomplished using the process of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Behnam Gholami , Pritish Sahu , Minyoung Kim , Vladimir Pavlovic

Foundational Vision-Language Models (VLMs) excel across diverse tasks, but adapting them to new domains without forgetting prior knowledge remains a critical challenge. Continual Learning (CL) addresses this challenge by enabling models to…

Machine Learning · Computer Science 2026-02-03 Vaibhav Singh , Rahaf Aljundi , Eugene Belilovsky

Although current face anti-spoofing methods achieve promising results under intra-dataset testing, they suffer from poor generalization to unseen attacks. Most existing works adopt domain adaptation (DA) or domain generalization (DG)…

Computer Vision and Pattern Recognition · Computer Science 2021-02-25 Jingjing Wang , Jingyi Zhang , Ying Bian , Youyi Cai , Chunmao Wang , Shiliang Pu

Often domain adaptation is performed using a discriminator (domain classifier) to learn domain-invariant feature representations so that a classifier trained on labeled source data will generalize well to unlabeled target data. A line of…

Machine Learning · Computer Science 2019-07-19 Garrett Wilson , Diane J. Cook

Deep learning has produced state-of-the-art results for a variety of tasks. While such approaches for supervised learning have performed well, they assume that training and testing data are drawn from the same distribution, which may not…

Machine Learning · Computer Science 2020-02-10 Garrett Wilson , Diane J. Cook

Self-training based on pseudo-labels has emerged as a dominant approach for addressing conditional distribution shifts in unsupervised domain adaptation (UDA) for semantic segmentation problems. A notable drawback, however, is that this…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Rajshekhar Das , Jonathan Francis , Sanket Vaibhav Mehta , Jean Oh , Emma Strubell , Jose Moura

Unsupervised Domain Adaptation (UDA) aims to classify unlabeled target domain by transferring knowledge from labeled source domain with domain shift. Most of the existing UDA methods try to mitigate the adverse impact induced by the shift…

Machine Learning · Computer Science 2022-12-13 Weikai Li , Songcan Chen

Self-supervised learning systems have gained significant attention in recent years by leveraging clustering-based pseudo-labels to provide supervision without the need for human annotations. However, the noise in these pseudo-labels caused…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Zia-ur-Rehman , Arif Mahmood , Wenxiong Kang

Domain Adaptation (DA) is important for deep learning-based medical image segmentation models to deal with testing images from a new target domain. As the source-domain data are usually unavailable when a trained model is deployed at a new…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Jianghao Wu , Guotai Wang , Ran Gu , Tao Lu , Yinan Chen , Wentao Zhu , Tom Vercauteren , Sébastien Ourselin , Shaoting Zhang

Prognostics and Health Management (PHM) is an emerging field which has received much attention from the manufacturing industry because of the benefits and efficiencies it brings to the table. And Remaining Useful Life (RUL) prediction is at…

Machine Learning · Computer Science 2022-08-18 Manu Joseph , Varchita Lalwani

Semi-supervised domain adaptation (SSDA) adapts a learner to a new domain by effectively utilizing source domain data and a few labeled target samples. It is a practical yet under-investigated research topic. In this paper, we analyze the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Wenqiao Zhang , Changshuo Liu , Can Cui , Beng Chin Ooi

Unsupervised Domain Adaptation~(UDA) has attracted a surge of interest over the past decade but is difficult to be used in real-world applications. Considering the privacy-preservation issues and security concerns, in this work, we study a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Jiexiang Wang , Chaoqi Chen

Black-Box unsupervised domain adaptation (BBUDA) learns knowledge only with the prediction of target data from the source model without access to the source data and source model, which attempts to alleviate concerns about the privacy and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yawen Zou , Chunzhi Gu , Jun Yu , Shangce Gao , Chao Zhang

We demonstrate that self-learning techniques like entropy minimization and pseudo-labeling are simple and effective at improving performance of a deployed computer vision model under systematic domain shifts. We conduct a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Evgenia Rusak , Steffen Schneider , George Pachitariu , Luisa Eck , Peter Gehler , Oliver Bringmann , Wieland Brendel , Matthias Bethge

Unsupervised domain adaptation person re-identification (Re-ID) aims to identify pedestrian images within an unlabeled target domain with an auxiliary labeled source-domain dataset. Many existing works attempt to recover reliable identity…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Qiong Wu , Jiahan Li , Pingyang Dai , Qixiang Ye , Liujuan Cao , Yongjian Wu , Rongrong Ji

Distribution shifts are all too common in real-world applications of machine learning. Domain adaptation (DA) aims to address this by providing various frameworks for adapting models to the deployment data without using labels. However, the…

Machine Learning · Computer Science 2023-09-08 Linus Ericsson , Da Li , Timothy M. Hospedales

The divergence between labeled training data and unlabeled testing data is a significant challenge for recent deep learning models. Unsupervised domain adaptation (UDA) attempts to solve such problem. Recent works show that self-training is…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Chuang Zhu , Kebin Liu , Wenqi Tang , Ke Mei , Jiaqi Zou , Tiejun Huang

Training deep neural networks is challenging when large and annotated datasets are unavailable. Extensive manual annotation of data samples is time-consuming, expensive, and error-prone, notably when it needs to be done by experts. To…

Machine Learning · Computer Science 2021-09-08 Barbara C Benato , Alexandru C Telea , Alexandre X Falcão