English
Related papers

Related papers: Understanding Self-Training for Gradual Domain Ada…

200 papers

Domain adaptation aims at adapting the knowledge acquired on a source domain to a new different but related target domain. Several approaches have beenproposed for classification tasks in the unsupervised scenario, where no labeled target…

Computer Vision and Pattern Recognition · Computer Science 2015-04-30 Basura Fernando , Tatiana Tommasi , Tinne Tuytelaars

Although deep neural networks have achieved remarkable results for the task of semantic segmentation, they usually fail to generalize towards new domains, especially when performing synthetic-to-real adaptation. Such domain shift is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Adriano Cardace , Pierluigi Zama Ramirez , Samuele Salti , Luigi Di Stefano

We demonstrate that self-learning techniques like entropy minimization and pseudo-labeling are simple and effective at improving performance of a deployed computer vision model under systematic domain shifts. We conduct a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Evgenia Rusak , Steffen Schneider , George Pachitariu , Luisa Eck , Peter Gehler , Oliver Bringmann , Wieland Brendel , Matthias Bethge

One of the central problems in machine learning is domain adaptation. Unlike past theoretical work, we consider a new model for subpopulation shift in the input or representation space. In this work, we propose a provably effective…

Machine Learning · Computer Science 2021-07-21 Tianle Cai , Ruiqi Gao , Jason D. Lee , Qi Lei

Machine learning algorithms have achieved remarkable success across various disciplines, use cases and applications, under the prevailing assumption that training and test samples are drawn from the same distribution. Consequently, these…

Machine Learning · Computer Science 2024-11-07 Zehao Xiao , Cees G. M. Snoek

We consider the problem of unsupervised domain adaptation for image classification. To learn target-domain-aware features from the unlabeled data, we create a self-supervised pretext task by augmenting the unlabeled data with a certain type…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 L. Xiao , J. Xu , D. Zhao , Z. Wang , L. Wang , Y. Nie , B. Dai

The aim of this paper is to address the challenge of gradual domain adaptation within a class of manifold-constrained data distributions. In particular, we consider a sequence of $T\ge2$ data distributions $P_1,\ldots,P_T$ undergoing a…

Unsupervised Domain Adaptive Object Detection (UDA-OD) uses unlabelled data to improve the reliability of robotic vision systems in open-world environments. Previous approaches to UDA-OD based on self-training have been effective in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Nicolas Harvey Chapman , Feras Dayoub , Will Browne , Christopher Lehnert

The performance of automatic speech recognition (ASR) systems typically degrades significantly when the training and test data domains are mismatched. In this paper, we show that self-training (ST) combined with an uncertainty-based…

Computation and Language · Computer Science 2021-02-17 Sameer Khurana , Niko Moritz , Takaaki Hori , Jonathan Le Roux

Traditional machine learning assumes that training and test sets are derived from the same distribution; however, this assumption does not always hold in practical applications. This distribution disparity can lead to severe performance…

Machine Learning · Computer Science 2025-02-18 Ahmad Chaddad , Yihang Wu , Yuchen Jiang , Ahmed Bouridane , Christian Desrosiers

Self-training and contrastive learning have emerged as leading techniques for incorporating unlabeled data, both under distribution shift (unsupervised domain adaptation) and when it is absent (semi-supervised learning). However, despite…

Domain adaptation is an important technique to alleviate performance degradation caused by domain shift, e.g., when training and test data come from different domains. Most existing deep adaptation methods focus on reducing domain shift by…

Machine Learning · Computer Science 2019-06-25 Jun Wen , Nenggan Zheng , Junsong Yuan , Zhefeng Gong , Changyou Chen

Deep learning has raised hopes and expectations as a general solution for many applications; indeed it has proven effective, but it also showed a strong dependence on large quantities of data. Luckily, it has been shown that, even when data…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Fabio Maria Carlucci

Imitation learning models for robotic tasks typically rely on multi-modal inputs, such as RGB images, language, and proprioceptive states. While proprioception is intuitively important for decision-making and obstacle avoidance, simply…

Robotics · Computer Science 2025-07-02 Fuhang Kuang , Jiacheng You , Yingdong Hu , Tong Zhang , Chuan Wen , Yang Gao

We propose a learning problem involving adapting a pre-trained source model to the target domain for classifying all classes that appeared in the source data, using target data that covers only a partial label space. This problem is…

Machine Learning · Computer Science 2023-11-03 Cheng-Hao Tu , Hong-You Chen , Zheda Mai , Jike Zhong , Vardaan Pahuja , Tanya Berger-Wolf , Song Gao , Charles Stewart , Yu Su , Wei-Lun Chao

Domain generalization aims to learn a prediction model on multi-domain source data such that the model can generalize to a target domain with unknown statistics. Most existing approaches have been developed under the assumption that the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Jin Kim , Jiyoung Lee , Jungin Park , Dongbo Min , Kwanghoon Sohn

Multimodal image registration is a very challenging problem for deep learning approaches. Most current work focuses on either supervised learning that requires labelled training scans and may yield models that bias towards annotated…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Mattias P Heinrich , Lasse Hansen

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…

Supervised learning with large scale labeled datasets and deep layered models has made a paradigm shift in diverse areas in learning and recognition. However, this approach still suffers generalization issues under the presence of a domain…

Machine Learning · Statistics 2016-03-28 Ozan Sener , Hyun Oh Song , Ashutosh Saxena , Silvio Savarese

In the absence of labeled target data, unsupervised domain adaptation approaches seek to align the marginal distributions of the source and target domains in order to train a classifier for the target. Unsupervised domain alignment…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Sachin Chhabra , Hemanth Venkateswara , Baoxin Li