English
Related papers

Related papers: Pre-Training Transformers for Domain Adaptation

200 papers

Unsupervised Domain Adaptation (UDA) refers to the method that utilizes annotated source domain data and unlabeled target domain data to train a model capable of generalizing to the target domain data. Domain discrepancy leads to a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Ting Li , Jianshu Chao , Deyu An

We investigate the problem of cross-dataset adaptation for visual question answering (Visual QA). Our goal is to train a Visual QA model on a source dataset but apply it to another target one. Analogous to domain adaptation for visual…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Wei-Lun Chao , Hexiang Hu , Fei Sha

In this paper, we address the problem of unsupervised Domain Adaptation. The need for such an adaptation arises when the distribution of the target data differs from that which is used to develop the model and the ground truth information…

Machine Learning · Computer Science 2022-10-04 Siddharth Roheda , Ashkan Panahi , Hamid Krim

By using unsupervised domain adaptation (UDA), knowledge can be transferred from a label-rich source domain to a target domain that contains relevant information but lacks labels. Many existing UDA algorithms suffer from directly using raw…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Le Luo , Bingrong Xu , Qingyong Zhang , Cheng Lian , Jie Luo

The performance of a machine learning model degrades when it is applied to data from a similar but different domain than the data it has initially been trained on. To mitigate this domain shift problem, domain adaptation (DA) techniques…

Machine Learning · Computer Science 2024-10-08 Felix Ott , David Rügamer , Lucas Heublein , Bernd Bischl , Christopher Mutschler

Over the last few years, Unsupervised Domain Adaptation (UDA) techniques have acquired remarkable importance and popularity in computer vision. However, when compared to the extensive literature available for images, the field of videos is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Victor G. Turrisi da Costa , Giacomo Zara , Paolo Rota , Thiago Oliveira-Santos , Nicu Sebe , Vittorio Murino , Elisa Ricci

Domain adaptation (DA) addresses the real-world image classification problem of discrepancy between training (source) and testing (target) data distributions. We propose an unsupervised DA method that considers the presence of only…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Debasmit Das , C. S. George Lee

This paper addresses unsupervised domain adaptation, the setting where labeled training data is available on a source domain, but the goal is to have good performance on a target domain with only unlabeled data. Like much of previous work,…

Machine Learning · Computer Science 2019-10-01 Yu Sun , Eric Tzeng , Trevor Darrell , Alexei A. Efros

Modern AI models excel in controlled settings but often fail in real-world scenarios where data distributions shift unpredictably - a challenge known as domain generalisation (DG). This paper tackles this limitation by rigorously evaluating…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Hamza Riaz , Alan F. Smeaton

The exploitation of visible spectrum datasets has led deep networks to show remarkable success. However, real-world tasks include low-lighting conditions which arise performance bottlenecks for models trained on large-scale RGB image…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Berkcan Ustun , Ahmet Kagan Kaya , Ezgi Cakir Ayerden , Fazil Altinel

The accuracy of deep learning (e.g., convolutional neural networks) for an image classification task critically relies on the amount of labeled training data. Aiming to solve an image classification task on a new domain that lacks labeled…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Xianghong Fang , Haoli Bai , Ziyi Guo , Bin Shen , Steven Hoi , Zenglin Xu

Using synthetic data for training neural networks that achieve good performance on real-world data is an important task as it can reduce the need for costly data annotation. Yet, synthetic and real world data have a domain gap. Reducing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Shahaf Ettedgui , Shady Abu-Hussein , Raja Giryes

In this paper, we investigate a challenging unsupervised domain adaptation setting -- unsupervised model adaptation. We aim to explore how to rely only on unlabeled target data to improve performance of an existing source prediction model…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Rui Li , Qianfen Jiao , Wenming Cao , Hau-San Wong , Si Wu

The goal of domain adaptation is to adapt models learned on a source domain to a particular target domain. Most methods for unsupervised domain adaptation proposed in the literature to date, assume that the set of classes present in the…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Ayush Mittal , Anant Raj , Vinay P. Namboodiri , Tinne Tuytelaars

Test-time domain adaptation aims to adapt a source pre-trained model to a target domain without using any source data. Existing works mainly consider the case where the target domain is static. However, real-world machine perception systems…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Qin Wang , Olga Fink , Luc Van Gool , Dengxin Dai

GeoNet is a recently proposed domain adaptation benchmark consisting of three challenges (i.e., GeoUniDA, GeoImNet, and GeoPlaces). Each challenge contains images collected from the USA and Asia where there are huge geographical gaps. Our…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Lijun Sheng , Zhengbo Wang , Jian Liang

Domain adaptation targets at knowledge acquisition and dissemination from a labeled source domain to an unlabeled target domain under distribution shift. Still, the common requirement of identical class space shared across domains hinders…

Machine Learning · Computer Science 2022-03-16 Zhangjie Cao , Kaichao You , Ziyang Zhang , Jianmin Wang , Mingsheng Long

Visual domain adaptation (DA) seeks to transfer trained models to unseen, unlabeled domains across distribution shift, but approaches typically focus on adapting convolutional neural network architectures initialized with supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Viraj Prabhu , Sriram Yenamandra , Aaditya Singh , Judy Hoffman

We introduce a self-supervised vision representation model BEiT, which stands for Bidirectional Encoder representation from Image Transformers. Following BERT developed in the natural language processing area, we propose a masked image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Hangbo Bao , Li Dong , Songhao Piao , Furu Wei

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…