English
Related papers

Related papers: Pre-Training Transformers for Domain Adaptation

200 papers

Large-scale labeled training datasets have enabled deep neural networks to excel on a wide range of benchmark vision tasks. However, in many applications it is prohibitively expensive or time-consuming to obtain large quantities of labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Sicheng Zhao , Bichen Wu , Joseph Gonzalez , Sanjit A. Seshia , Kurt Keutzer

Domain adaptation is a potential method to train a powerful deep neural network, which can handle the absence of labeled data. More precisely, domain adaptation solving the limitation called dataset bias or domain shift when the training…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Thai-Vu Nguyen , Anh Nguyen , Nghia Le , Bac Le

Domain adaptation (DA) aims to transfer knowledge learned from a labeled source domain to an unlabeled or a less labeled but related target domain. Ideally, the source and target distributions should be aligned to each other equally to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Jian Hu , Haowen Zhong , Junchi Yan , Shaogang Gong , Guile Wu , Fei Yang

Since annotating and curating large datasets is very expensive, there is a need to transfer the knowledge from existing annotated datasets to unlabelled data. Data that is relevant for a specific application, however, usually differs from…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Pau Panareda Busto , Ahsan Iqbal , Juergen Gall

Unsupervised domain adaptation for object detection addresses the adaption of detectors trained in a source domain to work accurately in an unseen target domain. Recently, methods approaching the alignment of the intermediate features…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Vinicius F. Arruda , Rodrigo F. Berriel , Thiago M. Paixão , Claudine Badue , Alberto F. De Souza , Nicu Sebe , Thiago Oliveira-Santos

In this work, we explore the usage of the Frequency Transformation for reducing the domain shift between the source and target domain (e.g., synthetic image and real image respectively) towards solving the Domain Adaptation task. Most of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vikash Kumar , Himanshu Patil , Rohit Lal , Anirban Chakraborty

Domain adaptation (DA) attempts to transfer the knowledge from a labeled source domain to an unlabeled target domain that follows different distribution from the source. To achieve this, DA methods include a source classification objective…

Machine Learning · Computer Science 2021-12-10 Fangrui Lv , Jian Liang , Kaixiong Gong , Shuang Li , Chi Harold Liu , Han Li , Di Liu , Guoren Wang

This notebook paper presents an overview and comparative analysis of our systems designed for the following two tasks in Visual Domain Adaptation Challenge (VisDA-2019): multi-source domain adaptation and semi-supervised domain adaptation.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Yingwei Pan , Yehao Li , Qi Cai , Yang Chen , Ting Yao

Domain adaptation (DA) is the task of classifying an unlabeled dataset (target) using a labeled dataset (source) from a related domain. The majority of successful DA methods try to directly match the distributions of the source and target…

Machine Learning · Statistics 2018-03-22 Twan van Laarhoven , Elena Marchiori

Domain adaptation (DA) is transfer learning which aims to learn an effective predictor on target data from source data despite data distribution mismatch between source and target. We present in this paper a novel unsupervised DA method for…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 Lingkun Luo , Liming Chen , Ying lu , Shiqiang Hu

Unsupervised domain adaptation (UDA) aims to mitigate the domain shift issue, where the distribution of training (source) data differs from that of testing (target) data. Many models have been developed to tackle this problem, and recently…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Ali Abedi , Q. M. Jonathan Wu , Ning Zhang , Farhad Pourpanah

Reading comprehension (RC) has been studied in a variety of datasets with the boosted performance brought by deep neural networks. However, the generalization capability of these models across different domains remains unclear. To alleviate…

Computation and Language · Computer Science 2020-07-28 Yu Cao , Meng Fang , Baosheng Yu , Joey Tianyi Zhou

Domain shift is a significant challenge in machine learning, particularly in medical applications where data distributions differ across institutions due to variations in data collection practices, equipment, and procedures. This can…

Machine Learning · Computer Science 2025-06-30 Takumi Okuo , Shinnosuke Matsuo , Shota Harada , Kiyohito Tanaka , Ryoma Bise

Unsupervised Domain Adaptation aims to learn a model on a source domain with labeled data in order to perform well on unlabeled data of a target domain. Current approaches focus on learning \textit{Domain Invariant Representations}. It…

Machine Learning · Computer Science 2019-07-30 Victor Bouvier , Philippe Very , Céline Hudelot , Clément Chastagnol

As a study on the efficient usage of data, Multi-source Unsupervised Domain Adaptation transfers knowledge from multiple source domains with labeled data to an unlabeled target domain. However, the distribution discrepancy between different…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Tong Xu , Lin Wang , Wu Ning , Chunyan Lyu , Kejun Wang , Chenhui Wang

This paper presents our proposed methods for domain adaptive pedestrian re-identification (Re-ID) task in Visual Domain Adaptation Challenge (VisDA-2020). Considering the large gap between the source domain and target domain, we focused on…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Jianyang Gu , Hao Luo , Weihua Chen , Yiqi Jiang , Yuqi Zhang , Shuting He , Fan Wang , Hao Li , Wei Jiang

Unsupervised domain adaptation, which involves transferring knowledge from a label-rich source domain to an unlabeled target domain, can be used to substantially reduce annotation costs in the field of object detection. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Kazuma Fujii , Hiroshi Kera , Kazuhiko Kawamoto

For visual document understanding (VDU), self-supervised pretraining has been shown to successfully generate transferable representations, yet, effective adaptation of such representations to distribution shifts at test-time remains to be…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Sayna Ebrahimi , Sercan O. Arik , Tomas Pfister

A pre-trained language model, BERT, has brought significant performance improvements across a range of natural language processing tasks. Since the model is trained on a large corpus of diverse topics, it shows robust performance for domain…

Computation and Language · Computer Science 2020-10-26 Minho Ryu , Kichun Lee

Due to the difficulty of obtaining ground-truth labels, learning from virtual-world datasets is of great interest for real-world applications like semantic segmentation. From domain adaptation perspective, the key challenge is to learn…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Fengyi Shen , Akhil Gurram , Ahmet Faruk Tuna , Onay Urfalioglu , Alois Knoll