English
Related papers

Related papers: Pre-Training Transformers for Domain Adaptation

200 papers

Unsupervised domain adaptation (UDA) aims to transfer and adapt knowledge from a labeled source domain to an unlabeled target domain. Traditionally, subspace-based methods form an important class of solutions to this problem. Despite their…

Machine Learning · Computer Science 2022-01-07 Kowshik Thopalli , Jayaraman J Thiagarajan , Rushil Anirudh , Pavan K Turaga

Unsupervised domain adaptation enables to alleviate the need for pixel-wise annotation in the semantic segmentation. One of the most common strategies is to translate images from the source domain to the target domain and then align their…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jinyu Yang , Weizhi An , Sheng Wang , Xinliang Zhu , Chaochao Yan , Junzhou Huang

Deep learning has raised hopes and expectations as a general solution for many applications; indeed it has proven effective, but it also showed a strong dependence on large quantities of data. Luckily, it has been shown that, even when data…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Fabio Maria Carlucci

Unsupervised domain adaptation aims to learn a model of classifier for unlabeled samples on the target domain, given training data of labeled samples on the source domain. Impressive progress is made recently by learning invariant features…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Yabin Zhang , Hui Tang , Kui Jia , Mingkui Tan

Multi-source unsupervised domain adaptation~(MSDA) aims at adapting models trained on multiple labeled source domains to an unlabeled target domain. In this paper, we propose a novel multi-source domain adaptation framework based on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Jianzhong He , Xu Jia , Shuaijun Chen , Jianzhuang Liu

In this paper, we study the problem of legal domain adaptation problem from an imbalanced source domain to a partial target domain. The task aims to improve legal judgment predictions for non-professional fact descriptions. We formulate…

Computation and Language · Computer Science 2023-02-16 Guangyi Xiao , Xinlong Liu , Hao Chen , Jingzhi Guo , Zhiguo Gong

Unsupervised domain adaption aims to learn a powerful classifier for the target domain given a labeled source data set and an unlabeled target data set. To alleviate the effect of `domain shift', the major challenge in domain adaptation,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Yexun Zhang , Ya Zhang , Yanfeng Wang , Qi Tian

Continual Test-Time Adaptation (CTA) is a challenging task that aims to adapt a source pre-trained model to continually changing target domains. In the CTA setting, a model does not know when the target domain changes, thus facing a drastic…

Machine Learning · Computer Science 2024-03-05 Inseop Chung , Kyomin Hwang , Jayeon Yoo , Nojun Kwak

Deep learning has shown remarkable performance in medical image segmentation. However, despite its promise, deep learning has many challenges in practice due to its inability to effectively transition to unseen domains, caused by the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Dewei Hu , Hao Li , Han Liu , Jiacheng Wang , Xing Yao , Daiwei Lu , Ipek Oguz

Unsupervised cross-modality domain adaptation is a challenging task in medical image analysis, and it becomes more challenging when source and target domain data are collected from multiple institutions. In this paper, we present our…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Han Liu , Yubo Fan , Zhoubing Xu , Benoit M. Dawant , Ipek Oguz

Unsupervised domain adaptation is a promising technique for semantic segmentation and other computer vision tasks for which large-scale data annotation is costly and time-consuming. In semantic segmentation, it is attractive to train models…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Luke Melas-Kyriazi , Arjun K. Manrai

Progress in machine learning is typically measured by training and testing a model on the same distribution of data, i.e., the same domain. This over-estimates future accuracy on out-of-distribution data. The Visual Domain Adaptation…

Machine Learning · Computer Science 2021-07-26 Dina Bashkirova , Dan Hendrycks , Donghyun Kim , Samarth Mishra , Kate Saenko , Kuniaki Saito , Piotr Teterwak , Ben Usman

Top-performing deep architectures are trained on massive amounts of labeled data. In the absence of labeled data for a certain task, domain adaptation often provides an attractive option given that labeled data of similar nature but from a…

Machine Learning · Statistics 2015-03-02 Yaroslav Ganin , Victor Lempitsky

Recent developments in deep domain adaptation have allowed knowledge transfer from a labeled source domain to an unlabeled target domain at the level of intermediate features or input pixels. We propose that advantages may be derived by…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Luan Tran , Kihyuk Sohn , Xiang Yu , Xiaoming Liu , Manmohan Chandraker

Existing Source-free Unsupervised Domain Adaptation (SUDA) approaches inherently exhibit catastrophic forgetting. Typically, models trained on a labeled source domain and adapted to unlabeled target data improve performance on the target…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Waqar Ahmed , Pietro Morerio , Vittorio Murino

Domain Adaptation is a technique to address the lack of massive amounts of labeled data in unseen environments. Unsupervised domain adaptation is proposed to adapt a model to new modalities using solely labeled source data and unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Thong Vo , Naimul Khan

Domain Adaptation (DA), the process of effectively adapting task models learned on one domain, the source, to other related but distinct domains, the targets, with no or minimal retraining, is typically accomplished using the process of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Behnam Gholami , Pritish Sahu , Minyoung Kim , Vladimir Pavlovic

Deep learning has achieved great success in the challenging circuit annotation task by employing Convolutional Neural Networks (CNN) for the segmentation of circuit structures. The deep learning approaches require a large amount of manually…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Yee-Yang Tee , Deruo Cheng , Chye-Soon Chee , Tong Lin , Yiqiong Shi , Bah-Hwee Gwee

In this paper, we aim to adapt a model at test-time using a few unlabeled data to address distribution shifts. To tackle the challenges of extracting domain knowledge from a limited amount of data, it is crucial to utilize correlated…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Zhixiang Chi , Li Gu , Tao Zhong , Huan Liu , Yuanhao Yu , Konstantinos N Plataniotis , Yang Wang

Unsupervised domain adaptation aims to transfer knowledge from a fully-labeled source domain to an unlabeled target domain. However, in real-world scenarios, providing abundant labeled data even in the source domain can be infeasible due to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Yizhe Xiong , Hui Chen , Zijia Lin , Sicheng Zhao , Guiguang Ding