English
Related papers

Related papers: Patch-Mix Transformer for Unsupervised Domain Adap…

200 papers

Unsupervised domain adaptation is a promising technique for semantic segmentation and other computer vision tasks for which large-scale data annotation is costly and time-consuming. In semantic segmentation, it is attractive to train models…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Luke Melas-Kyriazi , Arjun K. Manrai

Vision Transformer (ViT) has recently demonstrated promise in computer vision problems. However, unlike Convolutional Neural Networks (CNN), it is known that the performance of ViT saturates quickly with depth increasing, due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Peihao Wang , Wenqing Zheng , Tianlong Chen , Zhangyang Wang

Domain Adaptation (DA) aims to leverage the knowledge learned from a source domain with ample labeled data to a target domain with unlabeled data only. Most existing studies on DA contribute to learning domain-invariant feature…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Xiyu Wang , Pengxin Guo , Yu Zhang

We study the problem of unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain. Recently, the cluster assumption has been applied to unsupervised domain…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Xudong Mao , Yun Ma , Zhenguo Yang , Yangbin Chen , Qing Li

Domain shift is a common problem in clinical applications, where the training images (source domain) and the test images (target domain) are under different distributions. Unsupervised Domain Adaptation (UDA) techniques have been proposed…

Image and Video Processing · Electrical Eng. & Systems 2023-09-06 Jiajin Zhang , Hanqing Chao , Amit Dhurandhar , Pin-Yu Chen , Ali Tajer , Yangyang Xu , Pingkun Yan

Unsupervised domain adaptation (UDA) conventionally assumes labeled source samples coming from a single underlying source distribution. Whereas in practical scenario, labeled data are typically collected from diverse sources. The multiple…

Machine Learning · Computer Science 2018-03-05 Ruijia Xu , Ziliang Chen , Wangmeng Zuo , Junjie Yan , Liang Lin

Unsupervised domain adaptation (UDA) transfers knowledge from a label-rich source domain to a fully-unlabeled target domain. To tackle this task, recent approaches resort to discriminative domain transfer in virtue of pseudo-labels to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Chaoqi Chen , Weiping Xie , Wenbing Huang , Yu Rong , Xinghao Ding , Yue Huang , Tingyang Xu , Junzhou Huang

Unsupervised domain adaptation (UDA) addresses the problem of distribution shift between the unlabelled target domain and labelled source domain. While the single target domain adaptation (STDA) is well studied in the literature for both 2D…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Ashish Sinha , Jonghyun Choi

Recently, despite the unprecedented success of large pre-trained visual-language models (VLMs) on a wide range of downstream tasks, the real-world unsupervised domain adaptation (UDA) problem is still not well explored. Therefore, in this…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Shuanghao Bai , Min Zhang , Wanqi Zhou , Siteng Huang , Zhirong Luan , Donglin Wang , Badong Chen

Semantic segmentation models based on convolutional neural networks have recently displayed remarkable performance for a multitude of applications. However, these models typically do not generalize well when applied on new domains,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Wilhelm Tranheden , Viktor Olsson , Juliano Pinto , Lennart Svensson

In this work, we explore the usage of the Frequency Transformation for reducing the domain shift between the source and target domain (e.g., synthetic image and real image respectively) towards solving the Domain Adaptation task. Most of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vikash Kumar , Himanshu Patil , Rohit Lal , Anirban Chakraborty

This paper proposes a novel approach for unsupervised domain adaptation (UDA) with target shift. Target shift is a problem of mismatch in label distribution between source and target domains. Typically it appears as class-imbalance in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-28 Ryuhei Takahashi , Atsushi Hashimoto , Motoharu Sonogashira , Masaaki Iiyama

The recently proposed data augmentation TransMix employs attention labels to help visual transformers (ViT) achieve better robustness and performance. However, TransMix is deficient in two aspects: 1) The image cropping method of TransMix…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Qihao Zhao , Yangyu Huang , Wei Hu , Fan Zhang , Jun Liu

Deep learning models tend to underperform in the presence of domain shifts. Domain transfer has recently emerged as a promising approach wherein images exhibiting a domain shift are transformed into other domains for augmentation or…

Image and Video Processing · Electrical Eng. & Systems 2022-10-27 Weinan Song , Gaurav Fotedar , Nima Tajbakhsh , Ziheng Zhou , Lei He , Xiaowei Ding

A foundational requirement of a deployed ML model is to generalize to data drawn from a testing distribution that is different from training. A popular solution to this problem is to adapt a pre-trained model to novel domains using only…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Kowshik Thopalli , Pavan Turaga , Jayaraman J. Thiagarajan

Mixup-based augmentation has been found to be effective for generalizing models during training, especially for Vision Transformers (ViTs) since they can easily overfit. However, previous mixup-based methods have an underlying prior…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Jie-Neng Chen , Shuyang Sun , Ju He , Philip Torr , Alan Yuille , Song Bai

The computer vision community is witnessing an unprecedented rate of new tasks being proposed and addressed, thanks to the deep convolutional networks' capability to find complex mappings from X to Y. The advent of each task often…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Junnan Li , Ziwei Xu , Yongkang Wong , Qi Zhao , Mohan Kankanhalli

Unsupervised Domain Adaptation (UDA) seeks to transfer knowledge from a labeled source domain to an unlabeled target domain but often suffers from severe domain and scale gaps that degrade performance. Existing cross-attention-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Zelin Zang , Yehui Yang , Fei Wang , Liangyu Li , Baigui Sun

Unsupervised Domain Adaptation (UDA) has emerged as a powerful solution for the domain shift problem via transferring the knowledge from a labeled source domain to a shifted unlabeled target domain. Despite the prevalence of UDA for visual…

Machine Learning · Computer Science 2023-07-28 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee-Keong Kwoh , Xiaoli Li

Vision transformers (ViTs) have demonstrated impressive performance on a series of computer vision tasks, yet they still suffer from adversarial examples. % crafted in a similar fashion as CNNs. In this paper, we posit that adversarial…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Zhipeng Wei , Jingjing Chen , Micah Goldblum , Zuxuan Wu , Tom Goldstein , Yu-Gang Jiang