English
Related papers

Related papers: Patch-Mix Transformer for Unsupervised Domain Adap…

200 papers

Vision Transformers (ViTs) have shown impressive performance and have become a unified backbone for multiple vision tasks. However, both the attention mechanism and multi-layer perceptrons (MLPs) in ViTs are not sufficiently efficient due…

Machine Learning · Computer Science 2024-07-26 Haoran You , Huihong Shi , Yipin Guo , Yingyan Celine Lin

Unsupervised domain adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Owing to privacy concerns and heavy data transmission, source-free UDA, exploiting the pre-trained source models…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Yuhe Ding , Lijun Sheng , Jian Liang , Aihua Zheng , Ran He

The Visual Domain Adaptation Challenge 2021 called for unsupervised domain adaptation methods that could improve the performance of models by transferring the knowledge obtained from source datasets to out-of-distribution target datasets.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Burhan Ul Tayyab , Nicholas Chua

Unsupervised domain adaptation (UDA) amounts to assigning class labels to the unlabeled instances of a dataset from a target domain, using labeled instances of a dataset from a related source domain. In this paper, we propose to cast this…

After the great success of Vision Transformer variants (ViTs) in computer vision, it has also demonstrated great potential in domain adaptive semantic segmentation. Unfortunately, straightforwardly applying local ViTs in domain adaptive…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Runfa Chen , Yu Rong , Shangmin Guo , Jiaqi Han , Fuchun Sun , Tingyang Xu , Wenbing Huang

Multi-source domain adaptation (MDA) aims to transfer knowledge from multiple source domains to an unlabeled target domain. MDA is a challenging task due to the severe domain shift, which not only exists between target and source but also…

Machine Learning · Computer Science 2022-02-23 Ren Chuan-Xian , Liu Yong-Hui , Zhang Xi-Wen , Huang Ke-Kun

In this technical report, we present our submission to the VisDA Challenge in ECCV 2020 and we achieved one of the top-performing results on the leaderboard. Our solution is based on Structured Domain Adaptation (SDA) and Mutual…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Yixiao Ge , Shijie Yu , Dapeng Chen

Although convolutional networks have been the dominant architecture for vision tasks for many years, recent experiments have shown that Transformer-based models, most notably the Vision Transformer (ViT), may exceed their performance in…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Asher Trockman , J. Zico Kolter

Unsupervised Domain Adaptation (UDA) aims to enhance the generalization of the learned model to other domains. The domain-invariant knowledge is transferred from the model trained on labeled source domain, e.g., video game, to unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Mu Chen , Zhedong Zheng , Yi Yang , Tat-Seng Chua

Despite recent advances in semantic segmentation, an inevitable challenge is the performance degradation caused by the domain shift in real applications. Current dominant approach to solve this problem is unsupervised domain adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Weifu Fu , Qiang Nie , Jialin Li , Yuhuan Lin , Kai Wu , Jian Li , Yabiao Wang , Yong Liu , Chengjie Wang

Adapting visual object detectors to operational target domains is a challenging task, commonly achieved using unsupervised domain adaptation (UDA) methods. Recent studies have shown that when the labeled dataset comes from multiple source…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Atif Belal , Akhil Meethal , Francisco Perdigon Romero , Marco Pedersoli , Eric Granger

As emerging hardware begins to support mixed bit-width arithmetic computation, mixed-precision quantization is widely used to reduce the complexity of neural networks. However, Vision Transformers (ViTs) require complex self-attention…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Junrui Xiao , Zhikai Li , Lianwei Yang , Qingyi Gu

Unsupervised video domain adaptation (UVDA) is a practical but under-explored problem. In this paper, we propose a frustratingly easy UVDA method, called MetaTrans. Specifically, MetaTrans adopts a concise learning objective that contains…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Pengfei Wei , Yiqun Sun , Zhiqiang Xu , Yiping Ke , Lawrence B. Hsieh

Accurate segmentation is a crucial step in medical image analysis and applying supervised machine learning to segment the organs or lesions has been substantiated effective. However, it is costly to perform data annotation that provides…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yunxiang Li , Jingxiong Li , Ruilong Dan , Shuai Wang , Kai Jin , Guodong Zeng , Jun Wang , Xiangji Pan , Qianni Zhang , Huiyu Zhou , Qun Jin , Li Wang , Yaqi Wang

Unsupervised domain adaptation (UDA) aims to adapt a model of the labeled source domain to an unlabeled target domain. Existing UDA-based semantic segmentation approaches always reduce the domain shifts in pixel level, feature level, and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Qianyu Zhou , Zhengyang Feng , Qiqi Gu , Jiangmiao Pang , Guangliang Cheng , Xuequan Lu , Jianping Shi , Lizhuang Ma

Recent deep learning methods for object detection rely on a large amount of bounding box annotations. Collecting these annotations is laborious and costly, yet supervised models do not generalize well when testing on images from a different…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Han-Kai Hsu , Chun-Han Yao , Yi-Hsuan Tsai , Wei-Chih Hung , Hung-Yu Tseng , Maneesh Singh , Ming-Hsuan Yang

Learning subtle representation about object parts plays a vital role in fine-grained visual recognition (FGVR) field. The vision transformer (ViT) achieves promising results on computer vision due to its attention mechanism. Nonetheless,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yuan Zhang , Jian Cao , Ling Zhang , Xiangcheng Liu , Zhiyi Wang , Feng Ling , Weiqian Chen

Vision Transformers (ViTs) are built on the assumption of treating image patches as ``visual tokens" and learn patch-to-patch attention. The patch embedding based tokenizer has a semantic gap with respect to its counterpart, the textual…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Ryan Grainger , Thomas Paniagua , Xi Song , Naresh Cuntoor , Mun Wai Lee , Tianfu Wu

Unsupervised Domain Adaptation (UDA) transfers predictive models from a fully-labeled source domain to an unlabeled target domain. In some applications, however, it is expensive even to collect labels in the source domain, making most…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Xiangyu Yue , Zangwei Zheng , Shanghang Zhang , Yang Gao , Trevor Darrell , Kurt Keutzer , Alberto Sangiovanni Vincentelli

Unsupervised domain adaptation (UDA) aims to learn the unlabeled target domain by transferring the knowledge of the labeled source domain. To date, most of the existing works focus on the scenario of one source domain and one target domain…

Machine Learning · Computer Science 2018-09-18 Huanhuan Yu , Menglei Hu , Songcan Chen