English
Related papers

Related papers: TVT: Transferable Vision Transformer for Unsupervi…

200 papers

Unsupervised domain adaptation (UDA) aims to transfer knowledge learned from a labeled source domain to a different unlabeled target domain. Most existing UDA methods focus on learning domain-invariant feature representation, either from…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Tongkun Xu , Weihua Chen , Pichao Wang , Fan Wang , Hao Li , Rong Jin

The accuracy of deep learning (e.g., convolutional neural networks) for an image classification task critically relies on the amount of labeled training data. Aiming to solve an image classification task on a new domain that lacks labeled…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Xianghong Fang , Haoli Bai , Ziyi Guo , Bin Shen , Steven Hoi , Zenglin Xu

Unsupervised Domain Adaptation (UDA) refers to the problem of learning a model in a target domain where labeled data are not available by leveraging information from annotated data in a source domain. Most deep UDA approaches operate in a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Massimiliano Mancini , Lorenzo Porzi , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

Unsupervised domain adaptation (UDA) is the task of modifying a statistical model trained on labeled data from a source domain to achieve better performance on data from a target domain, with access to only unlabeled data in the target…

Computation and Language · Computer Science 2023-04-06 Timothy A Miller

Vision Transformers (ViTs) have revolutionized computer vision by leveraging self-attention to model long-range dependencies. However, ViTs face challenges such as high computational costs due to the quadratic scaling of self-attention and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Zhoujie Qian

Conventional unsupervised domain adaptation (UDA) studies the knowledge transfer between a limited number of domains. This neglects the more practical scenario where data are distributed in numerous different domains in the real world. The…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Xingchao Peng , Yichen Li , Kate Saenko

Domain Adaptation (DA) aims to leverage the knowledge learned from a source domain with ample labeled data to a target domain with unlabeled data only. Most existing studies on DA contribute to learning domain-invariant feature…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Xiyu Wang , Pengxin Guo , Yu Zhang

Vision Transformers (ViTs) have become prominent models for solving various vision tasks. However, the interpretability of ViTs has not kept pace with their promising performance. While there has been a surge of interest in developing {\it…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Yao Qiang , Chengyin Li , Prashant Khanduri , Dongxiao Zhu

Unsupervised domain adaptation (UDA) is an important topic in the computer vision community. The key difficulty lies in defining a common property between the source and target domains so that the source-domain features can align with the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Xinyue Huo , Lingxi Xie , Hengtong Hu , Wengang Zhou , Houqiang Li , Qi Tian

Vision Transformer (ViT) has shown its advantages over the convolutional neural network (CNN) with its ability to capture global long-range dependencies for visual representation learning. Besides ViT, contrastive learning is another…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Hua-Bao Ling , Bowen Zhu , Dong Huang , Ding-Hua Chen , Chang-Dong Wang , Jian-Huang Lai

In this work, we tackle the problem of unsupervised domain adaptation (UDA) for video action recognition. Our approach, which we call UNITE, uses an image teacher model to adapt a video student model to the target domain. UNITE first…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Arun Reddy , William Paul , Corban Rivera , Ketul Shah , Celso M. de Melo , Rama Chellappa

Vision Transformers (ViTs) have gained significant popularity in recent years and have proliferated into many applications. However, their behavior under different learning paradigms is not well explored. We compare ViTs trained through…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Matthew Walmer , Saksham Suri , Kamal Gupta , Abhinav Shrivastava

Although transformer networks are recently employed in various vision tasks with outperforming performance, extensive training data and a lengthy training time are required to train a model to disregard an inductive bias. Using trainable…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Heegon Jin , Jongwon Choi

Unsupervised domain adaptation (UDA) aims to learn the unlabeled target domain by transferring the knowledge of the labeled source domain. To date, most of the existing works focus on the scenario of one source domain and one target domain…

Machine Learning · Computer Science 2018-09-18 Huanhuan Yu , Menglei Hu , Songcan Chen

Vision Transformers, ViTs, have emerged as a powerful alternative to convolutional neural networks, CNNs, in a variety of image-based tasks. While CNNs have previously been evaluated for their ability to perform graphical perception tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Poonam Poonam , Pere-Pau Vázquez , Timo Ropinski

Vision Transformers (ViTs) are becoming more popular and dominating technique for various vision tasks, compare to Convolutional Neural Networks (CNNs). As a demanding technique in computer vision, ViTs have been successfully solved various…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Khawar Islam

The groundbreaking performance of transformers in Natural Language Processing (NLP) tasks has led to their replacement of traditional Convolutional Neural Networks (CNNs), owing to the efficiency and accuracy achieved through the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Gousia Habib , Damandeep Singh , Ishfaq Ahmad Malik , Brejesh Lall

Unsupervised domain adaptation aims to transfer knowledge from a fully-labeled source domain to an unlabeled target domain. However, in real-world scenarios, providing abundant labeled data even in the source domain can be infeasible due to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Yizhe Xiong , Hui Chen , Zijia Lin , Sicheng Zhao , Guiguang Ding

Unsupervised Domain Adaptation (UDA) aims to transfer the knowledge from the labeled source domain to the unlabeled target domain in the presence of dataset shift. Most existing methods cannot address the domain alignment and class…

Machine Learning · Computer Science 2021-12-22 You-Wei Luo , Chuan-Xian Ren , Zi-Ying Chen

Unsupervised Domain Adaptation (UDA) aims to leverage a label-rich source domain to solve tasks on a related unlabeled target domain. It is a challenging problem especially when a large domain gap lies between the source and target domains.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Tao Sun , Cheng Lu , Tianshuo Zhang , Haibin Ling