English
Related papers

Related papers: TVT: Transferable Vision Transformer for Unsupervi…

200 papers

Unsupervised domain adaptation (UDA) aims to transfer and adapt knowledge from a labeled source domain to an unlabeled target domain. Traditionally, subspace-based methods form an important class of solutions to this problem. Despite their…

Machine Learning · Computer Science 2022-01-07 Kowshik Thopalli , Jayaraman J Thiagarajan , Rushil Anirudh , Pavan K Turaga

Since real-world machine systems are running in non-stationary environments, Continual Test-Time Adaptation (CTTA) task is proposed to adapt the pre-trained model to continually changing target domains. Recently, existing methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jiaming Liu , Senqiao Yang , Peidong Jia , Renrui Zhang , Ming Lu , Yandong Guo , Wei Xue , Shanghang Zhang

Endeavors have been recently made to leverage the vision transformer (ViT) for the challenging unsupervised domain adaptation (UDA) task. They typically adopt the cross-attention in ViT for direct domain alignment. However, as the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Jinjing Zhu , Haotian Bai , Lin Wang

Over the last few years, Unsupervised Domain Adaptation (UDA) techniques have acquired remarkable importance and popularity in computer vision. However, when compared to the extensive literature available for images, the field of videos is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Victor G. Turrisi da Costa , Giacomo Zara , Paolo Rota , Thiago Oliveira-Santos , Nicu Sebe , Vittorio Murino , Elisa Ricci

Unsupervised domain adaptation (UDA) aims to align the labelled source distribution with the unlabelled target distribution to obtain domain-invariant predictive models. Since cross-modality medical data exhibit significant intra and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Fengming Lin , Yan Xia , Michael MacRaild , Yash Deo , Haoran Dou , Qiongyao Liu , Kun Wu , Nishant Ravikumar , Alejandro F. Frangi

Unsupervised Domain Adaptation (UDA) seeks to transfer knowledge from a labeled source domain to an unlabeled target domain but often suffers from severe domain and scale gaps that degrade performance. Existing cross-attention-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Zelin Zang , Yehui Yang , Fei Wang , Liangyu Li , Baigui Sun

Unsupervised domain adaptation (UDA) is an emerging research topic in the field of machine learning and pattern recognition, which aims to help the learning of unlabeled target domain by transferring knowledge from the source domain.

Machine Learning · Computer Science 2021-12-28 Qing Tian , Yanan Zhu , Chuang Ma , Meng Cao

Since their inception, Vision Transformers (ViTs) have emerged as a compelling alternative to Convolutional Neural Networks (CNNs) across a wide spectrum of tasks. ViTs exhibit notable characteristics, including global attention, resilience…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Hanan Gani , Nada Saadi , Noor Hussein , Karthik Nandakumar

Vision Transformer (ViT), as a powerful alternative to Convolutional Neural Network (CNN), has received much attention. Recent work showed that ViTs are also vulnerable to adversarial examples like CNNs. To build robust ViTs, an intuitive…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Boxi Wu , Jindong Gu , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu

Deep learning has become the method of choice to tackle real-world problems in different domains, partly because of its ability to learn from data and achieve impressive performance on a wide range of applications. However, its success…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Xiaofeng Liu , Chaehwa Yoo , Fangxu Xing , Hyejin Oh , Georges El Fakhri , Je-Won Kang , Jonghye Woo

Standard deep learning models such as convolutional neural networks (CNNs) lack the ability of generalizing to domains which have not been seen during training. This problem is mainly due to the common but often wrong assumption of such…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Gustavo A. Vargas Hakim , David Osowiechi , Ismail Ben Ayed , Christian Desrosiers

Unsupervised domain adaptation (UDA) has been successfully applied to transfer knowledge from a labeled source domain to target domains without their labels. Recently introduced transferable prototypical networks (TPN) further addresses…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Xiaofeng Liu , Fangxu Xing , Jia You , Jun Lu , C. -C. Jay Kuo , Georges El Fakhri , Jonghye Woo

Unsupervised domain adaptation (UDA) is important for applications where large scale annotation of representative data is challenging. For semantic segmentation in particular, it helps deploy on real "target domain" data models that are…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tuan-Hung Vu , Himalaya Jain , Maxime Bucher , Matthieu Cord , Patrick Pérez

Convolutional neural networks (CNNs) have led to significant improvements in the semantic segmentation of images. When source and target datasets come from different modalities, CNN performance suffers due to domain shift. In such cases…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Serban Stan , Mohammad Rostami

Recent breakthroughs in scale have enabled the emergence of powerful generative language models, and the ability to fine-tune these models on various tasks by casting them into prompts or instructions. In this landscape, the problem of…

Computation and Language · Computer Science 2025-03-04 Rheeya Uppaal , Yixuan Li , Junjie Hu

Unsupervised Domain Adaptation (UDA) addresses the problem of performance degradation due to domain shift between training and testing sets, which is common in computer vision applications. Most existing UDA approaches are based on…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Songsong Wu , Yan Yan , Hao Tang , Jianjun Qian , Jian Zhang , Xiao-Yuan Jing

Federated domain adaptation (FDA) aims to collaboratively transfer knowledge from source clients (domains) to the related but different target client, without communicating the local data of any client. Moreover, the source clients have…

Machine Learning · Computer Science 2023-05-19 Chang'an Yi , Haotian Chen , Yonghui Xu , Yifan Zhang

Visual domain adaptation (DA) seeks to transfer trained models to unseen, unlabeled domains across distribution shift, but approaches typically focus on adapting convolutional neural network architectures initialized with supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Viraj Prabhu , Sriram Yenamandra , Aaditya Singh , Judy Hoffman

Vision Transformer (ViT) has shown high potential in video recognition, owing to its flexible design, adaptable self-attention mechanisms, and the efficacy of masked pre-training. Yet, it remains unclear how to adapt these pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Min Yang , Huan Gao , Ping Guo , Limin Wang

For computer vision, Vision Transformers (ViTs) have become one of the go-to deep net architectures. Despite being inspired by Convolutional Neural Networks (CNNs), ViTs' output remains sensitive to small spatial shifts in the input, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Renan A. Rojas-Gomez , Teck-Yian Lim , Minh N. Do , Raymond A. Yeh