English
Related papers

Related papers: Continual-MAE: Adaptive Distribution Masked Autoen…

200 papers

Unsupervised Domain Adaptation (UDA) aims to align the labeled source distribution with the unlabeled target distribution to obtain domain invariant predictive models. However, the application of well-known UDA approaches does not…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Ankit Singh

Learning transferable representations from unlabeled time series is crucial for improving performance in data-scarce classification. Existing self-supervised methods often operate at the point level and rely on unidirectional encoding,…

Machine Learning · Computer Science 2026-03-02 Mingyue Cheng , Xiaoyu Tao , Zhiding Liu , Qi Liu , Hao Zhang , Rujiao Zhang , Enhong Chen

Test-Time Adaptation (TTA) methods improve the robustness of deep neural networks to domain shift on a variety of tasks such as image classification or segmentation. This work explores adapting segmentation models to a single unlabelled…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Klara Janouskova , Tamir Shor , Chaim Baskin , Jiri Matas

One fascinating aspect of pre-trained Audio-Language Models (ALMs) learning is their impressive zero-shot generalization capability and test-time adaptation (TTA) methods aiming to improve domain performance without annotations. However,…

Sound · Computer Science 2024-12-24 Gongyu Chen , Haomin Zhang , Chaofan Ding , Zihao Chen , Xinhan Di

A foundational requirement of a deployed ML model is to generalize to data drawn from a testing distribution that is different from training. A popular solution to this problem is to adapt a pre-trained model to novel domains using only…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Kowshik Thopalli , Pavan Turaga , Jayaraman J. Thiagarajan

Deep Learning-based end-to-end Automatic Speech Recognition (ASR) has made significant strides but still struggles with performance on out-of-domain samples due to domain shifts in real-world scenarios. Test-Time Adaptation (TTA) methods…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-04 Guan-Ting Lin , Wei-Ping Huang , Hung-yi Lee

Self-training is an important class of unsupervised domain adaptation (UDA) approaches that are used to mitigate the problem of domain shift, when applying knowledge learned from a labeled source domain to unlabeled and heterogeneous target…

Image and Video Processing · Electrical Eng. & Systems 2023-05-25 Xiaofeng Liu , Jerry L. Prince , Fangxu Xing , Jiachen Zhuo , Reese Timothy , Maureen Stone , Georges El Fakhri , Jonghye Woo

Test-time adaptation (TTA) aims to adapt a pretrained model to distribution shifts using only unlabeled test data. While promising, existing methods like Tent suffer from instability and can catastrophically forget the source knowledge,…

Machine Learning · Computer Science 2025-10-08 Harshil Vejendla

Test-time adaptation with pre-trained vision-language models has attracted increasing attention for tackling distribution shifts during the test time. Though prior studies have achieved very promising performance, they involve intensive…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Adilbek Karmanov , Dayan Guan , Shijian Lu , Abdulmotaleb El Saddik , Eric Xing

Anomaly detection is a well-known task that involves the identification of abnormal events that occur relatively infrequently. Methods for improving anomaly detection performance have been widely studied. However, no studies utilizing…

Machine Learning · Computer Science 2025-02-10 Seffi Cohen , Niv Goldshlager , Lior Rokach , Bracha Shapira

Recently, test-time adaptation (TTA) has been proposed as a promising solution for addressing distribution shifts. It allows a base model to adapt to an unforeseen distribution during inference by leveraging the information from the batch…

Machine Learning · Computer Science 2023-02-07 Tong Wu , Feiran Jia , Xiangyu Qi , Jiachen T. Wang , Vikash Sehwag , Saeed Mahloujifar , Prateek Mittal

Test-Time Adaptation (TTA) addresses domain shifts between training and testing. However, existing methods assume a homogeneous target domain (e.g., single domain) at any given time. They fail to handle the dynamic nature of real-world…

Machine Learning · Computer Science 2025-12-25 Chuyang Ye , Dongyan Wei , Zhendong Liu , Yuanyi Pang , Yixi Lin , Qinting Jiang , Jingyan Jiang , Dongbiao He

In this work, we explore the usage of the Frequency Transformation for reducing the domain shift between the source and target domain (e.g., synthetic image and real image respectively) towards solving the Domain Adaptation task. Most of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vikash Kumar , Himanshu Patil , Rohit Lal , Anirban Chakraborty

Conventional domain adaptation typically transfers knowledge from a source domain to a stationary target domain. However, in many real-world cases, target data usually emerge sequentially and have continuously evolving distributions.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Gangming Zhao , Chaoqi Chen , Wenhao He , Chengwei Pan , Chaowei Fang , Jinpeng Li , Xilin Chen , Yizhou Yu

Domain adaptation (DA) is transfer learning which aims to learn an effective predictor on target data from source data despite data distribution mismatch between source and target. We present in this paper a novel unsupervised DA method for…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 Lingkun Luo , Liming Chen , Ying lu , Shiqiang Hu

Deep learning models perform poorly when domain shifts exist between training and test data. Test-time adaptation (TTA) is a paradigm to mitigate this issue by adapting pre-trained models using only unlabeled test samples. However, existing…

Machine Learning · Computer Science 2025-05-27 Taeckyung Lee , Sorn Chottananurak , Junsu Kim , Jinwoo Shin , Taesik Gong , Sung-Ju Lee

Multimodal 3D vision-language models show strong generalization across diverse 3D tasks, but their performance still degrades notably under domain shifts. This has motivated recent studies on test-time adaptation (TTA), which enables models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xingyu Zhu , Liang Yi , Shuo Wang , Wenbo Zhu , Yonglinag Wu , Beier Zhu , Hanwang Zhang

The success of automated medical image analysis depends on large-scale and expert-annotated training sets. Unsupervised domain adaptation (UDA) has been raised as a promising approach to alleviate the burden of labeled data collection.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Jianan Fan , Dongnan Liu , Hang Chang , Heng Huang , Mei Chen , Weidong Cai

This paper presents a simple yet effective approach that improves continual test-time adaptation (TTA) in a memory-efficient manner. TTA may primarily be conducted on edge devices with limited memory, so reducing memory is crucial but has…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Junha Song , Jungsoo Lee , In So Kweon , Sungha Choi

Domain adaptation (DA) aims to generalize a learning model across training and testing data despite the mismatch of their data distributions. In light of a theoretical estimation of upper error bound, we argue in this paper that an…

Computer Vision and Pattern Recognition · Computer Science 2018-01-01 Lingkun Luo , Liming Chen , Shiqiang Hu , Ying Lu , Xiaofang Wang