English
Related papers

Related papers: Continual-MAE: Adaptive Distribution Masked Autoen…

200 papers

Continual Test-Time Adaptation (CTA) is a challenging task that aims to adapt a source pre-trained model to continually changing target domains. In the CTA setting, a model does not know when the target domain changes, thus facing a drastic…

Machine Learning · Computer Science 2024-03-05 Inseop Chung , Kyomin Hwang , Jayeon Yoo , Nojun Kwak

Given a model trained on source data, Test-Time Adaptation (TTA) enables adaptation and inference in test data streams with domain shifts from the source. Current methods predominantly optimize the model for each incoming test data batch…

Machine Learning · Computer Science 2024-07-18 Ziqiang Wang , Zhixiang Chi , Yanan Wu , Li Gu , Zhi Liu , Konstantinos Plataniotis , Yang Wang

Continual Test-Time Adaptation (CTTA) aims to empower perception systems to handle dynamic distribution shifts encountered after deployment. Existing methods predominantly follow a backward-alignment paradigm, which rigidly aligns incoming…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zhilin Zhu , Yabin Wang , Zhiheng Ma , Yaguang Song , Yaowei Wang , Xiaopeng Hong

The objective of Continual Test-time Domain Adaptation (CTDA) is to gradually adapt a pre-trained model to a sequence of target domains without accessing the source data. This paper proposes a Dynamic Sample Selection (DSS) method for CTDA.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Yanshuo Wang , Jie Hong , Ali Cheraghian , Shafin Rahman , David Ahmedt-Aristizabal , Lars Petersson , Mehrtash Harandi

Test-time adaptation (TTA) is a technique used to reduce distribution gaps between the training and testing sets by leveraging unlabeled test data during inference. In this work, we expand TTA to a more practical scenario, where the test…

Machine Learning · Computer Science 2023-03-06 Chenyan Wu , Yimu Pan , Yandong Li , James Z. Wang

Speech emotion recognition (SER) with audio-language models (ALMs) remains vulnerable to distribution shifts at test time, leading to performance degradation in out-of-domain scenarios. Test-time adaptation (TTA) provides a promising…

Sound · Computer Science 2026-02-05 Jiacheng Shi , Hongfei Du , Y. Alicia Hong , Ye Gao

Deep neural networks often suffer performance degradation upon deployment due to distribution shifts. Continual Test-Time Adaptation (CTTA) aims to address this issue in an unsupervised manner. However, existing methods that rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Xiao Chen , Jiazhen Huang , Zhiming Liu , Qinting Jiang , Fanding Huang , Jingyan Jiang , Zhi Wang

Prior to the deployment of robotic systems, pre-training the deep-recognition models on all potential visual cases is infeasible in practice. Hence, test-time adaptation (TTA) allows the model to adapt itself to novel environments and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Junha Song , Kwanyong Park , InKyu Shin , Sanghyun Woo , Chaoning Zhang , In So Kweon

Test-time Adaptation (TTA) poses a challenge, requiring models to dynamically adapt and perform optimally on shifting target domains. This task is particularly emphasized in real-world driving scenes, where weather domain shifts occur…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Dongjae Jeon , Taeheon Kim , Seongwon Cho , Minhyuk Seo , Jonghyun Choi

Multimodal sentiment analysis (MSA) is an emerging research topic that aims to understand and recognize human sentiment or emotions through multiple modalities. However, in real-world dynamic scenarios, the distribution of target data is…

Machine Learning · Computer Science 2025-02-11 Zirun Guo , Tao Jin , Wenlong Xu , Wang Lin , Yangyang Wu

Continual Test-Time Adaptation (CTTA) task investigates effective domain adaptation under the scenario of continuous domain shifts during testing time. Due to the utilization of solely unlabeled samples, there exists significant uncertainty…

Machine Learning · Computer Science 2025-12-18 Fan Lyu , Kaile Du , Yuyang Li , Hanyu Zhao , Fuyuan Hu , Zhang Zhang , Guangcan Liu , Liang Wang

Domain shift is a common problem in the realistic world, where training data and test data follow different data distributions. To deal with this problem, fully test-time adaptation (TTA) leverages the unlabeled data encountered during test…

Artificial Intelligence · Computer Science 2024-04-29 Guoliang Lin , Hanjiang Lai , Yan Pan , Jian Yin

Test-time adaptation (TTA) aims to adapt a pre-trained model to the target domain in a batch-by-batch manner during inference. While label distributions often exhibit imbalances in real-world scenarios, most previous TTA approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sunghyun Park , Seunghan Yang , Jaegul Choo , Sungrack Yun

Test-time adaptation (TTA) is an effective approach to mitigate performance degradation of trained models when encountering input distribution shifts at test time. However, existing TTA methods often suffer significant performance drops…

Machine Learning · Computer Science 2025-02-06 Minguk Jang , Hye Won Chung

Continual Test-Time Adaptation (CTTA) is crucial for deploying models in real-world applications with unseen, evolving target domains. Existing CTTA methods, however, often rely on source data or prototypes, limiting their applicability in…

Test-time adaptation (TTA) has emerged as a viable solution to adapt pre-trained models to domain shifts using unlabeled test data. However, TTA faces challenges of adaptation failures due to its reliance on blind adaptation to unknown test…

Machine Learning · Computer Science 2024-04-03 Taeckyung Lee , Sorn Chottananurak , Taesik Gong , Sung-Ju Lee

Test-time adaptation (TTA) aims to adapt a model, initially trained on training data, to test data with potential distribution shifts. Most existing TTA methods focus on classification problems. The pronounced success of classification…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Chang'an Yi , Haotian Chen , Yifan Zhang , Yonghui Xu , Yan Zhou , Lizhen Cui

Masked Autoencoders (MAE) achieve self-supervised learning of image representations by randomly removing a portion of visual tokens and reconstructing the original image as a pretext task, thereby significantly enhancing pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Jiaxuan Li , Qing Xu , Xiangjian He , Ziyu Liu , Chang Xing , Zhen Chen , Daokun Zhang , Rong Qu , Chang Wen Chen

Multivariate time-series anomaly detection (MTSAD) aims to identify deviations from normality in multivariate time-series and is critical in real-world applications. However, in real-world deployments, distribution shifts are ubiquitous and…

Machine Learning · Computer Science 2026-04-03 HyunGi Kim , Jisoo Mok , Hyungyu Lee , Juhyeon Shin , Sungroh Yoon

Test-Time Adaptation (TTA) enables pre-trained models to bridge the gap between source and target datasets using unlabeled test data, addressing domain shifts caused by corruptions like weather changes, noise, or sensor malfunctions in test…

Machine Learning · Computer Science 2025-07-29 Yufei Zhang , Yicheng Xu , Hongxin Wei , Zhiping Lin , Xiaofeng Zou , Cen Chen , Huiping Zhuang