English
Related papers

Related papers: Continual-MAE: Adaptive Distribution Masked Autoen…

200 papers

Continual test-time domain adaptation (CTTA) aims to adjust models so that they can perform well over time across non-stationary environments. While previous methods have made considerable efforts to optimize the adaptation process, a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Yanshuo Wang , Jinguang Tong , Jun Lan , Weiqiang Wang , Huijia Zhu , Haoxing Chen , Xuesong Li , Jie Hong

Test-Time Adaptation (TTA) aims to mitigate distributional shifts between training and test domains during inference time. However, existing TTA methods fall short in the realistic scenario where models face both continually changing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yingkai Yang , Chaoqi Chen , Hui Huang

Masked Autoencoders (MAEs) learn generalizable representations for image, text, audio, video, etc., by reconstructing masked input data from tokens of the visible data. Current MAE approaches for videos rely on random patch, tube, or…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Wele Gedara Chaminda Bandara , Naman Patel , Ali Gholami , Mehdi Nikkhah , Motilal Agrawal , Vishal M. Patel

Unsupervised domain adaptation (UDA) aims to learn transferable knowledge from a labeled source domain and adapts a trained model to an unlabeled target domain. To bridge the gap between source and target domains, one prevailing strategy is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Xu Ma , Junkun Yuan , Yen-wei Chen , Ruofeng Tong , Lanfen Lin

Continuous Video Domain Adaptation (CVDA) is a scenario where a source model is required to adapt to a series of individually available changing target domains continuously without source data or target supervision. It has wide…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Xiyu Wang , Yuecong Xu , Jianfei Yang , Bihan Wen , Alex C. Kot

Continual Test-Time Adaptation (CTTA), which aims to adapt the pre-trained model to ever-evolving target domains, emerges as an important task for vision models. As current vision models appear to be heavily biased towards texture,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Rongyu Zhang , Aosong Cheng , Yulin Luo , Gaole Dai , Huanrui Yang , Jiaming Liu , Ran Xu , Li Du , Yuan Du , Yanbing Jiang , Shanghang Zhang

Despite recent advancements in deep learning, deep neural networks continue to suffer from performance degradation when applied to new data that differs from training data. Test-time adaptation (TTA) aims to address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanghun Jung , Jungsoo Lee , Nanhee Kim , Amirreza Shaban , Byron Boots , Jaegul Choo

Current test-time adaptation (TTA) approaches aim to adapt a machine learning model to environments that change continuously. Yet, it is unclear whether TTA methods can maintain their adaptability over prolonged periods. To answer this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Trung-Hieu Hoang , Duc Minh Vo , Minh N. Do

Recent breakthroughs in scale have enabled the emergence of powerful generative language models, and the ability to fine-tune these models on various tasks by casting them into prompts or instructions. In this landscape, the problem of…

Computation and Language · Computer Science 2025-03-04 Rheeya Uppaal , Yixuan Li , Junjie Hu

Active Domain Adaptation (ADA) aims to maximally boost model adaptation in a new target domain by actively selecting a limited number of target data to annotate.This setting neglects the more practical scenario where training data are…

Artificial Intelligence · Computer Science 2023-11-23 Wenqiao Zhang , Zheqi Lv , Hao Zhou , Jia-Wei Liu , Juncheng Li , Mengze Li , Siliang Tang , Yueting Zhuang

It is well known that the mismatch between training (source) and test (target) data distribution will significantly decrease the performance of acoustic scene classification (ASC) systems. To address this issue, domain adaptation (DA) is…

Sound · Computer Science 2021-05-24 Dongchao Yang , Helin Wang , Yuexian Zou

Vision-language models (VLMs) such as CLIP achieve strong zero-shot recognition but degrade significantly under \textit{temporally evolving distribution shifts} common in real-world scenarios (e.g., gradual illumination or seasonal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Shuang Cui , Jinglin Xu , Yi Li , Xiongxin Tang , Jiangmeng Li , Jiahuan Zhou , Fanjiang Xu , Fuchun Sun , Hui Xiong

In real-world scenarios, tabular data often suffer from distribution shifts that threaten the performance of machine learning models. Despite its prevalence and importance, handling distribution shifts in the tabular domain remains…

Machine Learning · Computer Science 2025-02-13 Changhun Kim , Taewon Kim , Seungyeon Woo , June Yong Yang , Eunho Yang

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges:…

Machine Learning · Computer Science 2025-08-27 Mingkui Tan , Guohao Chen , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Peilin Zhao , Shuaicheng Niu

Recent continual test-time adaptation (CTTA) methods adopt masked image modeling to stabilize learning under distribution shift, yet each treats its masking family $F$ as a fixed design choice and innovates exclusively along the selection…

Domain adaptation (DA) enables knowledge transfer from a labeled source domain to an unlabeled target domain by reducing the cross-domain distribution discrepancy. Most prior DA approaches leverage complicated and powerful deep neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Shuang Li , Jinming Zhang , Wenxuan Ma , Chi Harold Liu , Wei Li

Continual test-time domain adaptation (CTTA) aims to adjust pre-trained source models to perform well over time across non-stationary target environments. While previous methods have made considerable efforts to optimize the adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yanshuo Wang , Xuesong Li , Jinguang Tong , Jie Hong , Jun Lan , Weiqiang Wang , Huijia Zhu , Haoxing Chen

Understanding the internal representations of large language models is crucial for ensuring their reliability and safety, with sparse autoencoders (SAEs) emerging as a promising interpretability approach. However, current SAE training…

Machine Learning · Computer Science 2025-10-13 T. Ed Li , Junyu Ren

This paper studies continual test-time adaptation (CTTA), the task of adapting a model to constantly changing unseen domains in testing while preserving previously learned knowledge. Existing CTTA methods mostly focus on adaptation to the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Sohyun Lee , Nayeong Kim , Juwon Kang , Seong Joon Oh , Suha Kwak

Unsupervised Domain Adaptation (UDA) for semantic segmentation has been favorably applied to real-world scenarios in which pixel-level labels are hard to be obtained. In most of the existing UDA methods, all target data are assumed to be…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Joonhyuk Kim , Sahng-Min Yoo , Gyeong-Moon Park , Jong-Hwan Kim