English
Related papers

Related papers: Orthogonal Projection Subspace to Aggregate Online…

200 papers

Benefiting from massive corpora and advanced hardware, large language models (LLMs) exhibit remarkable capabilities in language understanding and generation. However, their performance degrades in scenarios where multiple tasks are…

Computation and Language · Computer Science 2023-10-24 Xiao Wang , Tianze Chen , Qiming Ge , Han Xia , Rong Bao , Rui Zheng , Qi Zhang , Tao Gui , Xuanjing Huang

Fully Test-Time Adaptation (TTA), which aims at adapting models to data drifts, has recently attracted wide interest. Numerous tricks and techniques have been proposed to ensure robust learning on arbitrary streams of unlabeled data.…

Machine Learning · Computer Science 2023-11-13 Saypraseuth Mounsaveng , Florent Chiaroni , Malik Boudiaf , Marco Pedersoli , Ismail Ben Ayed

Since distribution shifts are likely to occur during test-time and can drastically decrease the model's performance, online test-time adaptation (TTA) continues to update the model after deployment, leveraging the current test data.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Robert A. Marsden , Mario Döbler , Bin Yang

Real-world systems often encounter new data over time, which leads to experiencing target domain shifts. Existing Test-Time Adaptation (TTA) methods tend to apply computationally heavy and memory-intensive backpropagation-based approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Yanshuo Wang , Ali Cheraghian , Zeeshan Hayder , Jie Hong , Sameera Ramasinghe , Shafin Rahman , David Ahmedt-Aristizabal , Xuesong Li , Lars Petersson , Mehrtash Harandi

Continual Test-Time Adaptation (CTTA) task investigates effective domain adaptation under the scenario of continuous domain shifts during testing time. Due to the utilization of solely unlabeled samples, there exists significant uncertainty…

Machine Learning · Computer Science 2025-12-18 Fan Lyu , Kaile Du , Yuyang Li , Hanyu Zhao , Fuyuan Hu , Zhang Zhang , Guangcan Liu , Liang Wang

Continual Test-Time Adaptation (CTTA) is proposed to migrate a source pre-trained model to continually changing target distributions, addressing real-world dynamism. Existing CTTA methods mainly rely on entropy minimization or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jiaming Liu , Ran Xu , Senqiao Yang , Renrui Zhang , Qizhe Zhang , Zehui Chen , Yandong Guo , Shanghang Zhang

It is a well-known fact that the performance of deep learning models deteriorates when they encounter a distribution shift at test time. Test-time adaptation (TTA) algorithms have been proposed to adapt the model online while inferring test…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Jayeon Yoo , Dongkwan Lee , Inseop Chung , Donghyun Kim , Nojun Kwak

Continual Test-Time Adaptation (CTA) is a challenging task that aims to adapt a source pre-trained model to continually changing target domains. In the CTA setting, a model does not know when the target domain changes, thus facing a drastic…

Machine Learning · Computer Science 2024-03-05 Inseop Chung , Kyomin Hwang , Jayeon Yoo , Nojun Kwak

Online Test-Time Adaptation (OTTA) has emerged as an effective strategy to handle distributional shifts, allowing on-the-fly adaptation of pre-trained models to new target domains during inference, without the need for source data. We…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 WeiQin Chuah , Ruwan Tennakoon , Alireza Bab-Hadiashar

Test-Time Adaptation (TTA) aims to mitigate distributional shifts between training and test domains during inference time. However, existing TTA methods fall short in the realistic scenario where models face both continually changing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yingkai Yang , Chaoqi Chen , Hui Huang

This paper presents a simple yet effective approach that improves continual test-time adaptation (TTA) in a memory-efficient manner. TTA may primarily be conducted on edge devices with limited memory, so reducing memory is crucial but has…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Junha Song , Jungsoo Lee , In So Kweon , Sungha Choi

Continual learning methods based on pre-trained models (PTM) have recently gained attention which adapt to successive downstream tasks without catastrophic forgetting. These methods typically refrain from updating the pre-trained parameters…

Machine Learning · Computer Science 2026-05-22 Kun-Peng Ning , Hai-Jian Ke , Yu-Yang Liu , Jia-Yu Yao , Yong-Hong Tian , Li Yuan

Continual Test-Time Adaptation (CTTA) aims to adapt a source pre-trained model to continually changing target domains during inference. As a fundamental principle, an ideal CTTA method should rapidly adapt to new domains (exploration) while…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Pinci Yang , Peisong Wen , Ke Ma , Qianqian Xu

Continual Test-Time Adaptation (CTTA) aims to adapt a pretrained model to ever-changing environments during the test time under continuous domain shifts. Most existing CTTA approaches are based on the Mean Teacher (MT) structure, which…

Machine Learning · Computer Science 2024-07-03 Jiaxu Tian , Fan Lyu

Continual Test Time Adaptation (CTTA) is required to adapt efficiently to continuous unseen domains while retaining previously learned knowledge. However, despite the progress of CTTA, it is still challenging to deploy the model with…

Machine Learning · Computer Science 2024-06-04 Daeun Lee , Jaehong Yoon , Sung Ju Hwang

Test-time adaptation aims to adapt pre-trained deep neural networks using solely online unlabelled test data during inference. Although TTA has shown promise in visual applications, its potential in time series contexts remains largely…

Machine Learning · Computer Science 2025-01-06 Peiliang Gong , Mohamed Ragab , Min Wu , Zhenghua Chen , Yongyi Su , Xiaoli Li , Daoqiang Zhang

Real-world vision models in dynamic environments face rapid shifts in domain distributions, leading to decreased recognition performance. Using unlabeled test data, continuous test-time adaptation (CTTA) directly adjusts a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Sarthak Kumar Maharana , Baoming Zhang , Yunhui Guo

In this paper, we present PCoTTA, an innovative, pioneering framework for Continual Test-Time Adaptation (CoTTA) in multi-task point cloud understanding, enhancing the model's transferability towards the continually changing target domain.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Jincen Jiang , Qianyu Zhou , Yuhang Li , Xinkui Zhao , Meili Wang , Lizhuang Ma , Jian Chang , Jian Jun Zhang , Xuequan Lu

Active Test-Time Adaptation (ATTA) improves model robustness under domain shift by selectively querying human annotations at deployment, but existing methods use heuristic uncertainty measures and suffer from low data selection efficiency,…

Machine Learning · Computer Science 2025-10-01 Tingyu Shi , Fan Lyu , Shaoliang Peng

Airborne laser scanning (ALS) point cloud semantic segmentation is a fundamental task for large-scale 3D scene understanding. Fixed models deployed in real-world scenarios often suffer from performance degradation due to continuous domain…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Yuan Gao , Shaobo Xia , Sheng Nie , Cheng Wang , Xiaohuan Xi , Bisheng Yang