English
Related papers

Related papers: CTA: Cross-Task Alignment for Better Test Time Tra…

200 papers

Previous works on depression detection use datasets collected in similar environments to train and test the models. In practice, however, the train and test distributions cannot be guaranteed to be identical. Distribution shifts can be…

Machine Learning · Computer Science 2024-04-09 Sri Harsha Dumpala , Chandramouli Shama Sastry , Rudolf Uher , Sageev Oore

Although recent years have witnessed significant advancements in medical image segmentation, the pervasive issue of domain shift among medical images from diverse centres hinders the effective deployment of pre-trained models. Many…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Ziyang Chen , Yiwen Ye , Yongsheng Pan , Yong Xia

Currently, pre-trained language models (PLMs) do not cope well with the distribution shift problem, resulting in models trained on the training set failing in real test scenarios. To address this problem, the test-time adaptation (TTA)…

Computation and Language · Computer Science 2023-04-26 Yi Su , Yixin Ji , Juntao Li , Hai Ye , Min Zhang

Test-time adaptation (TTA) is a technique aimed at enhancing the generalization performance of models by leveraging unlabeled samples solely during prediction. Given the need for robustness in neural network systems when faced with…

Machine Learning · Computer Science 2023-07-07 Yongcan Yu , Lijun Sheng , Ran He , Jian Liang

Test-time adaptation (TTA) refers to adapting neural networks to distribution shifts, with access to only the unlabeled test samples from the new domain at test-time. Prior TTA methods optimize over unsupervised objectives such as the…

Machine Learning · Computer Science 2022-11-24 Sachin Goyal , Mingjie Sun , Aditi Raghunathan , Zico Kolter

We present Point-TTA, a novel test-time adaptation framework for point cloud registration (PCR) that improves the generalization and the performance of registration models. While learning-based approaches have achieved impressive progress,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Ahmed Hatem , Yiming Qian , Yang Wang

Continual Test-Time Adaptation (CTTA) aims to empower perception systems to handle dynamic distribution shifts encountered after deployment. Existing methods predominantly follow a backward-alignment paradigm, which rigidly aligns incoming…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zhilin Zhu , Yabin Wang , Zhiheng Ma , Yaguang Song , Yaowei Wang , Xiaopeng Hong

In this work, we propose a novel complementary learning approach to enhance test-time adaptation (TTA), which has been proven to exhibit good performance on testing data with distribution shifts such as corruptions. In test-time adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Jiayi Han , Longbin Zeng , Liang Du , Weiyang Ding , Jianfeng Feng

This paper introduces a novel application of Test-Time Training (TTT) for Speech Enhancement, addressing the challenges posed by unpredictable noise conditions and domain shifts. This method combines a main speech enhancement task with a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-21 Avishkar Behera , Riya Ann Easow , Venkatesh Parvathala , K. Sri Rama Murty

Deploying models on target domain data subject to distribution shift requires adaptation. Test-time training (TTT) emerges as a solution to this adaptation under a realistic scenario where access to full source domain data is not available…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Yongyi Su , Xun Xu , Kui Jia

Since distribution shifts are likely to occur during test-time and can drastically decrease the model's performance, online test-time adaptation (TTA) continues to update the model after deployment, leveraging the current test data.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Robert A. Marsden , Mario Döbler , Bin Yang

In natural language processing tasks, pure reinforcement learning (RL) fine-tuning methods often suffer from inefficient exploration and slow convergence; while supervised fine-tuning (SFT) methods, although efficient in training, have…

Computation and Language · Computer Science 2025-09-17 Min Zeng , Jingfei Sun , Xueyou Luo , Caiquan Liu , Shiqi Zhang , Li Xie , Xiaoxin Chen

Deploying models on target domain data subject to distribution shift requires adaptation. Test-time training (TTT) emerges as a solution to this adaptation under a realistic scenario where access to full source domain data is not available,…

Machine Learning · Computer Science 2023-03-21 Yongyi Su , Xun Xu , Tianrui Li , Kui Jia

Multi-Task Learning (MTL) involves the concurrent training of multiple tasks, offering notable advantages for dense prediction tasks in computer vision. MTL not only reduces training and inference time as opposed to having multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Maxime Fontana , Michael Spratling , Miaojing Shi

Continual Test-Time Adaptation (CTTA) is an emerging and challenging task where a model trained in a source domain must adapt to continuously changing conditions during testing, without access to the original source data. CTTA is prone to…

Machine Learning · Computer Science 2024-05-29 Ziqi Shi , Fan Lyu , Ye Liu , Fanhua Shang , Fuyuan Hu , Wei Feng , Zhang Zhang , Liang Wang

Deep learning models perform poorly when domain shifts exist between training and test data. Test-time adaptation (TTA) is a paradigm to mitigate this issue by adapting pre-trained models using only unlabeled test samples. However, existing…

Machine Learning · Computer Science 2025-05-27 Taeckyung Lee , Sorn Chottananurak , Junsu Kim , Jinwoo Shin , Taesik Gong , Sung-Ju Lee

Current test-time adaptation (TTA) approaches aim to adapt a machine learning model to environments that change continuously. Yet, it is unclear whether TTA methods can maintain their adaptability over prolonged periods. To answer this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Trung-Hieu Hoang , Duc Minh Vo , Minh N. Do

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and testing data by adapting a given model w.r.t. any testing sample. This task is particularly important for deep models when the test environment…

Machine Learning · Computer Science 2022-06-01 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Shijian Zheng , Peilin Zhao , Mingkui Tan

Test-time adaptation (TTA) aims to adapt a pretrained model to distribution shifts using only unlabeled test data. While promising, existing methods like Tent suffer from instability and can catastrophically forget the source knowledge,…

Machine Learning · Computer Science 2025-10-08 Harshil Vejendla

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges:…

Machine Learning · Computer Science 2025-08-27 Mingkui Tan , Guohao Chen , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Peilin Zhao , Shuaicheng Niu