English
Related papers

Related papers: Audio-Visual Continual Test-Time Adaptation withou…

200 papers

Test-time adaptation (TTA) is an emerging paradigm that addresses distributional shifts between training and testing phases without additional data acquisition or labeling cost; only unlabeled test data streams are used for continual model…

Machine Learning · Computer Science 2023-01-12 Taesik Gong , Jongheon Jeong , Taewon Kim , Yewon Kim , Jinwoo Shin , Sung-Ju Lee

Convolutional Neural Networks (ConvNets) are trained offline using the few available data and may therefore suffer from substantial accuracy loss when ported on the field, where unseen input patterns received under unpredictable external…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Luca Mocerino , Roberto G. Rizzo , Valentino Peluso , Andrea Calimera , Enrico Macii

Audio-visual zero-shot learning aims to classify samples consisting of a pair of corresponding audio and video sequences from classes that are not present during training. An analysis of the audio-visual data reveals a large degree of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Jie Hong , Zeeshan Hayder , Junlin Han , Pengfei Fang , Mehrtash Harandi , Lars Petersson

Fully test-time adaptation aims at adapting a pre-trained model to the test stream during real-time inference, which is urgently required when the test distribution differs from the training distribution. Several efforts have been devoted…

Machine Learning · Computer Science 2023-01-31 Bowen Zhao , Chen Chen , Shu-Tao Xia

Adapter-based parameter-efficient transfer learning has achieved exciting results in vision-language models. Traditional adapter methods often require training or fine-tuning, facing challenges such as insufficient samples or resource…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Juncheng Yang , Zuchao Li , Shuai Xie , Weiping Zhu , Wei Yu , Shijun Li

Most unsupervised domain adaptation (UDA) methods assume that labeled source images are available during model adaptation. However, this assumption is often infeasible owing to confidentiality issues or memory constraints on mobile devices.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 JoonHo Lee , Gyemin Lee

When continual test-time adaptation (TTA) persists over the long term, errors accumulate in the model and further cause it to predict only a few classes for all inputs, a phenomenon known as model collapse. Recent studies have explored…

Machine Learning · Computer Science 2026-03-05 Taejun Lim , Joong-Won Hwang , Kibok Lee

Test-Time Adaptation (TTA) enhances model robustness to out-of-distribution (OOD) data by updating the model online during inference, yet existing methods lack theoretical insights into the fundamental causes of performance degradation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Xiao Chen , Zhongjing Du , Jiazhen Huang , Xu Jiang , Li Lu , Jingyan Jiang , Zhi Wang

Despite progress in end-to-end ASR, real-world domain mismatches still cause performance drops, which Test-Time Adaptation (TTA) aims to mitigate by adjusting models during inference. Recent work explores combining TTA with external…

Computation and Language · Computer Science 2025-06-16 Wei-Ping Huang , Guan-Ting Lin , Hung-yi Lee

Deep classifiers may encounter significant performance degradation when processing unseen testing data from varying centers, vendors, and protocols. Ensuring the robustness of deep models against these domain shifts is crucial for their…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yuhao Huang , Xin Yang , Xiaoqiong Huang , Xinrui Zhou , Haozhe Chi , Haoran Dou , Xindi Hu , Jian Wang , Xuedong Deng , Dong Ni

Test-time adaptation (TTA) aims to mitigate performance degradation under distribution shifts by updating model parameters during inference. Existing approaches have primarily framed adaptation around affine modulation, focusing on…

Machine Learning · Computer Science 2026-03-30 Hyeongyu Kim , Geonhui Han , Dosik Hwang

End-to-end acoustic speech recognition has quickly gained widespread popularity and shows promising results in many studies. Specifically the joint transformer/CTC model provides very good performance in many tasks. However, under noisy and…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-20 Wentao Yu , Steffen Zeiler , Dorothea Kolossa

Catastrophic forgetting makes neural network models unstable when learning visual domains consecutively. The neural network model drifts to catastrophic forgetting-induced low performance of previously learnt domains when training with new…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Sayan Rakshit , Hmrishav Bandyopadhyay , Nibaran Das , Biplab Banerjee

Test-Time Adaptation (TTA) has emerged as a crucial solution to the domain shift challenge, wherein the target environment diverges from the original training environment. A prime exemplification is TTA for Automatic Speech Recognition…

Computation and Language · Computer Science 2024-08-13 Eunseop Yoon , Hee Suk Yoon , John Harvill , Mark Hasegawa-Johnson , Chang D. Yoo

Online continual learning (CL) aims to learn new knowledge and consolidate previously learned knowledge from non-stationary data streams. Due to the time-varying training setting, the model learned from a changing distribution easily…

Machine Learning · Computer Science 2023-08-15 Quanziang Wang , Renzhen Wang , Yichen Wu , Xixi Jia , Deyu Meng

In recent advancements in Test Time Adaptation (TTA), most existing methodologies focus on updating normalization layers to adapt to the test domain. However, the reliance on normalization-based adaptation presents key challenges. First,…

Machine Learning · Computer Science 2026-03-24 Hyeongyu Kim , Geonhui Han , Dosik Hwang

While vision-and-language models significantly advance in many fields, the challenge of continual learning is unsolved. Parameter-efficient modules like adapters and prompts present a promising way to alleviate catastrophic forgetting.…

Machine Learning · Computer Science 2024-10-16 Hong Li , Zhiquan Tan , Xingyu Li , Weiran Huang

Test-time adaptation (TTA) is a technique aimed at enhancing the generalization performance of models by leveraging unlabeled samples solely during prediction. Given the need for robustness in neural network systems when faced with…

Machine Learning · Computer Science 2023-07-07 Yongcan Yu , Lijun Sheng , Ran He , Jian Liang

Test-time Adaptation (TTA) aims to improve model performance when the model encounters domain changes after deployment. The standard TTA mainly considers the case where the target domain is static, while the continual TTA needs to undergo a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Xinru Meng , Han Sun , Jiamei Liu , Ningzhong Liu , Huiyu Zhou

Although action recognition systems can achieve top performance when evaluated on in-distribution test points, they are vulnerable to unanticipated distribution shifts in test data. However, test-time adaptation of video action recognition…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Wei Lin , Muhammad Jehanzeb Mirza , Mateusz Kozinski , Horst Possegger , Hilde Kuehne , Horst Bischof