中文
相关论文

相关论文: Audio-Visual Continual Test-Time Adaptation withou…

200 篇论文

Test-time adaptation (TTA) is an emerging paradigm that addresses distributional shifts between training and testing phases without additional data acquisition or labeling cost; only unlabeled test data streams are used for continual model…

机器学习 · 计算机科学 2023-01-12 Taesik Gong , Jongheon Jeong , Taewon Kim , Yewon Kim , Jinwoo Shin , Sung-Ju Lee

Convolutional Neural Networks (ConvNets) are trained offline using the few available data and may therefore suffer from substantial accuracy loss when ported on the field, where unseen input patterns received under unpredictable external…

计算机视觉与模式识别 · 计算机科学 2021-05-14 Luca Mocerino , Roberto G. Rizzo , Valentino Peluso , Andrea Calimera , Enrico Macii

Audio-visual zero-shot learning aims to classify samples consisting of a pair of corresponding audio and video sequences from classes that are not present during training. An analysis of the audio-visual data reveals a large degree of…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Jie Hong , Zeeshan Hayder , Junlin Han , Pengfei Fang , Mehrtash Harandi , Lars Petersson

Fully test-time adaptation aims at adapting a pre-trained model to the test stream during real-time inference, which is urgently required when the test distribution differs from the training distribution. Several efforts have been devoted…

机器学习 · 计算机科学 2023-01-31 Bowen Zhao , Chen Chen , Shu-Tao Xia

Adapter-based parameter-efficient transfer learning has achieved exciting results in vision-language models. Traditional adapter methods often require training or fine-tuning, facing challenges such as insufficient samples or resource…

计算机视觉与模式识别 · 计算机科学 2024-04-22 Juncheng Yang , Zuchao Li , Shuai Xie , Weiping Zhu , Wei Yu , Shijun Li

Most unsupervised domain adaptation (UDA) methods assume that labeled source images are available during model adaptation. However, this assumption is often infeasible owing to confidentiality issues or memory constraints on mobile devices.…

计算机视觉与模式识别 · 计算机科学 2023-03-17 JoonHo Lee , Gyemin Lee

When continual test-time adaptation (TTA) persists over the long term, errors accumulate in the model and further cause it to predict only a few classes for all inputs, a phenomenon known as model collapse. Recent studies have explored…

机器学习 · 计算机科学 2026-03-05 Taejun Lim , Joong-Won Hwang , Kibok Lee

Test-Time Adaptation (TTA) enhances model robustness to out-of-distribution (OOD) data by updating the model online during inference, yet existing methods lack theoretical insights into the fundamental causes of performance degradation…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Xiao Chen , Zhongjing Du , Jiazhen Huang , Xu Jiang , Li Lu , Jingyan Jiang , Zhi Wang

Despite progress in end-to-end ASR, real-world domain mismatches still cause performance drops, which Test-Time Adaptation (TTA) aims to mitigate by adjusting models during inference. Recent work explores combining TTA with external…

计算与语言 · 计算机科学 2025-06-16 Wei-Ping Huang , Guan-Ting Lin , Hung-yi Lee

Deep classifiers may encounter significant performance degradation when processing unseen testing data from varying centers, vendors, and protocols. Ensuring the robustness of deep models against these domain shifts is crucial for their…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Yuhao Huang , Xin Yang , Xiaoqiong Huang , Xinrui Zhou , Haozhe Chi , Haoran Dou , Xindi Hu , Jian Wang , Xuedong Deng , Dong Ni

Test-time adaptation (TTA) aims to mitigate performance degradation under distribution shifts by updating model parameters during inference. Existing approaches have primarily framed adaptation around affine modulation, focusing on…

机器学习 · 计算机科学 2026-03-30 Hyeongyu Kim , Geonhui Han , Dosik Hwang

End-to-end acoustic speech recognition has quickly gained widespread popularity and shows promising results in many studies. Specifically the joint transformer/CTC model provides very good performance in many tasks. However, under noisy and…

音频与语音处理 · 电气工程与系统科学 2021-04-20 Wentao Yu , Steffen Zeiler , Dorothea Kolossa

Catastrophic forgetting makes neural network models unstable when learning visual domains consecutively. The neural network model drifts to catastrophic forgetting-induced low performance of previously learnt domains when training with new…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Sayan Rakshit , Hmrishav Bandyopadhyay , Nibaran Das , Biplab Banerjee

Test-Time Adaptation (TTA) has emerged as a crucial solution to the domain shift challenge, wherein the target environment diverges from the original training environment. A prime exemplification is TTA for Automatic Speech Recognition…

计算与语言 · 计算机科学 2024-08-13 Eunseop Yoon , Hee Suk Yoon , John Harvill , Mark Hasegawa-Johnson , Chang D. Yoo

Online continual learning (CL) aims to learn new knowledge and consolidate previously learned knowledge from non-stationary data streams. Due to the time-varying training setting, the model learned from a changing distribution easily…

机器学习 · 计算机科学 2023-08-15 Quanziang Wang , Renzhen Wang , Yichen Wu , Xixi Jia , Deyu Meng

In recent advancements in Test Time Adaptation (TTA), most existing methodologies focus on updating normalization layers to adapt to the test domain. However, the reliance on normalization-based adaptation presents key challenges. First,…

机器学习 · 计算机科学 2026-03-24 Hyeongyu Kim , Geonhui Han , Dosik Hwang

While vision-and-language models significantly advance in many fields, the challenge of continual learning is unsolved. Parameter-efficient modules like adapters and prompts present a promising way to alleviate catastrophic forgetting.…

机器学习 · 计算机科学 2024-10-16 Hong Li , Zhiquan Tan , Xingyu Li , Weiran Huang

Test-time adaptation (TTA) is a technique aimed at enhancing the generalization performance of models by leveraging unlabeled samples solely during prediction. Given the need for robustness in neural network systems when faced with…

机器学习 · 计算机科学 2023-07-07 Yongcan Yu , Lijun Sheng , Ran He , Jian Liang

Test-time Adaptation (TTA) aims to improve model performance when the model encounters domain changes after deployment. The standard TTA mainly considers the case where the target domain is static, while the continual TTA needs to undergo a…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Xinru Meng , Han Sun , Jiamei Liu , Ningzhong Liu , Huiyu Zhou

Although action recognition systems can achieve top performance when evaluated on in-distribution test points, they are vulnerable to unanticipated distribution shifts in test data. However, test-time adaptation of video action recognition…

计算机视觉与模式识别 · 计算机科学 2023-03-22 Wei Lin , Muhammad Jehanzeb Mirza , Mateusz Kozinski , Horst Possegger , Hilde Kuehne , Horst Bischof