English
Related papers

Related papers: LI-TTA: Language Informed Test-Time Adaptation for…

200 papers

Test-time adaptation (TTA) adapts the pre-trained models to test distributions during the inference phase exclusively employing unlabeled test data streams, which holds great value for the deployment of models in real-world applications.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Shuang Li , Longhui Yuan , Binhui Xie , Tao Yang

Conventional end-to-end automatic speech recognition (ASR) systems rely on paired speech-text data for domain adaptation. Recent LLM-based ASR architectures connect a speech encoder to a large language model via a projection module,…

Test-time adaptation (TTA) refers to adapting a trained model to a new domain during testing. Existing TTA techniques rely on having multiple test images from the same domain, yet this may be impractical in real-world applications such as…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Haoyu Dong , Nicholas Konz , Hanxue Gu , Maciej A. Mazurowski

Test-time adaptation (TTA) aims to improve model generalizability when test data diverges from training distribution, offering the distinct advantage of not requiring access to training data and processes, especially valuable in the context…

Machine Learning · Computer Science 2024-02-28 Yige Yuan , Bingbing Xu , Liang Hou , Fei Sun , Huawei Shen , Xueqi Cheng

The rapid advancements in vision-language models (VLMs), such as CLIP, have intensified the need to address distribution shifts between training and testing datasets. Although prior Test-Time Training (TTT) techniques for VLMs have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Yuto Kojima , Jiarui Xu , Xueyan Zou , Xiaolong Wang

This paper proposes a novel online evaluation protocol for Test Time Adaptation (TTA) methods, which penalizes slower methods by providing them with fewer samples for adaptation. TTA methods leverage unlabeled data at test time to adapt to…

Test-time adaptation (TTA) aims to improve the performance of source-domain pre-trained models on previously unseen, shifted target domains. Traditional TTA methods primarily adapt model weights based on target data streams, making model…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiayi Guo , Junhao Zhao , Chaoqun Du , Yulin Wang , Chunjiang Ge , Zanlin Ni , Shiji Song , Humphrey Shi , Gao Huang

Test-time adaption (TTA) has witnessed important progress in recent years, the prevailing methods typically first encode the image and the text and design strategies to model the association between them. Meanwhile, the image encoder is…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yaxiong Wang , Zhenqiang Zhang , Lechao Cheng , Zhun Zhong , Dan Guo , Meng Wang

Since real-world machine systems are running in non-stationary environments, Continual Test-Time Adaptation (CTTA) task is proposed to adapt the pre-trained model to continually changing target domains. Recently, existing methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jiaming Liu , Senqiao Yang , Peidong Jia , Renrui Zhang , Ming Lu , Yandong Guo , Wei Xue , Shanghang Zhang

Remote physiological measurement (RPM) has emerged as a promising non-invasive method for monitoring physiological signals using the non-contact device. Although various domain adaptation and generalization methods were proposed to promote…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xiao Yang , Jiyao Wang , Yuxuan Fan , Can Liu , Houcheng Su , Weichen Guo , Zitong Yu , Dengbo He , Kaishun Wu

Punctuation prediction for automatic speech recognition (ASR) output transcripts plays a crucial role for improving the readability of the ASR transcripts and for improving the performance of downstream natural language processing…

Computation and Language · Computer Science 2021-09-02 Qian Chen , Wen Wang , Mengzhe Chen , Qinglin Zhang

Recent advances in automatic speech recognition (ASR) have combined speech encoders with large language models (LLMs) through projection, forming Speech LLMs with strong performance. However, adapting them to new domains remains…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-24 Yangui Fang , Jing Peng , Xu Li , Yu Xi , Chengwei Zhang , Guohui Zhong , Kai Yu

Facial expression recognition (FER) in videos requires model personalization to capture the considerable variations across subjects. Vision-language models (VLMs) offer strong transfer to downstream tasks through image-text alignment, but…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Masoumeh Sharafi , Muhammad Osama Zeeshan , Soufiane Belharbi , Alessandro Lameiras Koerich , Marco Pedersoli , Eric Granger

Audio-driven talking-head generation has achieved remarkable progress with recent models such as AniTalker, FLOAT, and Sonic. Despite their success, most existing approaches rely on a single static reference image to condition the entire…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zhicheng Zhang , Lei Wang , Yu Zhang , Yongsheng Gao

Test-time training (TTT) enhances model performance by explicitly updating designated parameters prior to each prediction to adapt to the test data. While TTT has demonstrated considerable empirical success, its theoretical underpinnings…

Machine Learning · Statistics 2026-02-03 Kento Kuwataka , Taiji Suzuki

Wearable human activity recognition (WHAR) models often suffer from performance degradation under real-world cross-user distribution shifts. Test-time adaptation (TTA) mitigates this degradation by adapting models online using unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zishu Zhou , Zaipeng Xie , Xuanyao Jie

The rapid development of neural text-to-speech (TTS) systems enabled its usage in other areas of natural language processing such as automatic speech recognition (ASR) or spoken language translation (SLT). Due to the large number of…

Computation and Language · Computer Science 2024-08-01 Nick Rossenbach , Ralf Schlüter , Sakriani Sakti

The goal of the challenge is to develop a test-time adaptation (TTA) method, which could adapt the model to gradually changing domains in video sequences for semantic segmentation task. It is based on a synthetic driving video dataset -…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Damian Sójka , Yuyang Liu , Dipam Goswami , Sebastian Cygert , Bartłomiej Twardowski , Joost van de Weijer

Language models (LMs) have shown impressive performance on tasks within their training distribution, but often struggle with structurally novel tasks even when given a small number of in-context task examples. We investigate the…

Artificial Intelligence · Computer Science 2025-03-26 Ekin Akyürek , Mehul Damani , Adam Zweiger , Linlu Qiu , Han Guo , Jyothish Pari , Yoon Kim , Jacob Andreas

Multilingual models for Automatic Speech Recognition (ASR) are attractive as they have been shown to benefit from more training data, and better lend themselves to adaptation to under-resourced languages. However, initialisation from…

Audio and Speech Processing · Electrical Eng. & Systems 2018-01-24 Sibo Tong , Philip N. Garner , Hervé Bourlard