中文
相关论文

相关论文: LI-TTA: Language Informed Test-Time Adaptation for…

200 篇论文

Test-time adaptation (TTA) adapts the pre-trained models to test distributions during the inference phase exclusively employing unlabeled test data streams, which holds great value for the deployment of models in real-world applications.…

计算机视觉与模式识别 · 计算机科学 2023-10-10 Shuang Li , Longhui Yuan , Binhui Xie , Tao Yang

Conventional end-to-end automatic speech recognition (ASR) systems rely on paired speech-text data for domain adaptation. Recent LLM-based ASR architectures connect a speech encoder to a large language model via a projection module,…

Test-time adaptation (TTA) refers to adapting a trained model to a new domain during testing. Existing TTA techniques rely on having multiple test images from the same domain, yet this may be impractical in real-world applications such as…

计算机视觉与模式识别 · 计算机科学 2024-02-19 Haoyu Dong , Nicholas Konz , Hanxue Gu , Maciej A. Mazurowski

Test-time adaptation (TTA) aims to improve model generalizability when test data diverges from training distribution, offering the distinct advantage of not requiring access to training data and processes, especially valuable in the context…

机器学习 · 计算机科学 2024-02-28 Yige Yuan , Bingbing Xu , Liang Hou , Fei Sun , Huawei Shen , Xueqi Cheng

The rapid advancements in vision-language models (VLMs), such as CLIP, have intensified the need to address distribution shifts between training and testing datasets. Although prior Test-Time Training (TTT) techniques for VLMs have…

计算机视觉与模式识别 · 计算机科学 2025-02-05 Yuto Kojima , Jiarui Xu , Xueyan Zou , Xiaolong Wang

This paper proposes a novel online evaluation protocol for Test Time Adaptation (TTA) methods, which penalizes slower methods by providing them with fewer samples for adaptation. TTA methods leverage unlabeled data at test time to adapt to…

Test-time adaptation (TTA) aims to improve the performance of source-domain pre-trained models on previously unseen, shifted target domains. Traditional TTA methods primarily adapt model weights based on target data streams, making model…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Jiayi Guo , Junhao Zhao , Chaoqun Du , Yulin Wang , Chunjiang Ge , Zanlin Ni , Shiji Song , Humphrey Shi , Gao Huang

Test-time adaption (TTA) has witnessed important progress in recent years, the prevailing methods typically first encode the image and the text and design strategies to model the association between them. Meanwhile, the image encoder is…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Yaxiong Wang , Zhenqiang Zhang , Lechao Cheng , Zhun Zhong , Dan Guo , Meng Wang

Since real-world machine systems are running in non-stationary environments, Continual Test-Time Adaptation (CTTA) task is proposed to adapt the pre-trained model to continually changing target domains. Recently, existing methods mainly…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Jiaming Liu , Senqiao Yang , Peidong Jia , Renrui Zhang , Ming Lu , Yandong Guo , Wei Xue , Shanghang Zhang

Remote physiological measurement (RPM) has emerged as a promising non-invasive method for monitoring physiological signals using the non-contact device. Although various domain adaptation and generalization methods were proposed to promote…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Xiao Yang , Jiyao Wang , Yuxuan Fan , Can Liu , Houcheng Su , Weichen Guo , Zitong Yu , Dengbo He , Kaishun Wu

Punctuation prediction for automatic speech recognition (ASR) output transcripts plays a crucial role for improving the readability of the ASR transcripts and for improving the performance of downstream natural language processing…

计算与语言 · 计算机科学 2021-09-02 Qian Chen , Wen Wang , Mengzhe Chen , Qinglin Zhang

Recent advances in automatic speech recognition (ASR) have combined speech encoders with large language models (LLMs) through projection, forming Speech LLMs with strong performance. However, adapting them to new domains remains…

音频与语音处理 · 电气工程与系统科学 2025-12-24 Yangui Fang , Jing Peng , Xu Li , Yu Xi , Chengwei Zhang , Guohui Zhong , Kai Yu

Facial expression recognition (FER) in videos requires model personalization to capture the considerable variations across subjects. Vision-language models (VLMs) offer strong transfer to downstream tasks through image-text alignment, but…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Masoumeh Sharafi , Muhammad Osama Zeeshan , Soufiane Belharbi , Alessandro Lameiras Koerich , Marco Pedersoli , Eric Granger

Audio-driven talking-head generation has achieved remarkable progress with recent models such as AniTalker, FLOAT, and Sonic. Despite their success, most existing approaches rely on a single static reference image to condition the entire…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Zhicheng Zhang , Lei Wang , Yu Zhang , Yongsheng Gao

Test-time training (TTT) enhances model performance by explicitly updating designated parameters prior to each prediction to adapt to the test data. While TTT has demonstrated considerable empirical success, its theoretical underpinnings…

机器学习 · 统计学 2026-02-03 Kento Kuwataka , Taiji Suzuki

Wearable human activity recognition (WHAR) models often suffer from performance degradation under real-world cross-user distribution shifts. Test-time adaptation (TTA) mitigates this degradation by adapting models online using unlabeled…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Zishu Zhou , Zaipeng Xie , Xuanyao Jie

The rapid development of neural text-to-speech (TTS) systems enabled its usage in other areas of natural language processing such as automatic speech recognition (ASR) or spoken language translation (SLT). Due to the large number of…

计算与语言 · 计算机科学 2024-08-01 Nick Rossenbach , Ralf Schlüter , Sakriani Sakti

The goal of the challenge is to develop a test-time adaptation (TTA) method, which could adapt the model to gradually changing domains in video sequences for semantic segmentation task. It is based on a synthetic driving video dataset -…

计算机视觉与模式识别 · 计算机科学 2023-10-23 Damian Sójka , Yuyang Liu , Dipam Goswami , Sebastian Cygert , Bartłomiej Twardowski , Joost van de Weijer

Language models (LMs) have shown impressive performance on tasks within their training distribution, but often struggle with structurally novel tasks even when given a small number of in-context task examples. We investigate the…

人工智能 · 计算机科学 2025-03-26 Ekin Akyürek , Mehul Damani , Adam Zweiger , Linlu Qiu , Han Guo , Jyothish Pari , Yoon Kim , Jacob Andreas

Multilingual models for Automatic Speech Recognition (ASR) are attractive as they have been shown to benefit from more training data, and better lend themselves to adaptation to under-resourced languages. However, initialisation from…

音频与语音处理 · 电气工程与系统科学 2018-01-24 Sibo Tong , Philip N. Garner , Hervé Bourlard