English
Related papers

Related papers: Bridging the Gap for Test-Time Multimodal Sentimen…

200 papers

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges:…

Machine Learning · Computer Science 2025-08-27 Mingkui Tan , Guohao Chen , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Peilin Zhao , Shuaicheng Niu

Deep Learning-based end-to-end Automatic Speech Recognition (ASR) has made significant strides but still struggles with performance on out-of-domain samples due to domain shifts in real-world scenarios. Test-Time Adaptation (TTA) methods…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-04 Guan-Ting Lin , Wei-Ping Huang , Hung-yi Lee

Test-Time Adaptation (TTA) has emerged as a crucial solution to the domain shift challenge, wherein the target environment diverges from the original training environment. A prime exemplification is TTA for Automatic Speech Recognition…

Computation and Language · Computer Science 2024-08-13 Eunseop Yoon , Hee Suk Yoon , John Harvill , Mark Hasegawa-Johnson , Chang D. Yoo

Since distribution shifts are likely to occur during test-time and can drastically decrease the model's performance, online test-time adaptation (TTA) continues to update the model after deployment, leveraging the current test data.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Robert A. Marsden , Mario Döbler , Bin Yang

Sentiment analysis (SA) is an important research area in cognitive computation-thus in-depth studies of patterns of sentiment analysis are necessary. At present, rich resource data-based SA has been well developed, while the more…

Computation and Language · Computer Science 2021-05-26 Yong Dai , Jian Liu , Jian Zhang , Hongguang Fu , Zenglin Xu

Test-time adaptation aims to improve model robustness under distribution shifts by adapting models with access to unlabeled target samples. A primary cause of performance degradation under such shifts is the model's reliance on features…

Machine Learning · Computer Science 2025-10-14 Yingnan Liu , Rui Qiao , Mong Li Lee , Wynne Hsu

Multimodal sentiment analysis is a trending area of research, and the multimodal fusion is one of its most active topic. Acknowledging humans communicate through a variety of channels (i.e visual, acoustic, linguistic), multimodal systems…

Machine Learning · Computer Science 2021-09-10 Pierre Colombo , Emile Chapuis , Matthieu Labeau , Chloe Clavel

Recent instruction-finetuned large language models (LMs) have achieved notable performances in various tasks, such as question-answering (QA). However, despite their ability to memorize a vast amount of general knowledge across diverse…

Computation and Language · Computer Science 2023-10-23 Soyeong Jeong , Jinheon Baek , Sukmin Cho , Sung Ju Hwang , Jong C. Park

Recently, Automatic Speech Recognition (ASR) systems (e.g., Whisper) have achieved remarkable accuracy improvements but remain highly sensitive to real-world unseen data (data with large distribution shifts), including noisy environments…

Sound · Computer Science 2026-03-06 Linghan Fang , Tianxin Xie , Li Liu

Unsupervised domain adaptation (UDA) provides a strategy for improving machine learning performance in data-rich (target) domains where ground truth labels are inaccessible but can be found in related (source) domains. In cases where…

Machine Learning · Computer Science 2023-07-24 Garrett Wilson , Janardhan Rao Doppa , Diane J. Cook

Despite progress in end-to-end ASR, real-world domain mismatches still cause performance drops, which Test-Time Adaptation (TTA) aims to mitigate by adjusting models during inference. Recent work explores combining TTA with external…

Computation and Language · Computer Science 2025-06-16 Wei-Ping Huang , Guan-Ting Lin , Hung-yi Lee

In real-world scenarios, tabular data often suffer from distribution shifts that threaten the performance of machine learning models. Despite its prevalence and importance, handling distribution shifts in the tabular domain remains…

Machine Learning · Computer Science 2025-02-13 Changhun Kim , Taewon Kim , Seungyeon Woo , June Yong Yang , Eunho Yang

Multimodal sentiment analysis benefits various applications such as human-computer interaction and recommendation systems. It aims to infer the users' bipolar ideas using visual, textual, and acoustic signals. Although researchers affirm…

Machine Learning · Computer Science 2021-06-29 Sana Rahmani , Saeid Hosseini , Raziyeh Zall , Mohammad Reza Kangavari , Sara Kamran , Wen Hua

Multi-source domain adaptation (MSDA) addresses the challenge of learning a label prediction function for an unlabeled target domain by leveraging both the labeled data from multiple source domains and the unlabeled data from the target…

Machine Learning · Computer Science 2025-04-03 Yuhang Liu , Zhen Zhang , Dong Gong , Mingming Gong , Biwei Huang , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

Multimodal Sentiment Analysis is an active area of research that leverages multimodal signals for affective understanding of user-generated videos. The predominant approach, addressing this task, has been to develop sophisticated fusion…

Computation and Language · Computer Science 2020-10-20 Devamanyu Hazarika , Roger Zimmermann , Soujanya Poria

Domain adaptation (DA) techniques help deep learning models generalize across data shifts for point cloud semantic segmentation (PCSS). Test-time adaptation (TTA) allows direct adaptation of a pre-trained model to unlabeled data during…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Puzuo Wang , Wei Yao , Jie Shao , Zhiyi He

Spoken Language Models (SLMs) are increasingly central to modern speech-driven applications, but performance degrades under acoustic shift - real-world noise, reverberation, and microphone variation. Prior solutions rely on offline domain…

Test-time adaptation (TTA) aims to address distributional shifts between training and testing data using only unlabeled test data streams for continual model adaptation. However, most TTA methods assume benign test streams, while test…

Machine Learning · Computer Science 2023-10-17 Taesik Gong , Yewon Kim , Taeckyung Lee , Sorn Chottananurak , Sung-Ju Lee

Monitoring the growth of subcortical regions of the fetal brain in ultrasound (US) images can help identify the presence of abnormal development. Manually segmenting these regions is a challenging task, but recent work has shown that it can…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Joshua Omolegan , Pak Hei Yeung , Madeleine K. Wyburd , Linde Hesse , Monique Haak , Intergrowth-21st Consortium , Ana I. L. Namburete , Nicola K. Dinsdale

Distribution shifts between training and test data are inevitable over the lifecycle of a deployed model, leading to performance decay. Adapting a model on test samples can help mitigate this drop in performance. However, most test-time…

Machine Learning · Computer Science 2025-11-18 Mona Schirmer , Dan Zhang , Eric Nalisnick