English
Related papers

Related papers: Bridging Modalities via Progressive Re-alignment f…

200 papers

Multimodal learning often suffers from modality imbalance, where modalities that converge faster dominate optimization while others remain undertrained. Existing approaches typically mitigate this issue by strengthening the weak modality or…

Machine Learning · Computer Science 2026-05-29 Xiaoyu Ma , Weijie Zhang , Yuanhao Gao , Han Miao , Yongjian Deng , Hao Chen

Since distribution shifts are likely to occur during test-time and can drastically decrease the model's performance, online test-time adaptation (TTA) continues to update the model after deployment, leveraging the current test data.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Robert A. Marsden , Mario Döbler , Bin Yang

Test-Time Adaptation (TTA) enables pre-trained models to bridge the gap between source and target datasets using unlabeled test data, addressing domain shifts caused by corruptions like weather changes, noise, or sensor malfunctions in test…

Machine Learning · Computer Science 2025-07-29 Yufei Zhang , Yicheng Xu , Hongxin Wei , Zhiping Lin , Xiaofeng Zou , Cen Chen , Huiping Zhuang

Multimodal sentiment analysis (MSA) is an emerging research topic that aims to understand and recognize human sentiment or emotions through multiple modalities. However, in real-world dynamic scenarios, the distribution of target data is…

Machine Learning · Computer Science 2025-02-11 Zirun Guo , Tao Jin , Wenlong Xu , Wang Lin , Yangyang Wu

Test-time adaptation (TTA) is a technique aimed at enhancing the generalization performance of models by leveraging unlabeled samples solely during prediction. Given the need for robustness in neural network systems when faced with…

Machine Learning · Computer Science 2023-07-07 Yongcan Yu , Lijun Sheng , Ran He , Jian Liang

Test-Time Adaptation (TTA) has emerged as a promising solution for adapting a source model to unseen medical sites using unlabeled test data, due to the high cost of data annotation. Existing TTA methods consider scenarios where data from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Wei Li , Jingyang Zhang , Lihao Liu , Guoan Wang , Junjun He , Yang Chen , Lixu Gu

Multi-modal test-time adaptation (MM-TTA) adapts models to an unlabeled target domain by leveraging the complementary multi-modal inputs in an online manner. While previous MM-TTA methods for 3D segmentation offer a promising solution by…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Haozhi Cao , Yuecong Xu , Pengyu Yin , Xingyu Ji , Shenghai Yuan , Jianfei Yang , Lihua Xie

Multimodal learning, which integrates data from diverse sensory modes, plays a pivotal role in artificial intelligence. However, existing multimodal learning methods often struggle with challenges where some modalities appear more dominant…

Machine Learning · Computer Science 2024-04-02 Xiaohui Zhang , Jaehong Yoon , Mohit Bansal , Huaxiu Yao

Test-time adaptation aims to adapt a well-trained model to potential distribution shifts at test time using only unlabeled test data, without access to the original training data. While previous efforts mainly focus on a single modality,…

Artificial Intelligence · Computer Science 2025-03-05 Yusheng Zhao , Junyu Luo , Xiao Luo , Jinsheng Huang , Jingyang Yuan , Zhiping Xiao , Ming Zhang

Multimodal learning integrates diverse modalities but suffers from modality imbalance, where dominant modalities suppress weaker ones due to inconsistent convergence rates. Existing methods predominantly rely on static modulation or…

Machine Learning · Computer Science 2026-02-11 Zhaocheng Liu , Zhiwen Yu , Xiaoqing Liu

Vision-language models (VLMs) like CLIP exhibit strong zero-shot capabilities but often fail to generalize under distribution shifts. Test-time adaptation (TTA) allows models to update at inference time without labeled data, typically via…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Marc Lafon , Gustavo Adolfo Vargas Hakim , Clément Rambour , Christian Desrosier , Nicolas Thome

Test-time adaptation (TTA) has gained increasing popularity due to its efficacy in addressing ``distribution shift'' issue while simultaneously protecting data privacy. However, most prior methods assume that a paired source domain model…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Aiming Zhang , Tianyuan Yu , Liang Bai , Jun Tang , Yanming Guo , Yirun Ruan , Yun Zhou , Zhihe Lu

Test-time adaptation (TTA) is a technique used to reduce distribution gaps between the training and testing sets by leveraging unlabeled test data during inference. In this work, we expand TTA to a more practical scenario, where the test…

Machine Learning · Computer Science 2023-03-06 Chenyan Wu , Yimu Pan , Yandong Li , James Z. Wang

With the rapid advances in high-throughput sequencing technologies, the focus of survival analysis has shifted from examining clinical indicators to incorporating genomic profiles with pathological images. However, existing methods either…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Fengtao Zhou , Hao Chen

Continual Test-Time Adaptation (CTTA) is an emerging and challenging task where a model trained in a source domain must adapt to continuously changing conditions during testing, without access to the original source data. CTTA is prone to…

Machine Learning · Computer Science 2024-05-29 Ziqi Shi , Fan Lyu , Ye Liu , Fanhua Shang , Fuyuan Hu , Wei Feng , Zhang Zhang , Liang Wang

Deploying multi-sequence magnetic resonance imaging (MRI) segmentation models to new clinical environments is challenging due to variations in scanners and acquisition protocols. Although existing TTA methods handle basic per-modality…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zhipeng Deng , Jiale Zhou , Wenhan Jiang , Haolin Wang , Xun Lin , Yafei Ou , Yefeng Zheng

Despite domain generalization (DG) has significantly addressed the performance degradation of pre-trained models caused by domain shifts, it often falls short in real-world deployment. Test-time adaptation (TTA), which adjusts a learned…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Xingguo Lv , Xingbo Dong , Liwen Wang , Jiewen Yang , Lei Zhao , Bin Pu , Zhe Jin , Xuejun Li

Test-time adaptation (TTA) aims to adapt a model, initially trained on training data, to test data with potential distribution shifts. Most existing TTA methods focus on classification problems. The pronounced success of classification…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Chang'an Yi , Haotian Chen , Yifan Zhang , Yonghui Xu , Yan Zhou , Lizhen Cui

Given a model trained on source data, Test-Time Adaptation (TTA) enables adaptation and inference in test data streams with domain shifts from the source. Current methods predominantly optimize the model for each incoming test data batch…

Machine Learning · Computer Science 2024-07-18 Ziqiang Wang , Zhixiang Chi , Yanan Wu , Li Gu , Zhi Liu , Konstantinos Plataniotis , Yang Wang

Mainstream test-time adaptation (TTA) techniques endeavor to mitigate distribution shifts via entropy minimization for multi-class classification, inherently increasing the probability of the most confident class. However, when encountering…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Xiangyu Wu , Feng Yu , Qing-Guo Chen , Yang Yang , Jianfeng Lu