English
Related papers

Related papers: Efficient Prompting for Continual Adaptation to Mi…

200 papers

Due to the notorious modality imbalance problem, multimodal learning (MML) leads to the phenomenon of optimization imbalance, thus struggling to achieve satisfactory performance. Recently, some representative methods have been proposed to…

Machine Learning · Computer Science 2024-07-08 Qing-Yuan Jiang , Zhouyang Chi , Yang Yang

This survey reviews prompt tuning, a parameter-efficient approach for adapting language models by prepending trainable continuous vectors while keeping the model frozen. We classify existing approaches into two categories: direct prompt…

Computation and Language · Computer Science 2025-07-10 Zongqian Li , Yixuan Su , Nigel Collier

Multimodal learning systems often encounter challenges related to modality imbalance, where a dominant modality may overshadow others, thereby hindering the learning of weak modalities. Conventional approaches often force weak modalities to…

Machine Learning · Computer Science 2025-10-27 Baoquan Gong , Xiyuan Gao , Pengfei Zhu , Qinghua Hu , Bing Cao

Generally, items with missing modalities are dropped in multimodal recommendation. However, with this work, we question this procedure, highlighting that it would further damage the pipeline of any multimodal recommender system. First, we…

Information Retrieval · Computer Science 2024-08-22 Daniele Malitesta , Emanuele Rossi , Claudio Pomo , Tommaso Di Noia , Fragkiskos D. Malliaros

Pretrained large-scale vision-language models such as CLIP have demonstrated excellent generalizability over a series of downstream tasks. However, they are sensitive to the variation of input text prompts and need a selection of prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Lianyu Hu , Liqing Gao , Zekang Liu , Chi-Man Pun , Wei Feng

Fallacies are used as seemingly valid arguments to support a position and persuade the audience about its validity. Recognizing fallacies is an intrinsically difficult task both for humans and machines. Moreover, a big challenge for…

Computation and Language · Computer Science 2023-01-25 Tariq Alhindi , Tuhin Chakrabarty , Elena Musi , Smaranda Muresan

Continual fine-tuning aims to adapt a pre-trained backbone to new tasks sequentially while preserving performance on earlier tasks whose data are no longer available. Existing approaches fall into two categories which include input- and…

Machine Learning · Computer Science 2026-03-17 Hang Thi-Thuy Le , Long Minh Bui , Minh Hoang , Trong Nghia Hoang

Multi-Task Learning (MTL) is designed to train multiple correlated tasks simultaneously, thereby enhancing the performance of individual tasks. Typically, a multi-task network structure consists of a shared backbone and task-specific…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Yi Xin , Junlong Du , Qiang Wang , Ke Yan , Shouhong Ding

Current natural language processing models work well on a single task, yet they often fail to continuously learn new tasks without forgetting previous ones as they are re-trained throughout their lifetime, a challenge known as lifelong…

Computation and Language · Computer Science 2020-10-07 Zirui Wang , Sanket Vaibhav Mehta , Barnabás Póczos , Jaime Carbonell

Multi-modal learning aims to enhance performance by unifying models from various modalities but often faces the "modality imbalance" problem in real data, leading to a bias towards dominant modalities and neglecting others, thereby limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yang Yang , Hongpeng Pan , Qing-Yuan Jiang , Yi Xu , Jinghui Tang

Learning multimodal representations is a fundamentally complex research problem due to the presence of multiple heterogeneous sources of information. Although the presence of multiple modalities provides additional valuable information,…

Machine Learning · Computer Science 2019-05-15 Yao-Hung Hubert Tsai , Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency , Ruslan Salakhutdinov

Cross-modal medical image translation is an essential task for synthesizing missing modality data for clinical diagnosis. However, current learning-based techniques have limitations in capturing cross-modal and global features, restricting…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Xuhang Chen , Chi-Man Pun , Shuqiang Wang

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

Computation and Language · Computer Science 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

Multimodal learning combines information from multiple data modalities to improve predictive performance. However, modalities often contribute unequally and in a data dependent way, making it unclear which data modalities are genuinely…

Machine Learning · Statistics 2026-02-03 Mathew Chandy , Michael Johnson , Judong Shen , Devan V. Mehrotra , Hua Zhou , Jin Zhou , Xiaowu Dai

Due to the challenges of processing temporal information, most trackers depend solely on visual discriminability and overlook the unique temporal coherence of video data. In this paper, we propose a lightweight and plug-and-play motion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jie Zhao , Xin Chen , Yongsheng Yuan , Michael Felsberg , Dong Wang , Huchuan Lu

Test-time prompt tuning for vision-language models has demonstrated impressive generalization capabilities under zero-shot settings. However, tuning the learnable prompts solely based on unlabeled test data may induce prompt optimization…

Machine Learning · Computer Science 2025-11-18 Fei Song , Yi Li , Rui Wang , Jiahuan Zhou , Changwen Zheng , Jiangmeng Li

In real world clinical environments, training and applying deep learning models on multi-modal medical imaging data often struggles with partially incomplete data. Standard approaches either discard missing samples, require imputation or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Christoph Fürböck , Paul Weiser , Branko Mitic , Philipp Seeböck , Thomas Helbich , Georg Langs

While the field of multi-modal learning keeps growing fast, the deficiency of the standard joint training paradigm has become clear through recent studies. They attribute the sub-optimal performance of the jointly trained model to the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Hong Li , Xingyu Li , Pengbo Hu , Yinuo Lei , Chunxiao Li , Yi Zhou

We show that the representation of one modality can effectively guide the prompting of another modality for parameter-efficient multimodal fusion. Specifically, we first encode one modality and use its representation as a prior to…

Computation and Language · Computer Science 2023-12-08 Ruixiang Jiang , Lingbo Liu , Changwen Chen

Multimodal remote sensing classification often suffers from missing modalities caused by sensor failures and environmental interference, leading to severe performance degradation. In this work, we rethink missing-modality learning from a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Qinghao Gao , Jiahui Qu , Wenqian Dong