English
Related papers

Related papers: Rebalanced Multimodal Learning with Data-aware Uni…

200 papers

As instruction-tuned large language models (LLMs) evolve, aligning pretrained foundation models presents increasing challenges. Existing alignment strategies, which typically leverage diverse and high-quality data sources, often overlook…

Computation and Language · Computer Science 2024-06-10 Yikun Wang , Rui Zheng , Liang Ding , Qi Zhang , Dahua Lin , Dacheng Tao

In multimodal learning, dominant modalities often overshadow others, limiting generalization. We propose Modality-Aware Sharpness-Aware Minimization (M-SAM), a model-agnostic framework that applies to many modalities and supports early and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Hossein R. Nowdeh , Jie Ji , Xiaolong Ma , Fatemeh Afghah

Real-world multimodal learning is often hindered by missing modalities. While Incomplete Multimodal Learning (IML) has gained traction, existing methods typically rely on the unrealistic assumption of full-modal availability during training…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Huangbiao Xu , Huanqi Wu , Xiao Ke , Yuxin Peng

Multimodal machine learning with missing modalities is an increasingly relevant challenge arising in various applications such as healthcare. This paper extends the current research into missing modalities to the low-data regime, i.e., a…

Machine Learning · Computer Science 2024-03-27 Zhuo Zhi , Ziquan Liu , Moe Elbadawi , Adam Daneshmend , Mine Orlu , Abdul Basit , Andreas Demosthenous , Miguel Rodrigues

Class imbalance and distributional differences in large datasets present significant challenges for classification tasks machine learning, often leading to biased models and poor predictive performance for minority classes. This work…

Machine Learning · Statistics 2024-12-20 Alex Mak , Shubham Sahoo , Shivani Pandey , Yidan Yue , Linglong Kong

Multimodal learning methods with targeted unimodal learning objectives have exhibited their superior efficacy in alleviating the imbalanced multimodal learning problem. However, in this paper, we identify the previously ignored gradient…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Yake Wei , Di Hu

Meta learning is a promising solution to few-shot learning problems. However, existing meta learning methods are restricted to the scenarios where training and application tasks share the same out-put structure. To obtain a meta model…

Machine Learning · Computer Science 2019-04-22 Yingtian Zou , Jiashi Feng

Multi-Modal Learning (MML) integrates information from diverse modalities to improve predictive accuracy. While existing optimization strategies have made significant strides by mitigating gradient direction conflicts, we revisit MML from a…

Machine Learning · Computer Science 2026-02-09 Peizheng Guo , Jingyao Wang , Wenwen Qiang , Jiahuan Zhou , Changwen Zheng , Gang Hua

Machine learning models are trained to minimize the mean loss for a single metric, and thus typically do not consider fairness and robustness. Neglecting such metrics in training can make these models prone to fairness violations when…

Machine Learning · Computer Science 2022-07-21 Bobby Yan , Skyler Seto , Nicholas Apostoloff

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

We propose a unified deep meta-learning framework for accelerated magnetic resonance imaging (MRI) that jointly addresses multi-coil reconstruction and cross-modality synthesis. Motivated by the limitations of conventional methods in…

Optimization and Control · Mathematics 2026-03-10 Merham Fouladvand , Peuroly Batra

Vision-language retrieval aims to search for similar instances in one modality based on queries from another modality. The primary objective is to learn cross-modal matching representations in a latent common space. Actually, the assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yang Yang , Wenjuan Xi , Luping Zhou , Jinhui Tang

Multimodal representation learning seeks to relate and decompose information inherent in multiple modalities. By disentangling modality-specific information from information that is shared across modalities, we can improve interpretability…

Machine Learning · Computer Science 2025-03-18 Chenyu Wang , Sharut Gupta , Xinyi Zhang , Sana Tonekaboni , Stefanie Jegelka , Tommi Jaakkola , Caroline Uhler

Multi-modal learning, which focuses on utilizing various modalities to improve the performance of a model, is widely used in video recognition. While traditional multi-modal learning offers excellent recognition results, its computational…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Rameswar Panda , Chun-Fu Chen , Quanfu Fan , Ximeng Sun , Kate Saenko , Aude Oliva , Rogerio Feris

Recently, multi-view learning (MVL) has garnered significant attention due to its ability to fuse discriminative information from multiple views. However, real-world multi-view datasets are often heterogeneous and imperfect, which usually…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jie Xu , Na Zhao , Gang Niu , Masashi Sugiyama , Xiaofeng Zhu

Multimodal learning has become a prominent research area, with the potential of substantial performance gains by combining information across modalities. At the same time, model development has trended toward increasingly complex deep…

Machine Learning · Computer Science 2026-05-08 Tillmann Rheude , Roland Eils , Benjamin Wild

We present a novel Balanced Incremental Model Agnostic Meta Learning system (BI-MAML) for learning multiple tasks. Our method implements a meta-update rule to incrementally adapt its model to new tasks without forgetting old tasks. Such a…

Machine Learning · Computer Science 2020-06-16 Yang Zheng , Jinlin Xiang , Kun Su , Eli Shlizerman

Multimodal learning is expected to boost model performance by integrating information from different modalities. However, its potential is not fully exploited because the widely-used joint training strategy, which has a uniform objective…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Yake Wei , Di Hu , Henghui Du , Ji-Rong Wen

Data-driven fault diagnostics and prognostics suffers from class-imbalance problem in industrial systems and it raises challenges to common machine learning algorithms as it becomes difficult to learn the features of the minority class…

Machine Learning · Computer Science 2018-11-20 Wenfang Lin , Zhenyu Wu , Yang Ji

Generating multi-contrasts/modal MRI of the same anatomy enriches diagnostic information but is limited in practice due to excessive data acquisition time. In this paper, we propose a novel deep-learning model for joint reconstruction and…

Image and Video Processing · Electrical Eng. & Systems 2022-06-30 Wanyu Bian , Qingchao Zhang , Xiaojing Ye , Yunmei Chen