English
Related papers

Related papers: Towards Balanced Active Learning for Multimodal Cl…

200 papers

Multimodal learning often encounters the under-optimized problem and may perform worse than unimodal learning. Existing approaches attribute this issue to imbalanced learning across modalities and tend to address it through gradient…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Shicai Wei , Chunbo Luo , Yang Luo

To address the modality imbalance caused by data heterogeneity, existing multi-modal learning (MML) approaches primarily focus on balancing this difference from the perspective of optimization objectives. However, almost all existing…

Machine Learning · Computer Science 2025-01-06 Zhi-Hao Guan

Improving performance in multiple domains is a challenging task, and often requires significant amounts of data to train and test models. Active learning techniques provide a promising solution by enabling models to select the most…

Machine Learning · Computer Science 2023-04-14 Anand Gokul Mahalingam , Aayush Shah , Akshay Gulati , Royston Mascarenhas , Rakshitha Panduranga

Multimodal learning, which integrates data from diverse sensory modes, plays a pivotal role in artificial intelligence. However, existing multimodal learning methods often struggle with challenges where some modalities appear more dominant…

Machine Learning · Computer Science 2024-04-02 Xiaohui Zhang , Jaehong Yoon , Mohit Bansal , Huaxiu Yao

Multimodal learning systems often encounter challenges related to modality imbalance, where a dominant modality may overshadow others, thereby hindering the learning of weak modalities. Conventional approaches often force weak modalities to…

Machine Learning · Computer Science 2025-10-27 Baoquan Gong , Xiyuan Gao , Pengfei Zhu , Qinghua Hu , Bing Cao

Multimodal learning seeks to utilize data from multiple sources to improve the overall performance of downstream tasks. It is desirable for redundancies in the data to make multimodal systems robust to missing or corrupted observations in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Md Kaykobad Reza , Ashley Prater-Bennette , M. Salman Asif

Medical decision systems increasingly rely on data from multiple sources to ensure reliable and unbiased diagnosis. However, existing multimodal learning models fail to achieve this goal because they often ignore two critical challenges.…

Machine Learning · Computer Science 2025-10-10 Md Zubair , Hao Zheng , Nussdorf Jonathan , Grayson W. Armstrong , Lucy Q. Shen , Gabriela Wilson , Yu Tian , Xingquan Zhu , Min Shi

Active Learning aims to optimize performance while minimizing annotation costs by selecting the most informative samples from an unlabelled pool. Traditional uncertainty sampling often leads to sampling bias by choosing similar uncertain…

Machine Learning · Computer Science 2024-11-27 Tejaswi Kasarla , Abhishek Jha , Faye Tervoort , Rita Cucchiara , Pascal Mettes

Active learning is a promising paradigm to reduce the labeling cost by strategically requesting labels to improve model performance. However, existing active learning methods often rely on expensive acquisition function to compute,…

Machine Learning · Computer Science 2023-10-27 Zixin Ding , Si Chen , Ruoxi Jia , Yuxin Chen

Active learning is usually applied to acquire labels of informative data points in supervised learning, to maximize accuracy in a sample-efficient way. However, maximizing the accuracy is not the end goal when the results are used for…

Machine Learning · Statistics 2021-10-22 Louis Filstroff , Iiris Sundin , Petrus Mikkola , Aleksei Tiulpin , Juuso Kylmäoja , Samuel Kaski

Multimodal learning often relies on aligning representations across modalities to enable effective information integration, an approach traditionally assumed to be universally beneficial. However, prior research has primarily taken an…

Machine Learning · Computer Science 2025-11-26 Wanlong Fang , Tianle Zhang , Alvin Chan

Active learning, a powerful paradigm in machine learning, aims at reducing labeling costs by selecting the most informative samples from an unlabeled dataset. However, the traditional active learning process often demands extensive…

Machine Learning · Computer Science 2024-01-17 Gábor Németh , Tamás Matuszka

Learning-enabled control systems increasingly rely on multiple sensing modalities (e.g., vision, audio, language, etc.) for perception and decision support. A key challenge is that multi-modal sensor training dynamics are often imbalanced:…

Machine Learning · Computer Science 2026-04-01 Heshan Fernando , Quan Xiao , Parikshit Ram , Yi Zhou , Horst Samulowitz , Nathalie Baracaldo , Tianyi Chen

Multimodal learning helps to comprehensively understand the world, by integrating different senses. Accordingly, multiple input modalities are expected to boost model performance, but we actually find that they are not fully exploited even…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Xiaokang Peng , Yake Wei , Andong Deng , Dong Wang , Di Hu

Selecting proper clients to participate in each federated learning (FL) round is critical to effectively harness a broad range of distributed data. Existing client selection methods simply consider the mining of distributed uni-modal data,…

Machine Learning · Computer Science 2024-07-30 Yunfeng Fan , Wenchao Xu , Haozhao Wang , Fushuo Huo , Jinyu Chen , Song Guo

Multimodal learning integrates complementary information from different modalities such as image, text, and audio to improve model performance, but its success relies on large-scale labeled data, which is costly to obtain. Active learning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yuqiao Zeng , Xu Wang , Tengfei Liang , Yiqing Hao , Yi Jin , Hui Yu

The availability of large labeled datasets is the key component for the success of deep learning. However, annotating labels on large datasets is generally time-consuming and expensive. Active learning is a research area that addresses the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Felix Buchert , Nassir Navab , Seong Tae Kim

Active learning is a practical field of machine learning that automates the process of selecting which data to label. Current methods are effective in reducing the burden of data labeling but are heavily model-reliant. This has led to the…

Machine Learning · Computer Science 2023-03-01 Sai Prathyush Katragadda , Tyler Cody , Peter Beling , Laura Freeman

It is not an exaggeration to say that the recent progress in artificial intelligence technology depends on large-scale and high-quality data. Simultaneously, a prevalent issue exists everywhere: the budget for data labeling is constrained.…

Machine Learning · Computer Science 2023-08-22 Yujin Hwang , Won Jo , Juyoung Hong , Yukyung Choi

The ability to train complex and highly effective models often requires an abundance of training data, which can easily become a bottleneck in cost, time, and computational resources. Batch active learning, which adaptively issues batched…