English
Related papers

Related papers: AIM: Adaptive Intra-Network Modulation for Balance…

200 papers

Supervised multi-modal learning involves mapping multiple modalities to a target label. Previous studies in this field have concentrated on capturing in isolation either the inter-modality dependencies (the relationships between different…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Divyam Madaan , Taro Makino , Sumit Chopra , Kyunghyun Cho

Gradient-based meta-learners such as MAML are able to learn a meta-prior from similar tasks to adapt to novel tasks from the same distribution with few gradient updates. One important limitation of such frameworks is that they seek a common…

Machine Learning · Computer Science 2018-12-19 Risto Vuorio , Shao-Hua Sun , Hexiang Hu , Joseph J. Lim

Unified multimodal models for image generation and understanding represent a significant step toward AGI and have attracted widespread attention from researchers. The main challenge of this task lies in the difficulty in establishing an…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Dian Zheng , Manyuan Zhang , Hongyu Li , Kai Zou , Hongbo Liu , Ziyu Guo , Kaituo Feng , Yexin Liu , Ying Luo , Hongsheng Li

Multi-modal methods establish comprehensive superiority over uni-modal methods. However, the imbalanced contributions of different modalities to task-dependent predictions constantly degrade the discriminative performance of canonical…

Machine Learning · Computer Science 2025-04-18 Yi Li , Fei Song , Changwen Zheng , Jiangmeng Li , Fuchun Sun , Hui Xiong

Two of the main principles underlying the life cycle of an artificial intelligence (AI) module in communication networks are adaptation and monitoring. Adaptation refers to the need to adjust the operation of an AI module depending on the…

Machine Learning · Computer Science 2023-01-11 Kfir M. Cohen , Sangwoo Park , Osvaldo Simeone , Shlomo Shamai

Model-agnostic meta-learners aim to acquire meta-learned parameters from similar tasks to adapt to novel tasks from the same distribution with few gradient updates. With the flexibility in the choice of models, those frameworks demonstrate…

Machine Learning · Computer Science 2019-10-31 Risto Vuorio , Shao-Hua Sun , Hexiang Hu , Joseph J. Lim

Multi-modal learning is a fast growing area in artificial intelligence. It tries to help machines understand complex things by combining information from different sources, like images, text, and audio. By using the strengths of each…

Machine Learning · Computer Science 2025-12-22 Qihang Jin , Enze Ge , Yuhang Xie , Hongying Luo , Junhao Song , Ziqian Bi , Chia Xin Liang , Jibin Guan , Joe Yeong , Xinyuan Song , Junfeng Hao

Multimodal video understanding plays a crucial role in tasks such as action recognition and emotion classification by combining information from different modalities. However, multimodal models are prone to overfitting strong modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Xiaoyu Ma , Ding Ding , Hao Chen

Neural networks produced by standard training are known to suffer from poor accuracy on rare subgroups despite achieving high accuracy on average, due to the correlations between certain spurious features and labels. Previous approaches…

Machine Learning · Computer Science 2024-04-10 Gaotang Li , Jiarui Liu , Wei Hu

While many approaches exist in the literature to learn low-dimensional representations for data collections in multiple modalities, the generalizability of multi-modal nonlinear embeddings to previously unseen data is a rather overlooked…

Machine Learning · Computer Science 2021-05-05 Semih Kaya , Elif Vural

Index modulation (IM) brings the reduction of power consumption and complexity of the transmitter to classical multiple-input multiple-output orthogonal frequency division multiplexing (MIMO-OFDM) systems. However, due to the introduction…

Signal Processing · Electrical Eng. & Systems 2019-11-14 Jinxue Liu , Hancheng Lu

Growing concerns over data privacy and security highlight the importance of machine unlearning--removing specific data influences from trained models without full retraining. Techniques like Membership Inference Attacks (MIAs) are widely…

Machine Learning · Computer Science 2025-06-09 Cheng-Long Wang , Qi Li , Zihang Xiang , Yinzhi Cao , Di Wang

Multimodal information retrieval (MIR) faces inherent challenges due to the heterogeneity of data sources and the complexity of cross-modal alignment. While previous studies have identified modal gaps in feature spaces, a systematic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Fanheng Kong , Jingyuan Zhang , Yahui Liu , Hongzhi Zhang , Shi Feng , Xiaocui Yang , Daling Wang , Yu Tian , Victoria W. , Fuzheng Zhang , Guorui Zhou

Multimodal learning integrates complementary information from diverse modalities to enhance the decision-making process. However, the potential of multimodal collaboration remains under-exploited due to disparities in data quality and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Chengxuan Qian , Kai Han , Jiaxin Liu , Zhenlong Yuan , Zhengzhong Zhu , Jingchao Wang , Chongwen Lyu , Jun Chen , Zhe Liu

Multimodal learning has shown significant superiority on various tasks by integrating multiple modalities. However, the interdependencies among modalities increase the susceptibility of multimodal models to adversarial attacks. Existing…

Machine Learning · Computer Science 2025-11-25 Junrui Zhang , Xinyu Zhao , Jie Peng , Chenjie Wang , Jianmin Ji , Tianlong Chen

Modern multi-agent systems ranging from sensor networks monitoring critical infrastructure to crowdsourcing platforms aggregating human intelligence can suffer significant performance degradation due to systematic biases that vary with…

Machine Learning · Computer Science 2025-10-31 Siavash M. Alamouti , Fay Arjomandi

Multimodal learning has become a prominent research area, with the potential of substantial performance gains by combining information across modalities. At the same time, model development has trended toward increasingly complex deep…

Machine Learning · Computer Science 2026-05-08 Tillmann Rheude , Roland Eils , Benjamin Wild

Medical decision systems increasingly rely on data from multiple sources to ensure reliable and unbiased diagnosis. However, existing multimodal learning models fail to achieve this goal because they often ignore two critical challenges.…

Machine Learning · Computer Science 2025-10-10 Md Zubair , Hao Zheng , Nussdorf Jonathan , Grayson W. Armstrong , Lucy Q. Shen , Gabriela Wilson , Yu Tian , Xingquan Zhu , Min Shi

Multimodal sentiment analysis (MSA) draws increasing attention with the availability of multimodal data. The boost in performance of MSA models is mainly hindered by two problems. On the one hand, recent MSA works mostly focus on learning…

Machine Learning · Computer Science 2021-11-17 Ying Zeng , Sijie Mai , Haifeng Hu

Recent advances in Multimodal Large Language Models (MLLMs) have shown promising results in integrating diverse modalities such as texts and images. MLLMs are heavily influenced by modality bias, often relying on language while…