English
Related papers

Related papers: Do We Really Need to Drop Items with Missing Modal…

200 papers

Multimodal learning considers learning from multi-modality data, aiming to fuse heterogeneous sources of information. However, it is not always feasible to leverage all available modalities due to memory constraints. Further, training on…

Machine Learning · Computer Science 2022-10-25 Runxiang Cheng , Gargi Balasubramaniam , Yifei He , Yao-Hung Hubert Tsai , Han Zhao

Multimodal learning leverages the integration of diverse data modalities to enhance performance in complex tasks. Yet, it frequently encounters incomplete or redundant modality data in real-world scenarios. This paper presents a…

Machine Learning · Computer Science 2026-05-05 Richeng Zhou , Xuelin Zhang , Liyuan Liu

Recommender Systems have proliferated as general-purpose approaches to model a wide variety of consumer interaction data. Specific instances make use of signals ranging from user feedback, item relationships, geographic locality, social…

Information Retrieval · Computer Science 2018-08-31 Wang-Cheng Kang , Mengting Wan , Julian McAuley

With the development of information technology, human beings are constantly producing a large amount of information at all times. How to obtain the information that users are interested in from the large amount of information has become an…

Information Retrieval · Computer Science 2021-10-22 Mingbao Yang , ShaoBo Li , Zhou Peng , Ansi Zhang , Yuanmeng Zhang

Sequential recommendations have drawn significant attention in modeling the user's historical behaviors to predict the next item. With the booming development of multimodal data (e.g., image, text) on internet platforms, sequential…

Information Retrieval · Computer Science 2024-12-12 Changhong Li , Zhiqiang Guo

During multimodal model training and testing, certain data modalities may be absent due to sensor limitations, cost constraints, privacy concerns, or data loss, negatively affecting performance. Multimodal learning techniques designed to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Renjie Wu , Hu Wang , Hsiang-Ting Chen , Gustavo Carneiro

Missing modalities are a common challenge in real-world multimodal learning scenarios, occurring during both training and testing. Existing methods for managing missing modalities often require the design of separate prompts for each…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Zhe Chen , Xun Lin , Yawen Cui , Zitong Yu

Recently, multimodal recommendations (MMR) have gained increasing attention for alleviating the data sparsity problem of traditional recommender systems by incorporating modality-based representations. Although MMR exhibits notable…

Information Retrieval · Computer Science 2025-06-12 Weixin Chen , Li Chen , Yongxin Ni , Yuhan Zhao

While the mining of modalities is the focus of most multimodal recommendation methods, we believe that how to fully utilize both collaborative and multimodal information is pivotal in e-commerce scenarios where, as clarified in this work,…

Information Retrieval · Computer Science 2024-12-17 Cong Xu , Yunhang He , Jun Wang , Wei Zhang

Multimodal learning often outperforms its unimodal counterparts by exploiting unimodal contributions and cross-modal interactions. However, focusing only on integrating multimodal features into a unified comprehensive representation…

Machine Learning · Computer Science 2025-05-15 Sehwan Moon , Hyunju Lee

Multimedia content is of predominance in the modern Web era. Investigating how users interact with multimodal items is a continuing concern within the rapid development of recommender systems. The majority of previous work focuses on…

Information Retrieval · Computer Science 2021-07-22 Jinghao Zhang , Yanqiao Zhu , Qiang Liu , Shu Wu , Shuhui Wang , Liang Wang

Multimodal deep learning systems which employ multiple modalities like text, image, audio, video, etc., are showing better performance in comparison with individual modalities (i.e., unimodal) systems. Multimodal machine learning involves…

Machine Learning · Computer Science 2022-01-19 Anil Rahate , Rahee Walambe , Sheela Ramanna , Ketan Kotecha

MultiModal Recommendation (MMR) systems have emerged as a promising solution for improving recommendation quality by leveraging rich item-side modality information, prompting a surge of diverse methods. Despite these advances, existing…

Information Retrieval · Computer Science 2025-08-25 Xiaoxiong Zhang , Xin Zhou , Zhiwei Zeng , Yongjie Wang , Dusit Niyato , Zhiqi Shen

Multimodal Recommendation (MMR) systems are crucial for modern platforms but are often hampered by inherent noise and uncertainty in modal features, such as blurry images, diverse visual appearances, or ambiguous text. Existing methods…

Information Retrieval · Computer Science 2026-01-28 Xinzhuo Wu , Hongbo Wang , Yuan Lin , Kan Xu , Liang Yang , Hongfei Lin

Multi-modal recommendation systems aim to enhance performance by integrating an item's content features across various modalities with user behavior data. Effective utilization of features from different modalities requires addressing two…

Information Retrieval · Computer Science 2025-02-27 Hang Zhou , Yucheng Wang , Huijing Zhan

Multimodal Recommender Systems aim to improve recommendation accuracy by integrating heterogeneous content, such as images and textual metadata. While effective, it remains unclear whether their gains stem from true multimodal understanding…

Information Retrieval · Computer Science 2025-08-07 Claudio Pomo , Matteo Attimonelli , Danilo Danese , Fedelucio Narducci , Tommaso Di Noia

Multimodal recommendation has attracted extensive attention by leveraging heterogeneous modality information to alleviate data sparsity and improve recommendation accuracy. Existing methods have attempted to replace ID embeddings with…

Information Retrieval · Computer Science 2026-05-19 Hongjian Ma , Wenxin Huang , Yan Zhang , Zhifei Li , Zheng Wang

With the explosive growth of multimodal content online, pre-trained visual-language models have shown great potential for multimodal recommendation. However, while these models achieve decent performance when applied in a frozen manner,…

Information Retrieval · Computer Science 2025-02-24 Wenyu Zhang , Jie Luo , Xinming Zhang , Yuan Fang

Missing data is a common problem in machine learning and in retrospective imaging research it is often encountered in the form of missing imaging modalities. We propose to take into account missing modalities in the design and training of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Karin van Garderen , Marion Smits , Stefan Klein

With the increasing multimedia information, multimodal recommendation has received extensive attention. It utilizes multimodal information to alleviate the data sparsity problem in recommendation systems, thus improving recommendation…

Information Retrieval · Computer Science 2024-03-01 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Hewei Wang , Edith C. -H. Ngai