English
Related papers

Related papers: Dealing with Missing Modalities in Multimodal Reco…

200 papers

Multi-modal recommendation systems aim to enhance performance by integrating an item's content features across various modalities with user behavior data. Effective utilization of features from different modalities requires addressing two…

Information Retrieval · Computer Science 2025-02-27 Hang Zhou , Yucheng Wang , Huijing Zhan

The rise of online multi-modal sharing platforms like TikTok and YouTube has enabled personalized recommender systems to incorporate multiple modalities (such as visual, textual, and acoustic) into user representations. However, addressing…

Information Retrieval · Computer Science 2024-06-18 Yangqin Jiang , Lianghao Xia , Wei Wei , Da Luo , Kangyi Lin , Chao Huang

Recent works in multimodal recommendations, which leverage diverse modal information to address data sparsity and enhance recommendation accuracy, have garnered considerable interest. Two key processes in multimodal recommendations are…

Information Retrieval · Computer Science 2025-05-23 Jinfeng Xu , Zheyu Chen , Wei Wang , Xiping Hu , Sang-Wook Kim , Edith C. H. Ngai

Multimodal recommendation aims to model user and item representations comprehensively with the involvement of multimedia content for effective recommendations. Existing research has shown that it is beneficial for recommendation performance…

Information Retrieval · Computer Science 2024-05-24 Yuting Liu , Enneng Yang , Yizhou Dang , Guibing Guo , Qiang Liu , Yuliang Liang , Linying Jiang , Xingwei Wang

Accurately recommending products has long been a subject requiring in-depth research. This study proposes a multimodal paradigm for clothing recommendations. Specifically, it designs a multimodal analysis method that integrates clothing…

Information Retrieval · Computer Science 2024-10-22 Bingjie Huang , Qingyi Lu , Shuaishuai Huang , Xue-she Wang , Haowei Yang

Missing modality issues are common in real-world applications, arising from factors such as equipment failures and privacy concerns. When fine-tuning pre-trained models on downstream datasets with missing modalities, performance can degrade…

Machine Learning · Computer Science 2025-03-04 Zirun Guo , Shulei Wang , Wang Lin , Weicai Yan , Yangyang Wu , Tao Jin

Missing modalities consistently lead to significant performance degradation in multimodal models. Existing approaches either synthesize missing modalities at high computational cost or apply prompt-based fine-tuning that relies only on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Hongye Zhu , Xuan Liu , Yanwen Ba , Jingye Xue , Shigeng Zhang

Acquiring valuable data from the rapidly expanding information on the internet has become a significant concern, and recommender systems have emerged as a widely used and effective tool for helping users discover items of interest. The…

Information Retrieval · Computer Science 2025-02-25 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Wei Wang , Xiping Hu , Steven Hoi , Edith Ngai

The rapid expansion of multimedia contents has led to the emergence of multimodal recommendation systems. It has attracted increasing attention in recommendation systems because its full utilization of data from different modalities…

Information Retrieval · Computer Science 2024-12-30 Zheyu Chen , Jinfeng Xu , Haibo Hu

Multimodal recommender systems leverage diverse data sources, such as user interactions, content features, and contextual information, to address challenges like cold-start and data sparsity. However, existing methods often suffer from one…

Information Retrieval · Computer Science 2026-02-24 Adamya Shyam , Venkateswara Rao Kagita , Bharti Rana , Vikas Kumar

Recently, multimodal prompting, which introduces learnable missing-aware prompts for all missing modality cases, has exhibited impressive performance. However, it encounters two critical issues: 1) The number of prompts grows exponentially…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Jaehyuk Jang , Yooseung Wang , Changick Kim

Multimodal learning typically relies on the assumption that all modalities are fully available during both the training and inference phases. However, in real-world scenarios, consistently acquiring complete multimodal data presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Donggeun Kim , Taesup Kim

Learning multimodal representations is a fundamentally complex research problem due to the presence of multiple heterogeneous sources of information. Although the presence of multiple modalities provides additional valuable information,…

Machine Learning · Computer Science 2019-05-15 Yao-Hung Hubert Tsai , Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency , Ruslan Salakhutdinov

Multimodal recommender systems enhance personalized recommendations in e-commerce and online advertising by integrating visual, textual, and user-item interaction data. However, existing methods often overlook two critical biases: (i) modal…

Information Retrieval · Computer Science 2025-10-15 Jie Yang , Chenyang Gu , Zixuan Liu

The development of multimodal models has significantly advanced multimodal sentiment analysis and emotion recognition. However, in real-world applications, the presence of various missing modality cases often leads to a degradation in the…

Computation and Language · Computer Science 2024-07-09 Zirun Guo , Tao Jin , Zhou Zhao

In recent years, multimodal recommendation has received significant attention and achieved remarkable success in GCN-based recommendation methods. However, there are two key challenges here: (1) There is a significant amount of redundant…

Information Retrieval · Computer Science 2026-04-07 Xiangchen Pan , Wei Wei

Multimodal recommender systems utilize various types of information to model user preferences and item features, helping users discover items aligned with their interests. The integration of multimodal information mitigates the inherent…

Information Retrieval · Computer Science 2024-02-20 Shanshan Zhong , Zhongzhan Huang , Daifeng Li , Wushao Wen , Jinghui Qin , Liang Lin

Multimodal recommendation combines the user historical behaviors with the modal features of items to capture the tangible user preferences, presenting superior performance compared to the conventional ID-based recommender systems. However,…

Information Retrieval · Computer Science 2026-01-27 Yuzhuo Dang , Xin Zhang , Zhiqiang Pan , Yuxiao Duan , Wanyu Chen , Fei Cai , Honghui Chen

Multimedia content is of predominance in the modern Web era. Investigating how users interact with multimodal items is a continuing concern within the rapid development of recommender systems. The majority of previous work focuses on…

Information Retrieval · Computer Science 2021-07-22 Jinghao Zhang , Yanqiao Zhu , Qiang Liu , Shu Wu , Shuhui Wang , Liang Wang

Recommendation systems have become popular and effective tools to help users discover their interesting items by modeling the user preference and item property based on implicit interactions (e.g., purchasing and clicking). Humans perceive…

Information Retrieval · Computer Science 2023-02-10 Hongyu Zhou , Xin Zhou , Zhiwei Zeng , Lingzi Zhang , Zhiqi Shen