English
Related papers

Related papers: Towards Trustworthy Multimodal Recommendation

200 papers

Recommender systems have long been built upon the modeling of interactions between users and items, while recent studies have sought to broaden this paradigm by generalizing to new users and items, incorporating diverse information sources,…

Information Retrieval · Computer Science 2025-10-28 Chanyoung Chung , Kyeongryul Lee , Sunbin Park , Joyce Jiyoung Whang

Multimodal recommender systems (RSs) represent items in the catalog through multimodal data (e.g., product images and descriptions) that, in some cases, might be noisy or (even worse) missing. In those scenarios, the common practice is to…

Information Retrieval · Computer Science 2026-02-20 Daniele Malitesta , Emanuele Rossi , Claudio Pomo , Tommaso Di Noia , Fragkiskos D. Malliaros

Most existing multimodal collaborative filtering recommendation (MCFRec) methods rely heavily on ID features and multimodal content to enhance recommendation performance. However, this paper reveals that ID features are effective but have…

Information Retrieval · Computer Science 2025-10-28 Guohao Li , Li Jing , Jia Wu , Xuefei Li , Kai Zhu , Yue He

Recommender Systems have proliferated as general-purpose approaches to model a wide variety of consumer interaction data. Specific instances make use of signals ranging from user feedback, item relationships, geographic locality, social…

Information Retrieval · Computer Science 2018-08-31 Wang-Cheng Kang , Mengting Wan , Julian McAuley

The rapid advances in e-commerce and Web 2.0 technologies have greatly increased the impact of commercial advertisements on the general public. As a key enabling technology, a multitude of recommender systems exists which analyzes user…

Artificial Intelligence · Computer Science 2017-09-13 Nikhita Vedula , Wei Sun , Hyunhwan Lee , Harsh Gupta , Mitsunori Ogihara , Joseph Johnson , Gang Ren , Srinivasan Parthasarathy

Multi-behavior recommendation faces a critical challenge in practice: auxiliary behaviors (e.g., clicks, carts) are often noisy, weakly correlated, or semantically misaligned with the target behavior (e.g., purchase), which leads to biased…

Information Retrieval · Computer Science 2026-01-22 Miaomiao Cai , Zhijie Zhang , Junfeng Fang , Zhiyong Cheng , Xiang Wang , Meng Wang

In recent years, the rapid growth of online multimedia services, such as e-commerce platforms, has necessitated the development of personalised recommendation approaches that can encode diverse content about each item. Indeed, modern…

Information Retrieval · Computer Science 2023-11-06 Zixuan Yi , Zijun Long , Iadh Ounis , Craig Macdonald , Richard Mccreadie

Multimodal recommendation systems (MMRS) have received considerable attention from the research community due to their ability to jointly utilize information from user behavior and product images and text. Previous research has two main…

Information Retrieval · Computer Science 2024-07-18 Guojiao Lin , Zhen Meng , Dongjie Wang , Qingqing Long , Yuanchun Zhou , Meng Xiao

Recommender systems rely heavily on user feedback to learn effective user and item representations. Despite their widespread adoption, limited attention has been given to the uncertainty inherent in the feedback used to train these systems.…

Information Retrieval · Computer Science 2025-05-06 Bruno Sguerra , Viet-Anh Tran , Romain Hennequin , Manuel Moussallam

Improving model robustness against potential modality noise, as an essential step for adapting multimodal models to real-world applications, has received increasing attention among researchers. For Multimodal Sentiment Analysis (MSA), there…

Multimedia · Computer Science 2022-11-28 Huisheng Mao , Baozheng Zhang , Hua Xu , Ziqi Yuan , Yihe Liu

Multimodal learning often grapples with the challenge of low-quality data, which predominantly manifests as two facets: modality imbalance and noisy corruption. While these issues are often studied in isolation, we argue that they share a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Xun Jiang , Yufan Gu , Disen Hu , Yuqing Hou , Yazhou Yao , Fumin Shen , Heng Tao Shen , Xing Xu

We study the problem of inferring substitutable and complementary items, which underpins applications such as alternative and follow-up purchase suggestions. Existing approaches typically learn from behavior-derived item-item associations…

Information Retrieval · Computer Science 2026-05-05 Junting Wang , Chenghuan Guo , Jiao Yang , Yanhui Guo , Hari Sundaram , Yan Gao

Converting different modalities into general text, serving as input prompts for large language models (LLMs), is a common method to align multimodal models when there is limited pairwise data. This text-centric approach leverages the unique…

Computation and Language · Computer Science 2024-07-09 Ting-Yu Yen , Yun-Da Tsai , Keng-Te Liao , Shou-De Lin

Multi-modal learning is a fast growing area in artificial intelligence. It tries to help machines understand complex things by combining information from different sources, like images, text, and audio. By using the strengths of each…

Machine Learning · Computer Science 2025-12-22 Qihang Jin , Enze Ge , Yuhang Xie , Hongying Luo , Junhao Song , Ziqian Bi , Chia Xin Liang , Jibin Guan , Joe Yeong , Xinyuan Song , Junfeng Hao

Context-aware recommendation systems improve upon classical recommender systems by including, in the modelling, a user's behaviour. Research into context-aware recommendation systems has previously only considered the sequential ordering of…

Information Retrieval · Computer Science 2022-10-20 Mufhumudzi Muthivhi , Terence L. van Zyl , Hairong Wang

Generative recommendation models often struggle with two key challenges: (1) the superficial integration of collaborative signals, and (2) the decoupled fusion of multimodal features. These limitations hinder the creation of a truly…

Information Retrieval · Computer Science 2025-12-29 Yuzhen Lin , Hongyi Chen , Xuanjing Chen , Shaowen Wang , Ivonne Xu , Dongming Jiang

Multimodal recommendation is commonly framed as a feature fusion problem, where textual and visual signals are combined to better model user preference. However, the effectiveness of multimodal recommendation may depend not only on how…

Information Retrieval · Computer Science 2026-03-16 Ty Valencia , Burak Barlas , Varun Singhal , Ruchir Bhatia , Wei Yang

Social media content routinely incorporates multi-modal design to covey information and shape meanings, and sway interpretations toward desirable implications, but the choices and outcomes of using both texts and visual images have not been…

Computation and Language · Computer Science 2023-03-13 Mesut Erhan Unal , Adriana Kovashka , Wen-Ting Chung , Yu-Ru Lin

As audio-visual systems are being deployed for safety-critical tasks such as surveillance and malicious content filtering, their robustness remains an under-studied area. Existing published work on robustness either does not scale to…

Sound · Computer Science 2022-04-22 Juncheng B Li , Shuhui Qu , Xinjian Li , Po-Yao Huang , Florian Metze

A major challenge in multimodal learning is the presence of noise within individual modalities. This noise inherently affects the resulting multimodal representations, especially when these representations are obtained through explicit…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Mohammad Zia Ur Rehman , Devraj Raghuvanshi , Umang Jain , Shubhi Bansal , Nagendra Kumar