English
Related papers

Related papers: Teach Me How to Denoise: A Universal Framework for…

200 papers

This article presents a novel approach to multimodal recommendation systems, focusing on integrating and purifying multimodal data. Our methodology starts by developing a filter to remove noise from various types of data, making the…

Information Retrieval · Computer Science 2024-05-30 Mert Burabak , Tevfik Aytekin

Graph neural networks (GNNs) have become crucial in multimodal recommendation tasks because of their powerful ability to capture complex relationships between neighboring nodes. However, increasing the number of propagation layers in GNNs…

Multimedia · Computer Science 2024-11-05 Feng Mo , Lin Xiao , Qiya Song , Xieping Gao , Eryao Liang

With the increasing multimedia information, multimodal recommendation has received extensive attention. It utilizes multimodal information to alleviate the data sparsity problem in recommendation systems, thus improving recommendation…

Information Retrieval · Computer Science 2024-03-01 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Hewei Wang , Edith C. -H. Ngai

With the development of multimedia systems, multimodal recommendations are playing an essential role, as they can leverage rich contexts beyond interactions. Existing methods mainly regard multimodal information as an auxiliary, using them…

Information Retrieval · Computer Science 2024-08-02 Yifan Liu , Kangning Zhang , Xiangyuan Ren , Yanhua Huang , Jiarui Jin , Yingjie Qin , Ruilong Su , Ruiwen Xu , Yong Yu , Weinan Zhang

This paper presents an open-source toolbox, MMRec for multimodal recommendation. MMRec simplifies and canonicalizes the process of implementing and comparing multimodal recommendation models. The objective of MMRec is to provide a unified…

Information Retrieval · Computer Science 2024-02-09 Xin Zhou

In recent years, multimodal recommendation has received significant attention and achieved remarkable success in GCN-based recommendation methods. However, there are two key challenges here: (1) There is a significant amount of redundant…

Information Retrieval · Computer Science 2026-04-07 Xiangchen Pan , Wei Wei

Large language models have recently shown promise for multimodal recommendation, particularly with text and image inputs. Yet real-world recommendation signals extend far beyond these modalities. To reflect this, we formalize recommendation…

Information Retrieval · Computer Science 2026-05-01 Zijie Lei , Tao Feng , Zhigang Hua , Yan Xie , Guanyu Lin , Shuang Yang , Ge Liu , Jiaxuan You

Video multimodal fusion aims to integrate multimodal signals in videos, such as visual, audio and text, to make a complementary prediction with multiple modalities contents. However, unlike other image-text multimodal tasks, video has…

Computation and Language · Computer Science 2023-06-01 Shaoxiang Wu , Damai Dai , Ziwei Qin , Tianyu Liu , Binghuai Lin , Yunbo Cao , Zhifang Sui

Implicit feedback, such as user clicks, serves as the primary data source for modern recommender systems. However, click interactions inherently contain substantial noise, including accidental clicks, clickbait-induced interactions, and…

Information Retrieval · Computer Science 2026-02-18 Xikai Yang , Yang Wang , Yilin Li , Sebastian Sun

Traditional sequential recommendation methods assume that users' sequence data is clean enough to learn accurate sequence representations to reflect user preferences. In practice, users' sequences inevitably contain noise (e.g., accidental…

Information Retrieval · Computer Science 2024-03-08 Chi Zhang , Qilong Han , Rui Chen , Xiangyu Zhao , Peng Tang , Hongtao Song

In practical recommendation scenarios, users often interact with items under multi-typed behaviors (e.g., click, add-to-cart, and purchase). Traditional collaborative filtering techniques typically assume that users only have a single type…

Information Retrieval · Computer Science 2023-02-14 Chi Zhang , Rui Chen , Xiangyu Zhao , Qilong Han , Li Li

Implicit feedback is central to modern recommender systems but is inherently noisy, often impairing model training and degrading user experience. At scale, such noise can mislead learning processes, reducing both recommendation accuracy and…

Information Retrieval · Computer Science 2025-10-13 Ze Liu , Xianquan Wang , Shuochen Liu , Jie Ma , Huibo Xu , Yupeng Han , Kai Zhang , Jun Zhou

The importance of recommender systems is growing rapidly due to the exponential increase in the volume of content generated daily. This surge in content presents unique challenges for designing effective recommender systems. Key among these…

Computation and Language · Computer Science 2025-06-12 Jiahao Tian , Jinman Zhao , Zhenkai Wang , Zhicheng Ding

Implicit feedback -- the main data source for training Recommender Systems (RSs) -- is inherently noisy and has been shown to negatively affect recommendation effectiveness. Denoising has been proposed as a method for removing noisy…

Information Retrieval · Computer Science 2026-01-27 Ervin Dervishaj , Maria Maistro , Tuukka Ruotsalo , Christina Lioma

This study aims to construct an audio-video generative model with minimal computational cost by leveraging pre-trained single-modal generative models for audio and video. To achieve this, we propose a novel method that guides single-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Akio Hayakawa , Masato Ishii , Takashi Shibuya , Yuki Mitsufuji

The success of speech-image retrieval relies on establishing an effective alignment between speech and image. Existing methods often model cross-modal interaction through simple cosine similarity of the global feature of each modality,…

Computation and Language · Computer Science 2024-09-12 Lifeng Zhou , Yuke Li , Rui Deng , Yuting Yang , Haoqi Zhu

We study the problem of inferring substitutable and complementary items, which underpins applications such as alternative and follow-up purchase suggestions. Existing approaches typically learn from behavior-derived item-item associations…

Information Retrieval · Computer Science 2026-05-05 Junting Wang , Chenghuan Guo , Jiao Yang , Yanhui Guo , Hari Sundaram , Yan Gao

Multi-modal sequential recommendation systems leverage auxiliary signals (e.g., text, images) to alleviate data sparsity in user-item interactions. While recent methods exploit large language models to encode modalities into discrete…

Information Retrieval · Computer Science 2025-04-10 Kaiyuan Li , Rui Xiang , Yong Bai , Yongxiang Tang , Yanhua Cheng , Xialong Liu , Peng Jiang , Kun Gai

Recommender systems have long been built upon the modeling of interactions between users and items, while recent studies have sought to broaden this paradigm by generalizing to new users and items, incorporating diverse information sources,…

Information Retrieval · Computer Science 2025-10-28 Chanyoung Chung , Kyeongryul Lee , Sunbin Park , Joyce Jiyoung Whang

Modern recommendation systems face significant challenges in processing multimodal sequential data, particularly in temporal dynamics modeling and information flow coordination. Traditional approaches struggle with distribution…

Information Retrieval · Computer Science 2025-08-29 Maolin Wang , Yutian Xiao , Binhao Wang , Sheng Zhang , Shanshan Ye , Wanyu Wang , Hongzhi Yin , Ruocheng Guo , Zenglin Xu