English
Related papers

Related papers: Mirror Gradient: Towards Robust Multimodal Recomme…

200 papers

Multi-modal recommendation greatly enhances the performance of recommender systems by modeling the auxiliary information from multi-modality contents. Most existing multi-modal recommendation models primarily exploit multimedia information…

Information Retrieval · Computer Science 2024-07-09 Xinglong Wu , Anfeng Huang , Hongwei Yang , Hui He , Yu Tai , Weizhe Zhang

The increasing availability and diversity of multimodal data in recommender systems offer new avenues for enhancing recommendation accuracy and user satisfaction. However, these systems must contend with high-dimensional, sparse user-item…

Information Retrieval · Computer Science 2024-12-04 Yasser Khalafaoui , Martino Lovisetto , Basarab Matei , Nistor Grozavu

Multimodal recommender systems (MRSs) are critical for various online platforms, offering users more accurate personalized recommendations by incorporating multimodal information of items. Structure-based MRSs have achieved state-of-the-art…

Information Retrieval · Computer Science 2025-12-24 Ziyuan Guo , Jie Guo , Zhenghao Chen , Bin Song , Fei Richard Yu

With the prevalence of multimedia content on the Web, developing recommender solutions that can effectively leverage the rich signal in multimedia data is in urgent need. Owing to the success of deep neural networks in representation…

Information Retrieval · Computer Science 2019-05-30 Jinhui Tang , Xiaoyu Du , Xiangnan He , Fajie Yuan , Qi Tian , Tat-Seng Chua

Multimodal recommendation aims to recommend user-preferred candidates based on her/his historically interacted items and associated multimodal information. Previous studies commonly employ an embed-and-retrieve paradigm: learning user and…

Information Retrieval · Computer Science 2026-01-15 Han Liu , Yinwei Wei , Xuemeng Song , Weili Guan , Yuan-Fang Li , Liqiang Nie

Policy Mirror Descent (PMD) is a popular framework in reinforcement learning, serving as a unifying perspective that encompasses numerous algorithms. These algorithms are derived through the selection of a mirror map and enjoy finite-time…

Machine Learning · Statistics 2026-01-07 Carlo Alfano , Sebastian Towers , Silvia Sapora , Chris Lu , Patrick Rebeschini

A fundamental technique of recommender systems involves modeling user preferences, where queries and items are widely used as symbolic representations of user interests. Queries delineate user needs at an abstract level, providing a…

Information Retrieval · Computer Science 2024-12-17 Jiarui Jin , Xianyu Chen , Weinan Zhang , Yong Yu , Jun Wang

Recommender systems learn from historical user-item interactions to identify preferred items for target users. These observed interactions are usually unbalanced following a long-tailed distribution. Such long-tailed data lead to popularity…

Information Retrieval · Computer Science 2022-11-03 Weijieying Ren , Lei Wang , Kunpeng Liu , Ruocheng Guo , Lim Ee Peng , Yanjie Fu

Federated Recommendation (FR) is a new learning paradigm to tackle the learn-to-rank problem in a privacy-preservation manner. How to integrate multi-modality features into federated recommendation is still an open challenge in terms of…

Information Retrieval · Computer Science 2026-03-02 Chunxu Zhang , Weipeng Zhang , Guodong Long , Zhiheng Xue , Riting Xia , Bo Yang

With the increasing multimedia information, multimodal recommendation has received extensive attention. It utilizes multimodal information to alleviate the data sparsity problem in recommendation systems, thus improving recommendation…

Information Retrieval · Computer Science 2024-03-01 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Hewei Wang , Edith C. -H. Ngai

Multimedia content is of predominance in the modern Web era. Investigating how users interact with multimodal items is a continuing concern within the rapid development of recommender systems. The majority of previous work focuses on…

Information Retrieval · Computer Science 2021-07-22 Jinghao Zhang , Yanqiao Zhu , Qiang Liu , Shu Wu , Shuhui Wang , Liang Wang

In recent years, with the significant evolution of multi-modal large models, many recommender researchers realized the potential of multi-modal information for user interest modeling. In industry, a wide-used modeling architecture is a…

Multimodal recommendation has emerged as a mainstream paradigm, typically leveraging text and visual embeddings extracted from pre-trained models such as Sentence-BERT, Vision Transformers, and ResNet. This approach is founded on the…

Information Retrieval · Computer Science 2026-01-19 Yu Ye , Junchen Fu , Yu Song , Kaiwen Zheng , Joemon M. Jose

Traditional ID-based recommender systems often struggle with cold-start and generalization challenges. Multimodal recommendation systems, which leverage textual and visual data, offer a promising solution to mitigate these issues. However,…

Recent years have witnessed growing interests in multimedia recommendation, which aims to predict whether a user will interact with an item with multimodal contents. Previous studies focus on modeling user-item interactions with multimodal…

Information Retrieval · Computer Science 2022-03-18 Jinghao Zhang , Yanqiao Zhu , Qiang Liu , Mengqi Zhang , Shu Wu , Liang Wang

Multimodal learning has shown promising performance in content-based recommendation due to the auxiliary user and item information of multiple modalities such as text and images. However, the problem of incomplete and missing modality is…

Information Retrieval · Computer Science 2018-08-31 Cheng Wang , Mathias Niepert , Hui Li

Knowledge graphs (KGs) and multimodal item information, which respectively capture relational and attribute features, play a crucial role in improving recommender system accuracy. Recent studies have attempted to integrate them via…

Information Retrieval · Computer Science 2025-07-15 Jie Guo , Jiahao Jiang , Ziyuan Guo , Bin Song , Yue Sun

A recommender system generates personalized recommendations for a user by computing the preference score of items, sorting the items according to the score, and filtering top-K items with high scores. While sorting and ranking items are…

Information Retrieval · Computer Science 2020-12-08 Hyunsung Lee , Yeongjae Jang , Jaekwang Kim , Honguk Woo

Multi-modal models have shown a promising capability to effectively integrate information from various sources, yet meanwhile, they are found vulnerable to pervasive perturbations, such as uni-modal attacks and missing conditions. To…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Zequn Yang , Yake Wei , Ce Liang , Di Hu

Multimodal recommendation has emerged as a promising solution to alleviate the cold-start and sparsity problems in collaborative filtering by incorporating rich content information, such as product images and textual descriptions. However,…

Information Retrieval · Computer Science 2025-06-03 Sibei Liu , Yuanzhe Zhang , Xiang Li , Yunbo Liu , Chengwei Feng , Hao Yang