English
Related papers

Related papers: MM-GEF: Multi-modal representation meet collaborat…

200 papers

Multi-modal recommendation systems aim to enhance performance by integrating an item's content features across various modalities with user behavior data. Effective utilization of features from different modalities requires addressing two…

Information Retrieval · Computer Science 2025-02-27 Hang Zhou , Yucheng Wang , Huijing Zhan

In sequential recommendation, multi-modal information (e.g., text or image) can provide a more comprehensive view of an item's profile. The optimal stage (early or late) to fuse modality features into item representations is still debated.…

Information Retrieval · Computer Science 2023-08-31 Hengchang Hu , Wei Guo , Yong Liu , Min-Yen Kan

User and item attributes are essential side-information; their interactions (i.e., their co-occurrence in the sample data) can significantly enhance prediction accuracy in various recommender systems. We identify two different types of…

Information Retrieval · Computer Science 2021-07-26 Yixin Su , Rui Zhang , Sarah Erfani , Junhao Gan

MultiModal Recommendation (MMR) systems have emerged as a promising solution for improving recommendation quality by leveraging rich item-side modality information, prompting a surge of diverse methods. Despite these advances, existing…

Information Retrieval · Computer Science 2025-08-25 Xiaoxiong Zhang , Xin Zhou , Zhiwei Zeng , Yongjie Wang , Dusit Niyato , Zhiqi Shen

Learning vector representations (aka. embeddings) of users and items lies at the core of modern recommender systems. Ranging from early matrix factorization to recently emerged deep learning based methods, existing efforts typically obtain…

Information Retrieval · Computer Science 2020-07-06 Xiang Wang , Xiangnan He , Meng Wang , Fuli Feng , Tat-Seng Chua

While deep-learning-enabled recommender systems demonstrate strong performance benchmarks, many struggle to adapt effectively in real-world environments due to limited use of user-item relationship data and insufficient transparency in…

Machine Learning · Computer Science 2025-01-09 Dong Hyun Jeon , Wenbo Sun , Houbing Herbert Song , Dongfang Liu , Velasquez Alvaro , Yixin Chloe Xie , Shuteng Niu

Multimodal information (e.g., visual, acoustic, and textual) has been widely used to enhance representation learning for micro-video recommendation. For integrating multimodal information into a joint representation of micro-video,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Han Liu , Yinwei Wei , Fan Liu , Wenjie Wang , Liqiang Nie , Tat-Seng Chua

Multimedia recommendation aims to fuse the multi-modal information of items for feature enrichment to improve the recommendation performance. However, existing methods typically introduce multi-modal information based on collaborative…

Information Retrieval · Computer Science 2023-07-07 Haokai Ma , Zhuang Qi , Xinxin Dong , Xiangxian Li , Yuze Zheng , Xiangxu Mengand Lei Meng

Many recommendation systems limit user inputs to text strings or behavior signals such as clicks and purchases, and system outputs to a list of products sorted by relevance. With the advent of generative AI, users have come to expect richer…

Multimodal recommendation combines the user historical behaviors with the modal features of items to capture the tangible user preferences, presenting superior performance compared to the conventional ID-based recommender systems. However,…

Information Retrieval · Computer Science 2026-01-27 Yuzhuo Dang , Xin Zhang , Zhiqiang Pan , Yuxiao Duan , Wanyu Chen , Fei Cai , Honghui Chen

Incorporating multi-modal features as side information has recently become a trend in recommender systems. To elucidate user-item preferences, recent studies focus on fusing modalities via concatenation, element-wise sum, or attention…

Information Retrieval · Computer Science 2024-12-20 Rongqing Kenneth Ong , Andy W. H. Khong

Multimedia recommendation has received much attention in recent years. It models user preferences based on both behavior information and item multimodal information. Though current GCN-based methods achieve notable success, they suffer from…

Information Retrieval · Computer Science 2023-08-08 Penghang Yu , Zhiyi Tan , Guanming Lu , Bing-Kun Bao

Side information of items, e.g., images and text description, has shown to be effective in contributing to accurate recommendations. Inspired by the recent success of pre-training models on natural language and images, we propose a…

Information Retrieval · Computer Science 2021-01-08 Yong Liu , Susen Yang , Chenyi Lei , Guoxin Wang , Haihong Tang , Juyong Zhang , Aixin Sun , Chunyan Miao

This paper proposes a learning model, based on rank-fusion graphs, for general applicability in multimodal prediction tasks, such as multimodal regression and image classification. Rank-fusion graphs encode information from multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Icaro Cavalcante Dourado , Salvatore Tabbone , Ricardo da Silva Torres

Cold-start is a very common and still open problem in the Recommender Systems literature. Since cold start items do not have any interaction, collaborative algorithms are not applicable. One of the main strategies is to use pure or hybrid…

Machine Learning · Computer Science 2019-07-16 Cesare Bernardis , Maurizio Ferrari Dacrema , Paolo Cremonesi

Recommending appropriate tags to items can facilitate content organization, retrieval, consumption and other applications, where hybrid tag recommender systems have been utilized to integrate collaborative information and content…

Information Retrieval · Computer Science 2022-04-21 Jing Yi , Xubin Ren , Zhenzhong Chen

Many previous studies aim to augment collaborative filtering with deep neural network techniques, so as to achieve better recommendation performance. However, most existing deep learning-based recommender systems are designed for modeling…

Information Retrieval · Computer Science 2022-03-29 Lianghao Xia , Chao Huang , Yong Xu , Peng Dai , Mengyin Lu , Liefeng Bo

Multi-modal recommendation (MMR) enriches item representations by introducing item content, e.g., visual and textual descriptions, to improve upon interaction-only recommenders. The success of MMR hinges on aligning these content modalities…

Information Retrieval · Computer Science 2026-04-06 Jing Du , Zesheng Ye , Congbo Ma , Feng Liu , Flora. D. Salim

Knowledge graph (KG) enhanced recommendation has demonstrated improved performance in the recommendation system (RecSys) and attracted considerable research interest. Recently the literature has adopted neural graph networks (GNNs) on the…

Information Retrieval · Computer Science 2022-11-15 Liangwei Yang , Shen Wang , Jibing Gong , Shaojie Zheng , Shuying Du , Zhiwei Liu , Philip S. Yu

Generative recommendation (GR) has become a powerful paradigm in recommendation systems that implicitly links modality and semantics to item representation, in contrast to previous methods that relied on non-semantic item identifiers in…

Information Retrieval · Computer Science 2025-04-01 Jing Zhu , Mingxuan Ju , Yozen Liu , Danai Koutra , Neil Shah , Tong Zhao