English
Related papers

Related papers: Cross-Modal Content Inference and Feature Enrichme…

200 papers

Multimodal recommendation has emerged as a promising solution to alleviate the cold-start and sparsity problems in collaborative filtering by incorporating rich content information, such as product images and textual descriptions. However,…

Information Retrieval · Computer Science 2025-06-03 Sibei Liu , Yuanzhe Zhang , Xiang Li , Yunbo Liu , Chengwei Feng , Hao Yang

Modern recommendation systems face significant challenges in processing multimodal sequential data, particularly in temporal dynamics modeling and information flow coordination. Traditional approaches struggle with distribution…

Information Retrieval · Computer Science 2025-08-29 Maolin Wang , Yutian Xiao , Binhao Wang , Sheng Zhang , Shanshan Ye , Wanyu Wang , Hongzhi Yin , Ruocheng Guo , Zenglin Xu

Multimodal recommendation combines the user historical behaviors with the modal features of items to capture the tangible user preferences, presenting superior performance compared to the conventional ID-based recommender systems. However,…

Information Retrieval · Computer Science 2026-01-27 Yuzhuo Dang , Xin Zhang , Zhiqiang Pan , Yuxiao Duan , Wanyu Chen , Fei Cai , Honghui Chen

Incomplete multi-modal emotion recognition (IMER) aims at understanding human intentions and sentiments by comprehensively exploring the partially observed multi-source data. Although the multi-modal data is expected to provide more…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Wen-Jue He , Xiaofeng Zhu , Zheng Zhang

Multimodal recommender systems utilize various types of information to model user preferences and item features, helping users discover items aligned with their interests. The integration of multimodal information mitigates the inherent…

Information Retrieval · Computer Science 2024-02-20 Shanshan Zhong , Zhongzhan Huang , Daifeng Li , Wushao Wen , Jinghui Qin , Liang Lin

While recommender systems with multi-modal item representations (image, audio, and text), have been widely explored, learning recommendations from multi-modal user interactions (e.g., clicks and speech) remains an open problem. We study the…

Information Retrieval · Computer Science 2024-05-08 Simone Borg Bruun , Krisztian Balog , Maria Maistro

Item representation learning (IRL) plays an essential role in recommender systems, especially for sequential recommendation. Traditional sequential recommendation models usually utilize ID embeddings to represent items, which are not shared…

Information Retrieval · Computer Science 2023-12-22 Shenghao Yang , Chenyang Wang , Yankai Liu , Kangping Xu , Weizhi Ma , Yiqun Liu , Min Zhang , Haitao Zeng , Junlan Feng , Chao Deng

Sequential recommendation systems often struggle to make predictions or take action when dealing with cold-start items that have limited amount of interactions. In this work, we propose SimRec - a new approach to mitigate the cold-start…

Information Retrieval · Computer Science 2024-10-30 Shaked Brody , Shoval Lagziel

In this paper we examine the ability of low-level multimodal features to extract movie similarity, in the context of a content-based movie recommendation approach. In particular, we demonstrate the extraction of multimodal representation…

Information Retrieval · Computer Science 2019-12-19 Konstantinos Bougiatiotis , Theodore Giannakopoulos

Recently, multimodal recommendations (MMR) have gained increasing attention for alleviating the data sparsity problem of traditional recommender systems by incorporating modality-based representations. Although MMR exhibits notable…

Information Retrieval · Computer Science 2025-06-12 Weixin Chen , Li Chen , Yongxin Ni , Yuhan Zhao

Recommender systems have become increasingly ubiquitous in daily life. While traditional recommendation approaches primarily rely on ID-based representations or item-side content features, they often fall short in capturing the underlying…

Information Retrieval · Computer Science 2025-08-12 Yunze Luo , Yinjie Jiang , Gaode Chen , Xinghua Zhang , Jun Zhang , Jian Liang , Kaigui Bian

Multimodal information (e.g., visual, acoustic, and textual) has been widely used to enhance representation learning for micro-video recommendation. For integrating multimodal information into a joint representation of micro-video,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Han Liu , Yinwei Wei , Fan Liu , Wenjie Wang , Liqiang Nie , Tat-Seng Chua

The surge in multimedia content has led to the development of Multi-Modal Recommender Systems (MMRecs), which use diverse modalities such as text, images, videos, and audio for more personalized recommendations. However, MMRecs struggle…

Information Retrieval · Computer Science 2025-04-22 Hongji Li , Hanwen Du , Youhua Li , Junchen Fu , Chunxiao Li , Ziyi Zhuang , Jiakang Li , Yongxin Ni

We introduce a multimodal dataset where users express preferences through images. These images encompass a broad spectrum of visual expressions ranging from landscapes to artistic depictions. Users request recommendations for books or music…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Se-eun Yoon , Hyunsik Jeon , Julian McAuley

The core of the general recommender systems lies in learning high-quality embedding representations of users and items to investigate their positional relations in the feature space. Unfortunately, data sparsity caused by…

Information Retrieval · Computer Science 2025-04-24 Yi Zhang , Yiwen Zhang

Conventional multimodal recommender systems predominantly leverage Bayesian Personalized Ranking (BPR) optimization to learn item representations by amalgamating item identity (ID) embeddings with multimodal features. Nevertheless, our…

Information Retrieval · Computer Science 2025-05-09 Xin Zhou , Xiaoxiong Zhang , Dusit Niyato , Zhiqi Shen

Recommender systems (RSs) offer personalized navigation experiences on online platforms, but recommendation remains a challenging task, particularly in specific scenarios and domains. Multimodality can help tap into richer information…

This paper proposes a cold start recommendation model that integrates contrastive learning, aiming to solve the problem of performance degradation of recommendation systems in cold start scenarios due to the scarcity of user and item…

Information Retrieval · Computer Science 2025-02-07 Jiacheng Hu , Tai An , Zidong Yu , Junliang Du , Yuanshuai Luo

Multimodal recommender systems enhance personalized recommendations in e-commerce and online advertising by integrating visual, textual, and user-item interaction data. However, existing methods often overlook two critical biases: (i) modal…

Information Retrieval · Computer Science 2025-10-15 Jie Yang , Chenyang Gu , Zixuan Liu

With the rapid development of mobile Internet and big data, a huge amount of data is generated in the network, but the data that users are really interested in a very small portion. To extract the information that users are interested in…

Information Retrieval · Computer Science 2022-05-09 Bo Liu