English
Related papers

Related papers: Multimodality Invariant Learning for Multimedia-Ba…

200 papers

Although existing multimodal recommendation models have shown promising performance, their effectiveness continues to be limited by the pervasive data sparsity problem. This problem arises because users typically interact with only a small…

Information Retrieval · Computer Science 2025-12-10 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Zitong Wan , Hewei Wang , Weijie Liu , Yijie Li , Edith C. H. Ngai

Incomplete scenario is a prevalent, practical, yet challenging setting in Multimodal Recommendations (MMRec), where some item modalities are missing due to various factors. Recently, a few efforts have sought to improve the recommendation…

Information Retrieval · Computer Science 2025-02-25 Jin Li , Shoujin Wang , Qi Zhang , Shui Yu , Fang Chen

Most existing recommender systems represent a user's preference with a feature vector, which is assumed to be fixed when predicting this user's preferences for different items. However, the same vector cannot accurately capture a user's…

Information Retrieval · Computer Science 2019-08-22 Fan Liu , Zhiyong Cheng , Changchang Sun , Yinglong Wang , Liqiang Nie , Mohan Kankanhalli

Conventional recommendation systems succeed in identifying relevant content but often fail to provide users with surprising or novel items. Multimodal Large Language Models (MLLMs) possess the world knowledge and multimodal understanding…

Information Retrieval · Computer Science 2025-09-23 Haoting Wang , Jianling Wang , Hao Li , Fangjun Yi , Mengyu Fu , Youwei Zhang , Yifan Liu , Liang Liu , Minmin Chen , Ed H. Chi , Lichan Hong , Haokai Lu

Many recommendation systems limit user inputs to text strings or behavior signals such as clicks and purchases, and system outputs to a list of products sorted by relevance. With the advent of generative AI, users have come to expect richer…

With the development of multimedia systems, multimodal recommendations are playing an essential role, as they can leverage rich contexts beyond interactions. Existing methods mainly regard multimodal information as an auxiliary, using them…

Information Retrieval · Computer Science 2024-08-02 Yifan Liu , Kangning Zhang , Xiangyuan Ren , Yanhua Huang , Jiarui Jin , Yingjie Qin , Ruilong Su , Ruiwen Xu , Yong Yu , Weinan Zhang

Multimodal recommender systems utilize various types of information to model user preferences and item features, helping users discover items aligned with their interests. The integration of multimodal information mitigates the inherent…

Information Retrieval · Computer Science 2024-02-20 Shanshan Zhong , Zhongzhan Huang , Daifeng Li , Wushao Wen , Jinghui Qin , Liang Lin

Many multimodal recommender systems have been proposed to exploit the rich side information associated with users or items (e.g., user reviews and item images) for learning better user and item representations to improve the recommendation…

Information Retrieval · Computer Science 2022-10-26 Fan Liu , Huilin Chen , Zhiyong Cheng , Anan Liu , Liqiang Nie , Mohan Kankanhalli

With the rapid development of mobile Internet and big data, a huge amount of data is generated in the network, but the data that users are really interested in a very small portion. To extract the information that users are interested in…

Information Retrieval · Computer Science 2022-05-09 Bo Liu

Multimodal learning seeks to combine data from multiple input sources to enhance the performance of different downstream tasks. In real-world scenarios, performance can degrade substantially if some input modalities are missing. Existing…

Machine Learning · Computer Science 2024-10-10 Niki Nezakati , Md Kaykobad Reza , Ameya Patil , Mashhour Solh , M. Salman Asif

This paper studies the item-to-item recommendation problem in recommender systems from a new perspective of metric learning via implicit feedback. We develop and investigate a personalizable deep metric model that captures both the internal…

Information Retrieval · Computer Science 2022-03-24 Trong Nghia Hoang , Anoop Deoras , Tong Zhao , Jin Li , George Karypis

Multi-modal recommendation (MMR) enriches item representations by introducing item content, e.g., visual and textual descriptions, to improve upon interaction-only recommenders. The success of MMR hinges on aligning these content modalities…

Information Retrieval · Computer Science 2026-04-06 Jing Du , Zesheng Ye , Congbo Ma , Feng Liu , Flora. D. Salim

Generally, items with missing modalities are dropped in multimodal recommendation. However, with this work, we question this procedure, highlighting that it would further damage the pipeline of any multimodal recommender system. First, we…

Information Retrieval · Computer Science 2024-08-22 Daniele Malitesta , Emanuele Rossi , Claudio Pomo , Tommaso Di Noia , Fragkiskos D. Malliaros

In recent years, the rapid growth of online multimedia services, such as e-commerce platforms, has necessitated the development of personalised recommendation approaches that can encode diverse content about each item. Indeed, modern…

Information Retrieval · Computer Science 2023-11-06 Zixuan Yi , Zijun Long , Iadh Ounis , Craig Macdonald , Richard Mccreadie

With the increasing multimedia information, multimodal recommendation has received extensive attention. It utilizes multimodal information to alleviate the data sparsity problem in recommendation systems, thus improving recommendation…

Information Retrieval · Computer Science 2024-03-01 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Hewei Wang , Edith C. -H. Ngai

Nowadays, the recommendation systems are applied in the fields of e-commerce, video websites, social networking sites, etc., which bring great convenience to people's daily lives. The types of the information are diversified and abundant in…

Information Retrieval · Computer Science 2019-02-18 Junmei Lv , Bin Song , Jie Guo , Xiaojiang Du , Mohsen Guizani

In recent years, social media users have spent significant amounts of time on short-form video platforms. As a result, established platforms in other domains, such as e-commerce, have begun introducing short-form video content to engage…

Machine Learning · Computer Science 2025-09-05 Andrii Dzhoha , Katya Mirylenka , Egor Malykh , Marco-Andrea Buchmann , Francesca Catino

Due to the rapid growth of internet broadband access and proliferation of modern mobile devices, various types of multimedia (e.g. text, images, audios and videos) have become ubiquitously available anytime. Mobile device users usually…

Information Retrieval · Computer Science 2013-12-24 Feng Xia , Nana Yaw Asabere , Ahmedin Mohammed Ahmed , Jing Li , Xiangjie Kong

Session-based recommendation aims to predict intents of anonymous users based on limited behaviors. With the ability in alleviating data sparsity, contrastive learning is prevailing in the task. However, we spot that existing contrastive…

Information Retrieval · Computer Science 2025-06-06 Xiaokun Zhang , Bo Xu , Fenglong Ma , Zhizheng Wang , Liang Yang , Hongfei Lin

Semantically connecting users and items is a fundamental problem for the matching stage of an industrial recommender system. Recent advances in this topic are based on multi-channel retrieval to efficiently measure users' interest on items…

Information Retrieval · Computer Science 2022-02-15 Yujie Lu , Ping Nie , Shengyu Zhang , Ming Zhao , Ruobing Xie , William Yang Wang , Yi Ren