English
Related papers

Related papers: STAIR: Manipulating Collaborative and Multimodal I…

200 papers

MultiModal Recommendation (MMR) systems have emerged as a promising solution for improving recommendation quality by leveraging rich item-side modality information, prompting a surge of diverse methods. Despite these advances, existing…

Information Retrieval · Computer Science 2025-08-25 Xiaoxiong Zhang , Xin Zhou , Zhiwei Zeng , Yongjie Wang , Dusit Niyato , Zhiqi Shen

Generally, items with missing modalities are dropped in multimodal recommendation. However, with this work, we question this procedure, highlighting that it would further damage the pipeline of any multimodal recommender system. First, we…

Information Retrieval · Computer Science 2024-08-22 Daniele Malitesta , Emanuele Rossi , Claudio Pomo , Tommaso Di Noia , Fragkiskos D. Malliaros

Recent advances in multimodal recommendation (MMR) highlight the potential of integrating visual and textual content to enrich item representations. However, existing methods often rely on coarse visual features and naive fusion strategies,…

Information Retrieval · Computer Science 2025-11-11 Hai-Dang Kieu , Min Xu , Thanh Trung Huynh , Dung D. Le

Multimodal image-tabular learning is gaining attention, yet it faces challenges due to limited labeled data. While earlier work has applied self-supervised learning (SSL) to unlabeled data, its task-agnostic nature often results in learning…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Siyi Du , Xinzhe Luo , Declan P. O'Regan , Chen Qin

In modern e-commerce, item content features in various modalities offer accurate yet comprehensive information to recommender systems. The majority of previous work either focuses on learning effective item representation during modelling…

Information Retrieval · Computer Science 2024-08-15 Hao Wu , Alejandro Ariza-Casabona , Bartłomiej Twardowski , Tri Kurniawan Wijaya

Multimodal Recommendation (MMR) systems are crucial for modern platforms but are often hampered by inherent noise and uncertainty in modal features, such as blurry images, diverse visual appearances, or ambiguous text. Existing methods…

Information Retrieval · Computer Science 2026-01-28 Xinzhuo Wu , Hongbo Wang , Yuan Lin , Kan Xu , Liang Yang , Hongfei Lin

Many recommender models have been proposed to investigate how to incorporate multimodal content information into traditional collaborative filtering framework effectively. The use of multimodal information is expected to provide more…

Information Retrieval · Computer Science 2024-08-14 Jinghao Zhang , Guofan Liu , Qiang Liu , Shu Wu , Liang Wang

Vision Language models (VLMs) have demonstrated strong performance across a wide range of benchmarks, yet they often suffer from modality dominance, where predictions rely disproportionately on a single modality. Prior approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Seulgi Kim , Mohit Prabhushankar , Ghassan AlRegib

Knowledge graphs (KGs) and multimodal item information, which respectively capture relational and attribute features, play a crucial role in improving recommender system accuracy. Recent studies have attempted to integrate them via…

Information Retrieval · Computer Science 2025-07-15 Jie Guo , Jiahao Jiang , Ziyuan Guo , Bin Song , Yue Sun

Interactive Recommender Systems (IRS) have been increasingly used in various domains, including personalized article recommendation, social media, and online advertising. However, IRS faces significant challenges in providing accurate…

Information Retrieval · Computer Science 2023-09-06 Jin Zhang , Defu Lian , Hong Xie , Yawen Li , Enhong Chen

With the rapid development of online multimedia services, especially in e-commerce platforms, there is a pressing need for personalised recommendation systems that can effectively encode the diverse multi-modal content associated with each…

Artificial Intelligence · Computer Science 2024-07-30 Zixuan Yi , Iadh Ounis

Multimedia-based recommendation provides personalized item suggestions by learning the content preferences of users. With the proliferation of digital devices and APPs, a huge number of new items are created rapidly over time. How to…

Information Retrieval · Computer Science 2024-05-28 Haoyue Bai , Le Wu , Min Hou , Miaomiao Cai , Zhuangzhuang He , Yuyang Zhou , Richang Hong , Meng Wang

In recent years, researchers attempt to utilize online social information to alleviate data sparsity for collaborative filtering, based on the rationale that social networks offers the insights to understand the behavioral patterns.…

Information Retrieval · Computer Science 2021-10-11 Xiaoling Long , Chao Huang , Yong Xu , Huance Xu , Peng Dai , Lianghao Xia , Liefeng Bo

The online emergence of multi-modal sharing platforms (eg, TikTok, Youtube) is powering personalized recommender systems to incorporate various modalities (eg, visual, textual and acoustic) into the latent user representations. While…

Information Retrieval · Computer Science 2023-07-19 Wei Wei , Chao Huang , Lianghao Xia , Chuxu Zhang

Multimodal recommendation systems (MMRS) have received considerable attention from the research community due to their ability to jointly utilize information from user behavior and product images and text. Previous research has two main…

Information Retrieval · Computer Science 2024-07-18 Guojiao Lin , Zhen Meng , Dongjie Wang , Qingqing Long , Yuanchun Zhou , Meng Xiao

Multimodal recommendation aims to model user and item representations comprehensively with the involvement of multimedia content for effective recommendations. Existing research has shown that it is beneficial for recommendation performance…

Information Retrieval · Computer Science 2024-05-24 Yuting Liu , Enneng Yang , Yizhou Dang , Guibing Guo , Qiang Liu , Yuliang Liang , Linying Jiang , Xingwei Wang

Multimodal recommendation systems are increasingly popular for their potential to improve performance by integrating diverse data types. However, the actual benefits of this integration remain unclear, raising questions about when and how…

Information Retrieval · Computer Science 2025-08-08 Hongyu Zhou , Yinan Zhang , Aixin Sun , Zhiqi Shen

Multimodal recommendation has emerged as an effective paradigm for enhancing collaborative filtering by incorporating heterogeneous content modalities. Existing multimodal recommenders predominantly focus on reinforcing cross-modal…

Information Retrieval · Computer Science 2026-03-03 Hao Zhan , Yihui Wang , Yonghui Yang , Danyang Yue , Yu Wang , Pengyang Shao , Fei Shen , Fei Liu , Le Wu

Multimedia content is of predominance in the modern Web era. In real scenarios, multiple modalities reveal different aspects of item attributes and usually possess different importance to user purchase decisions. However, it is difficult…

Information Retrieval · Computer Science 2023-06-27 Jinghao Zhang , Qiang Liu , Shu Wu , Liang Wang

Sequential recommendation systems that model dynamic preferences based on a use's past behavior are crucial to e-commerce. Recent studies on these systems have considered various types of information such as images and texts. However,…

Information Retrieval · Computer Science 2024-05-29 Hyungtaik Oh , Wonkeun Jo , Dongil Kim