English
Related papers

Related papers: Joint Behavior-guided and Modality-coherence Condi…

200 papers

Multimodal recommender systems work by augmenting the representation of the products in the catalogue through multimodal features extracted from images, textual descriptions, or audio tracks characterising such products. Nevertheless, in…

Information Retrieval · Computer Science 2024-04-01 Daniele Malitesta , Emanuele Rossi , Claudio Pomo , Fragkiskos D. Malliaros , Tommaso Di Noia

Deep learning-based techniques for the analysis of multimodal remote sensing data have become popular due to their ability to effectively integrate complementary spatial, spectral, and structural information from different sensors.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Hao Liu , Yongjie Zheng , Yuhan Kang , Mingyang Zhang , Maoguo Gong , Lorenzo Bruzzone

Integrating diverse data modalities is crucial for enhancing the performance of personalized recommendation systems. Traditional models, which often rely on singular data sources, lack the depth needed to accurately capture the multifaceted…

Information Retrieval · Computer Science 2025-02-18 Luyi Ma , Xiaohan Li , Zezhong Fan , Kai Zhao , Jianpeng Xu , Jason Cho , Praveen Kanumala , Kaushiki Nag , Sushant Kumar , Kannan Achan

With the rapid development of imaging sensor technology in the field of remote sensing, multi-modal remote sensing data fusion has emerged as a crucial research direction for land cover classification tasks. While diffusion models have made…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 DaiXun Li , Weiying Xie , ZiXuan Wang , YiBing Lu , Yunsong Li , Leyuan Fang

Recent works in multimodal recommendations, which leverage diverse modal information to address data sparsity and enhance recommendation accuracy, have garnered considerable interest. Two key processes in multimodal recommendations are…

Information Retrieval · Computer Science 2025-05-23 Jinfeng Xu , Zheyu Chen , Wei Wang , Xiping Hu , Sang-Wook Kim , Edith C. H. Ngai

Multi-modal recommendation systems aim to enhance performance by integrating an item's content features across various modalities with user behavior data. Effective utilization of features from different modalities requires addressing two…

Information Retrieval · Computer Science 2025-02-27 Hang Zhou , Yucheng Wang , Huijing Zhan

A recent study has shown that diffusion models are well-suited for modeling the generative process of user-item interactions in recommender systems due to their denoising nature. However, existing diffusion model-based recommender systems…

Information Retrieval · Computer Science 2024-04-23 Yu Hou , Jin-Duk Park , Won-Yong Shin

Diffusion models arise as a powerful generative tool recently. Despite the great progress, existing diffusion models mainly focus on uni-modal control, i.e., the diffusion process is driven by only one modality of condition. To further…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Ziqi Huang , Kelvin C. K. Chan , Yuming Jiang , Ziwei Liu

Recovering user preferences from user-item interaction matrices is a key challenge in recommender systems. While diffusion models can sample and reconstruct preferences from latent distributions, they often fail to capture similar users'…

Information Retrieval · Computer Science 2025-01-03 Rui Xia , Yanhua Cheng , Yongxiang Tang , Xiaocheng Liu , Xialong Liu , Lisong Wang , Peng Jiang

Session-based recommendation aims to predict intents of anonymous users based on their limited behaviors. Modeling user behaviors involves two distinct rationales: co-occurrence patterns reflected by item IDs, and fine-grained preferences…

Information Retrieval · Computer Science 2024-04-22 Xiaokun Zhang , Bo Xu , Zhaochun Ren , Xiaochen Wang , Hongfei Lin , Fenglong Ma

Collaborative filtering (CF) is an important research direction in recommender systems that aims to make recommendations given the information on user-item interactions. Graph CF has attracted more and more attention in recent years due to…

Information Retrieval · Computer Science 2023-06-07 Jiayan Guo , Lun Du , Xu Chen , Xiaojun Ma , Qiang Fu , Shi Han , Dongmei Zhang , Yan Zhang

Diffusion models have emerged as powerful generative models for graph generation, yet their use for conditional graph generation remains a fundamental challenge. In particular, guiding diffusion models on graphs under arbitrary reward…

Machine Learning · Computer Science 2025-05-27 Victor M. Tenorio , Nicolas Zilberstein , Santiago Segarra , Antonio G. Marques

Multimodal recommender systems improve the performance of canonical recommender systems with no item features by utilizing diverse content types such as text, images, and videos, while alleviating inherent sparsity of user-item interactions…

Information Retrieval · Computer Science 2026-03-25 Yu-Seung Roh , Joo-Young Kim , Jin-Duk Park , Won-Yong Shin

With the rapid development of online multimedia services, especially in e-commerce platforms, there is a pressing need for personalised recommendation systems that can effectively encode the diverse multi-modal content associated with each…

Artificial Intelligence · Computer Science 2024-07-30 Zixuan Yi , Iadh Ounis

The surge in multimedia content has led to the development of Multi-Modal Recommender Systems (MMRecs), which use diverse modalities such as text, images, videos, and audio for more personalized recommendations. However, MMRecs struggle…

Information Retrieval · Computer Science 2025-04-22 Hongji Li , Hanwen Du , Youhua Li , Junchen Fu , Chunxiao Li , Ziyi Zhuang , Jiakang Li , Yongxin Ni

Graph Convolution Networks (GCNs), with their efficient ability to capture high-order connectivity in graphs, have been widely applied in recommender systems. Stacking multiple neighbor aggregation is the major operation in GCNs. It…

Information Retrieval · Computer Science 2022-10-11 Kang Liu , Feng Xue , Xiangnan He , Dan Guo , Richang Hong

Multi-modal recommendation (MMR) enriches item representations by introducing item content, e.g., visual and textual descriptions, to improve upon interaction-only recommenders. The success of MMR hinges on aligning these content modalities…

Information Retrieval · Computer Science 2026-04-06 Jing Du , Zesheng Ye , Congbo Ma , Feng Liu , Flora. D. Salim

The main idea of multimodal recommendation is the rational utilization of the item's multimodal information to improve the recommendation performance. Previous works directly integrate item multimodal features with item ID embeddings,…

Information Retrieval · Computer Science 2023-04-25 Yan Zhou , Jie Guo , Hao Sun , Bin Song , Fei Richard Yu

In modern e-commerce, item content features in various modalities offer accurate yet comprehensive information to recommender systems. The majority of previous work either focuses on learning effective item representation during modelling…

Information Retrieval · Computer Science 2024-08-15 Hao Wu , Alejandro Ariza-Casabona , Bartłomiej Twardowski , Tri Kurniawan Wijaya

Multimodal recommendation has emerged as a promising solution to alleviate the cold-start and sparsity problems in collaborative filtering by incorporating rich content information, such as product images and textual descriptions. However,…

Information Retrieval · Computer Science 2025-06-03 Sibei Liu , Yuanzhe Zhang , Xiang Li , Yunbo Liu , Chengwei Feng , Hao Yang