English
Related papers

Related papers: Improving Multi-modal Recommender Systems by Denoi…

200 papers

Multimodal sentiment analysis (MSA) draws increasing attention with the availability of multimodal data. The boost in performance of MSA models is mainly hindered by two problems. On the one hand, recent MSA works mostly focus on learning…

Machine Learning · Computer Science 2021-11-17 Ying Zeng , Sijie Mai , Haifeng Hu

In Conversational Recommendation Systems (CRS), a user provides feedback on recommended items at each turn, leading the CRS towards improved recommendations. Due to the need for a large amount of data, a user simulator is employed for both…

Information Retrieval · Computer Science 2025-07-25 Maria Vlachou

A recommender system generates personalized recommendations for a user by computing the preference score of items, sorting the items according to the score, and filtering top-K items with high scores. While sorting and ranking items are…

Information Retrieval · Computer Science 2020-12-08 Hyunsung Lee , Yeongjae Jang , Jaekwang Kim , Honguk Woo

Recommender systems traditionally represent items using unique identifiers (ItemIDs), but this approach struggles with large, dynamic item corpora and sparse long-tail data, limiting scalability and generalization. Semantic IDs, derived…

Information Retrieval · Computer Science 2026-03-03 Yi Xu , Moyu Zhang , Chenxuan Li , Zhihao Liao , Haibo Xing , Hao Deng , Jinxin Hu , Yu Zhang , Xiaoyi Zeng , Jing Zhang

Effectively leveraging multimodal data such as various images, laboratory tests and clinical information is gaining traction in a variety of AI-based medical diagnosis and prognosis tasks. Most existing multi-modal techniques only focus on…

Image and Video Processing · Electrical Eng. & Systems 2023-11-28 Yingying Fang , Shuang Wu , Sheng Zhang , Chaoyan Huang , Tieyong Zeng , Xiaodan Xing , Simon Walsh , Guang Yang

Generative Recommendation (GR) has emerged as a new paradigm in recommender systems. This approach relies on quantized representations to discretize item features, modeling users' historical interactions as sequences of discrete tokens.…

Information Retrieval · Computer Science 2025-11-25 Fuwei Zhang , Xiaoyu Liu , Dongbo Xi , Jishen Yin , Huan Chen , Peng Yan , Fuzhen Zhuang , Zhao Zhang

Recommender systems that learn from implicit feedback often use large volumes of a single type of implicit user feedback, such as clicks, to enhance the prediction of sparse target behavior such as purchases. Using multiple types of…

Information Retrieval · Computer Science 2023-05-10 Xin Xin , Xiangyuan Liu , Hanbing Wang , Pengjie Ren , Zhumin Chen , Jiahuan Lei , Xinlei Shi , Hengliang Luo , Joemon Jose , Maarten de Rijke , Zhaochun Ren

Recent advances in multi-modal large language models (MLLMs) have opened new possibilities for unified modeling of speech, text, images, and other modalities. Building on our prior work, this paper examines the conditions and model…

Sound · Computer Science 2025-07-28 Yiwen Guan , Viet Anh Trinh , Vivek Voleti , Jacob Whitehill

Multimedia recommendation has received much attention in recent years. It models user preferences based on both behavior information and item multimodal information. Though current GCN-based methods achieve notable success, they suffer from…

Information Retrieval · Computer Science 2023-08-08 Penghang Yu , Zhiyi Tan , Guanming Lu , Bing-Kun Bao

Recommendation systems have become popular and effective tools to help users discover their interesting items by modeling the user preference and item property based on implicit interactions (e.g., purchasing and clicking). Humans perceive…

Information Retrieval · Computer Science 2023-02-10 Hongyu Zhou , Xin Zhou , Zhiwei Zeng , Lingzi Zhang , Zhiqi Shen

As its availability and generality in online services, implicit feedback is more commonly used in recommender systems. However, implicit feedback usually presents noisy samples in real-world recommendation scenarios (such as misclicks or…

Information Retrieval · Computer Science 2024-05-29 Zhuangzhuang He , Yifan Wang , Yonghui Yang , Peijie Sun , Le Wu , Haoyue Bai , Jinqi Gong , Richang Hong , Min Zhang

Conversational recommender systems (CRSs) enhance recommendation quality by engaging users in multi-turn dialogues, capturing nuanced preferences through natural language interactions. However, these systems often face the false negative…

Information Retrieval · Computer Science 2025-08-11 Haozhe Xu , Xiaohua Wang , Changze Lv , Xiaoqing Zheng

This paper studies the multimodal named entity recognition (MNER) and multimodal relation extraction (MRE), which are important for multimedia social platform analysis. The core of MNER and MRE lies in incorporating evident visual…

Multimedia · Computer Science 2024-02-12 Shiyao Cui , Jiangxia Cao , Xin Cong , Jiawei Sheng , Quangang Li , Tingwen Liu , Jinqiao Shi

Sequential recommendations have drawn significant attention in modeling the user's historical behaviors to predict the next item. With the booming development of multimodal data (e.g., image, text) on internet platforms, sequential…

Information Retrieval · Computer Science 2024-12-12 Changhong Li , Zhiqiang Guo

Recommender systems have seen significant advancements with the influence of deep learning and graph neural networks, particularly in capturing complex user-item relationships. However, these graph-based recommenders heavily depend on…

Information Retrieval · Computer Science 2024-12-12 Xubin Ren , Wei Wei , Lianghao Xia , Lixin Su , Suqi Cheng , Junfeng Wang , Dawei Yin , Chao Huang

The explosion of multimedia data in information-rich environments has intensified the challenges of personalized content discovery, positioning recommendation systems as an essential form of passive data management. Multimodal sequential…

Information Retrieval · Computer Science 2026-03-05 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Hewei Wang , Yijie Li , Jianheng Tang , Yunhuai Liu , Edith C. H. Ngai

The ubiquity of implicit feedback makes them the default choice to build modern recommender systems. Generally speaking, observed interactions are considered as positive samples, while unobserved interactions are considered as negative…

Information Retrieval · Computer Science 2022-05-18 Yunjun Gao , Yuntao Du , Yujia Hu , Lu Chen , Xinjun Zhu , Ziquan Fang , Baihua Zheng

Interactive recommender systems (IRS) are increasingly optimized with Reinforcement Learning (RL) to capture the sequential nature of user-system dynamics. However, existing fairness-aware methods often suffer from a fundamental oversight:…

Machine Learning · Computer Science 2026-03-05 Yun Lu , Xiaoyu Shi , Hong Xie , Xiangyu Zhao , Mingsheng Shang

Medical Multi-modal Large Language Models (MLLMs) have shown promising clinical performance. However, their sensitivity to real-world input perturbations, such as imaging artifacts and textual errors, critically undermines their clinical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Dunyuan XU , Xikai Yang , Yaoqian Li , Juzheng Miao , Jinpeng Li , Pheng-Ann Heng

Conversational recommendation has advanced rapidly with large language models (LLMs), yet music remains a uniquely challenging domain in which effective recommendations require reasoning over audio content beyond what text or metadata can…

Sound · Computer Science 2026-01-26 Rohan Surana , Amit Namburi , Gagan Mundada , Abhay Lal , Zachary Novack , Julian McAuley , Junda Wu