English
Related papers

Related papers: Beyond Unimodal Boundaries: Generative Recommendat…

200 papers

Sequential Recommender Systems (SRS), which model a user's interaction history to predict the next item of interest, are widely used in various applications. However, existing SRS often struggle with low-popularity items, a challenge known…

Information Retrieval · Computer Science 2024-12-24 Qidong Liu , Xian Wu , Wanyu Wang , Yejing Wang , Yuanshao Zhu , Xiangyu Zhao , Feng Tian , Yefeng Zheng

Multimodal Attributed Graphs (MAGs) are ubiquitous in real-world applications, encompassing extensive knowledge through multimodal attributes attached to nodes (e.g., texts and images) and topological structure representing node…

Machine Learning · Computer Science 2025-02-28 Hao Yan , Chaozhuo Li , Jun Yin , Zhigang Yu , Weihao Han , Mingzheng Li , Zhengxin Zeng , Hao Sun , Senzhang Wang

Large language models provide rich semantic priors and strong reasoning capabilities, making them promising auxiliary signals for recommendation. However, prevailing approaches either deploy LLMs as standalone recommender or apply global…

Information Retrieval · Computer Science 2025-12-29 Shanglin Yang , Zhan Shi

The recommender system (RS) has been an integral toolkit of online services. They are equipped with various deep learning techniques to model user preference based on identifier and attribute information. With the emergence of multimedia…

Information Retrieval · Computer Science 2024-09-05 Qidong Liu , Jiaxi Hu , Yutian Xiao , Xiangyu Zhao , Jingtong Gao , Wanyu Wang , Qing Li , Jiliang Tang

Current research on Multimodal Retrieval-Augmented Generation (MRAG) enables diverse multimodal inputs but remains limited to single-modality outputs, restricting expressive capacity and practical utility. In contrast, real-world…

Information Retrieval · Computer Science 2025-08-11 Zhiyou Xiao , Qinhan Yu , Binghui Li , Geng Chen , Chong Chen , Wentao Zhang

To address the challenge of information overload from massive web contents, recommender systems are widely applied to retrieve and present personalized results for users. However, recommendation tasks are inherently constrained to filtering…

Artificial Intelligence · Computer Science 2025-06-04 Jiongnan Liu , Zhicheng Dou , Ning Hu , Chenyan Xiong

Large Language Models (LLMs) often suffer from hallucinations, which Retrieval-Augmented Generation (RAG) and GraphRAG mitigate by incorporating external knowledge and knowledge graphs (KGs). However, GraphRAG remains text-centric due to…

Artificial Intelligence · Computer Science 2026-03-11 Xueyao Wan , Hang Yu

Generative recommendation has recently emerged as a powerful paradigm that unifies retrieval and generation, representing items as discrete semantic tokens and enabling flexible sequence modeling with autoregressive models. Despite its…

Computation and Language · Computer Science 2025-11-27 Zheng Hui , Xiaokai Wei , Reza Shirkavand , Chen Wang , Weizhi Zhang , Alejandro Peláez , Michelle Gong

Grounded Multimodal Named Entity Recognition (GMNER) aims to extract text-based entities, assign them semantic categories, and ground them to corresponding visual regions. In this work, we explore the potential of Multimodal Large Language…

Computation and Language · Computer Science 2026-02-05 Jinlong Ma , Yu Zhang , Xuefeng Bai , Kehai Chen , Yuwei Wang , Zeming Liu , Jun Yu , Min Zhang

Large Language Models (LLMs) have demonstrated exceptional proficiency in text understanding and embedding tasks. However, their potential in multimodal representation, particularly for item-to-item (I2I) recommendations, remains…

Information Retrieval · Computer Science 2025-01-22 Chao Zhang , Haoxin Zhang , Shiwei Wu , Di Wu , Tong Xu , Xiangyu Zhao , Yan Gao , Yao Hu , Enhong Chen

The success of recommender systems in modern online platforms is inseparable from the accurate capture of users' personal tastes. In everyday life, large amounts of user feedback data are created along with user-item online interactions in…

Machine Learning · Computer Science 2019-06-25 Xiao Zhou , Danyang Liu , Jianxun Lian , Xing Xie

Generative Recommendation (GR) has excelled by framing recommendation as next-token prediction. This paradigm relies on Semantic IDs (SIDs) to tokenize large-scale items into discrete sequences. Existing GR approaches predominantly generate…

Information Retrieval · Computer Science 2026-05-22 Jie Jiang , Xinxun Zhang , Enming Zhang , Yuling Xiong , Jun Zhang , Jingwen Wang , Huan Yu , Yuxiang Wang , Hao Wang , Xiao Yan , Jiawei Jiang

Human perception integrates multiple modalities, such as vision, hearing, and language, into a unified understanding of the surrounding reality. While recent multimodal models have achieved significant progress by aligning pairs of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Giordano Cicchetti , Eleonora Grassucci , Luigi Sigillo , Danilo Comminiello

Group Recommendation (GR), which aims to recommend items to groups of users, has become a promising and practical direction for recommendation systems. This paper points out two issues of the state-of-the-art GR models. (1) The pre-defined…

Information Retrieval · Computer Science 2024-11-01 Yue Liu , Shihao Zhu , Tianyuan Yang , Jian Ma , Wenliang Zhong

Multimodal learning has shown promising performance in content-based recommendation due to the auxiliary user and item information of multiple modalities such as text and images. However, the problem of incomplete and missing modality is…

Information Retrieval · Computer Science 2018-08-31 Cheng Wang , Mathias Niepert , Hui Li

Many previous studies aim to augment collaborative filtering with deep neural network techniques, so as to achieve better recommendation performance. However, most existing deep learning-based recommender systems are designed for modeling…

Information Retrieval · Computer Science 2022-03-29 Lianghao Xia , Chao Huang , Yong Xu , Peng Dai , Mengyin Lu , Liefeng Bo

Generative recommendation systems, driven by large language models (LLMs), present an innovative approach to predicting user preferences by modeling items as token sequences and generating recommendations in a generative manner. A critical…

Recent works in multimodal recommendations, which leverage diverse modal information to address data sparsity and enhance recommendation accuracy, have garnered considerable interest. Two key processes in multimodal recommendations are…

Information Retrieval · Computer Science 2025-05-23 Jinfeng Xu , Zheyu Chen , Wei Wang , Xiping Hu , Sang-Wook Kim , Edith C. H. Ngai

Large Language Models (LLMs) have been integrated into recommender systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant items…

Information Retrieval · Computer Science 2025-03-27 Sichun Luo , Jian Xu , Xiaojie Zhang , Linrong Wang , Sicong Liu , Hanxu Hou , Linqi Song

Deep generative models with latent variables have been used lately to learn joint representations and generative processes from multi-modal data. These two learning mechanisms can, however, conflict with each other and representations can…

Machine Learning · Computer Science 2023-01-24 Rogelio A. Mancisidor , Michael Kampffmeyer , Kjersti Aas , Robert Jenssen