English
Related papers

Related papers: Multi-Aspect Cross-modal Quantization for Generati…

200 papers

We propose a novel recommender framework, MuSTRec (Multimodal and Sequential Transformer-based Recommendation), that unifies multimodal and sequential recommendation paradigms. MuSTRec captures cross-item similarities and collaborative…

Information Retrieval · Computer Science 2026-02-10 Bucher Sahyouni , Matthew Vowels , Liqun Chen , Simon Hadfield

Multimodal data plays a critical role in web-based recommendation systems, where information from diverse modalities such as vision and text enhances representation learning. However, real-world multimodal datasets often suffer from…

Information Retrieval · Computer Science 2026-05-04 Yuan Li , Jun Hu , Jiaxin Jiang , Bryan Hooi , Bingsheng He

Generative Recommendation (GenRec) models reformulate recommendation as a sequence generation task, representing items as discrete Semantic IDs used symmetrically as both inputs and prediction targets. We identify a critical dual-stage…

Information Retrieval · Computer Science 2026-05-15 Bin Huang , Xin Wang , Junwei Pan , Yongqi Zhou , Yifeng Zhou , Zhixiang Feng , Shudong Huang , Haijie Gu , Wenwu Zhu

Contrastive learning (CL) has shown its power in recommendation. However, most CL-based recommendation models build their CL tasks merely focusing on the user's aspects, ignoring the rich diverse information in items. In this work, we…

Information Retrieval · Computer Science 2023-01-18 Ruobing Xie , Zhijie Qiu , Bo Zhang , Leyu Lin

To tackle cold-start and data sparsity issues in recommender systems, numerous multimodal, sequential, and contrastive techniques have been proposed. While these augmentations can boost recommendation performance, they tend to add noise and…

Information Retrieval · Computer Science 2026-02-10 Bucher Sahyouni , Matthew Vowels , Liqun Chen , Simon Hadfield

Generative Recommendation (GR) reframes retrieval and ranking as autoregressive decoding over Semantic IDs (SIDs), unifying the multi-stage pipeline into a single model. Yet a fundamental expressive gap persists: discriminative models score…

Information Retrieval · Computer Science 2026-05-01 Ziliang Wang , Gaoyun Lin , Xuesi Wang , Shaoqiang Liang , Yili Huang , Weijie Bian , Li Zhang , Mingchen Cai , Jian Dong , Guanxing Zhang

Many recommendation systems limit user inputs to text strings or behavior signals such as clicks and purchases, and system outputs to a list of products sorted by relevance. With the advent of generative AI, users have come to expect richer…

Modern recommender systems perform large-scale retrieval by first embedding queries and item candidates in the same unified space, followed by approximate nearest neighbor search to select top candidates given a query embedding. In this…

In music recommendation systems, multimodal interest learning is pivotal, which allows the model to capture nuanced preferences, including textual elements such as lyrics and various musical attributes such as different instruments and…

Information Retrieval · Computer Science 2025-08-29 Shijia Wang , Tianpei Ouyang , Qiang Xiao , Dongjing Wang , Yintao Ren , Songpei Xu , Da Guo , Chuanjiang Luo

The multimodal recommendation has gradually become the infrastructure of online media platforms, enabling them to provide personalized service to users through a joint modeling of user historical behaviors (e.g., purchases, clicks) and item…

Information Retrieval · Computer Science 2024-04-19 Zhiqiang Guo , Jianjun Li , Guohui Li , Chaoyang Wang , Si Shi , Bin Ruan

Recommender systems need to mirror the complexity of the environment they are applied in. The more we know about what might benefit the user, the more objectives the recommender system has. In addition there may be multiple stakeholders -…

Information Retrieval · Computer Science 2020-04-20 Nikola Milojkovic , Diego Antognini , Giancarlo Bergamin , Boi Faltings , Claudiu Musat

Multi-task learning (MTL) is a common machine learning technique that allows the model to share information across different tasks and improve the accuracy of recommendations for all of them. Many existing MTL implementations suffer from…

Information Retrieval · Computer Science 2025-04-09 Luyang Wang , Cangcheng Tang , Chongyang Zhang , Jun Ruan , Kai Huang , Jason Dai

Modern recommender systems face critical challenges in handling information overload while addressing the inherent limitations of multimodal representation learning. Existing methods suffer from three fundamental limitations: (1) restricted…

Information Retrieval · Computer Science 2025-08-15 Zheyu Chen , Jinfeng Xu , Hewei Wang , Shuo Yang , Zitong Wan , Haibo Hu

Collaborative filtering often suffers from sparsity and cold start problems in real recommendation scenarios, therefore, researchers and engineers usually use side information to address the issues and improve the performance of recommender…

Information Retrieval · Computer Science 2019-01-28 Hongwei Wang , Fuzheng Zhang , Miao Zhao , Wenjie Li , Xing Xie , Minyi Guo

Semantic ID learning is a key interface in Generative Recommendation (GR) models, mapping items to discrete identifiers grounded in side information, most commonly via a pretrained text encoder. However, these text encoders are primarily…

Information Retrieval · Computer Science 2026-01-22 Shutong Qiao , Wei Yuan , Tong Chen , Xiangyu Zhao , Quoc Viet Hung Nguyen , Hongzhi Yin

The goal of sequential recommendation (SR) is to predict a user's potential interested items based on her/his historical interaction sequences. Most existing sequential recommenders are developed based on ID features, which, despite their…

Information Retrieval · Computer Science 2023-10-24 Jinpeng Wang , Ziyun Zeng , Yunxiao Wang , Yuting Wang , Xingyu Lu , Tianxiang Li , Jun Yuan , Rui Zhang , Hai-Tao Zheng , Shu-Tao Xia

MultiModal Recommendation (MMR) systems have emerged as a promising solution for improving recommendation quality by leveraging rich item-side modality information, prompting a surge of diverse methods. Despite these advances, existing…

Information Retrieval · Computer Science 2025-08-25 Xiaoxiong Zhang , Xin Zhou , Zhiwei Zeng , Yongjie Wang , Dusit Niyato , Zhiqi Shen

Multimodal recommender systems (MRSs) are critical for various online platforms, offering users more accurate personalized recommendations by incorporating multimodal information of items. Structure-based MRSs have achieved state-of-the-art…

Information Retrieval · Computer Science 2025-12-24 Ziyuan Guo , Jie Guo , Zhenghao Chen , Bin Song , Fei Richard Yu

This article presents a novel approach to multimodal recommendation systems, focusing on integrating and purifying multimodal data. Our methodology starts by developing a filter to remove noise from various types of data, making the…

Information Retrieval · Computer Science 2024-05-30 Mert Burabak , Tevfik Aytekin

As an important and challenging problem in vision-language tasks, referring expression comprehension (REC) generally requires a large amount of multi-grained information of visual and linguistic modalities to realize accurate reasoning. In…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Peihan Miao , Wei Su , Gaoang Wang , Xuewei Li , Xi Li