English
Related papers

Related papers: MoToRec: Sparse-Regularized Multimodal Tokenizatio…

200 papers

Recommender systems suffer from the cold-start problem whenever a new user joins the platform or a new item is added to the catalog. To address item cold-start, we propose to replace the embedding layer in sequential recommenders with a…

Information Retrieval · Computer Science 2024-10-02 Kuba Weimann , Tim O. F. Conrad

Training recommendation models on large datasets requires significant time and resources. It is desired to construct concise yet informative datasets for efficient training. Recent advances in dataset condensation show promise in addressing…

Information Retrieval · Computer Science 2025-04-10 Jiahao Wu , Wenqi Fan , Jingfan Chen , Shengcai Liu , Qijiong Liu , Rui He , Qing Li , Ke Tang

We propose a novel recommender framework, MuSTRec (Multimodal and Sequential Transformer-based Recommendation), that unifies multimodal and sequential recommendation paradigms. MuSTRec captures cross-item similarities and collaborative…

Information Retrieval · Computer Science 2026-02-10 Bucher Sahyouni , Matthew Vowels , Liqun Chen , Simon Hadfield

Recent advances in generative artificial intelligence, particularly large language models (LLMs), have opened new opportunities for enhancing recommender systems (RecSys). Most existing LLM-based RecSys approaches operate in a discrete…

Information Retrieval · Computer Science 2026-02-25 Haohao Qu , Shanru Lin , Yujuan Ding , Yiqi Wang , Wenqi Fan

Multimodal recommendation systems have attracted increasing attention for their improved performance by leveraging items' multimodal information. Prior methods often build modality-specific item-item semantic graphs from raw modality…

Information Retrieval · Computer Science 2025-08-11 Xiaoxiong Zhang , Xin Zhou , Zhiwei Zeng , Dusit Niyato , Zhiqi Shen

Micro-video recommendation aims to capture user preferences from the collaborative and context information of the interacted micro-videos, thereby predicting the appropriate videos. This target is often hindered by the inherent noise within…

Information Retrieval · Computer Science 2026-03-03 Xinxin Dong , Haokai Ma , Yuze Zheng , Yongfu Zha , Yonghui Yang , Xiaodong Wang

Multimodal recommender systems leverage diverse data sources, such as user interactions, content features, and contextual information, to address challenges like cold-start and data sparsity. However, existing methods often suffer from one…

Information Retrieval · Computer Science 2026-02-24 Adamya Shyam , Venkateswara Rao Kagita , Bharti Rana , Vikas Kumar

This paper presents an open-source toolbox, MMRec for multimodal recommendation. MMRec simplifies and canonicalizes the process of implementing and comparing multimodal recommendation models. The objective of MMRec is to provide a unified…

Information Retrieval · Computer Science 2024-02-09 Xin Zhou

Modern recommendation systems face significant challenges in processing multimodal sequential data, particularly in temporal dynamics modeling and information flow coordination. Traditional approaches struggle with distribution…

Information Retrieval · Computer Science 2025-08-29 Maolin Wang , Yutian Xiao , Binhao Wang , Sheng Zhang , Shanshan Ye , Wanyu Wang , Hongzhi Yin , Ruocheng Guo , Zenglin Xu

Semantic ID-based generative recommendation represents items as sequences of discrete tokens, but it inherently faces a trade-off between representational expressiveness and computational efficiency. Residual Quantization (RQ)-based…

Information Retrieval · Computer Science 2026-02-17 Ming Xia , Zhiqin Zhou , Guoxin Ma , Dongmin Huang

Sparsely activated Mixture-of-Experts (MoE) models effectively increase the number of parameters while maintaining consistent computational costs per token. However, vanilla MoE models often suffer from limited diversity and specialization…

Machine Learning · Computer Science 2025-07-11 Lei Kang , Jia Li , Mi Tian , Hua Huang

Multimodal recommender systems amalgamate multimodal information (e.g., textual descriptions, images) into a collaborative filtering framework to provide more accurate recommendations. While the incorporation of multimodal information could…

Information Retrieval · Computer Science 2024-02-27 Xin Zhou , Chunyan Miao

Prior motion generation largely follows two paradigms: continuous diffusion models that excel at kinematic control, and discrete token-based generators that are effective for semantic conditioning. To combine their strengths, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Chenyang Gu , Mingyuan Zhang , Haozhe Xie , Zhongang Cai , Lei Yang , Ziwei Liu

Sequential recommendation demonstrates the capability to recommend items by modeling the sequential behavior of users. Traditional methods typically treat users as sequences of items, overlooking the collaborative relationships among them.…

Information Retrieval · Computer Science 2023-08-15 Sijia Liu , Jiahao Liu , Hansu Gu , Dongsheng Li , Tun Lu , Peng Zhang , Ning Gu

Generative Recommendation (GenRec) models reformulate recommendation as a sequence generation task, representing items as discrete Semantic IDs used symmetrically as both inputs and prediction targets. We identify a critical dual-stage…

Information Retrieval · Computer Science 2026-05-15 Bin Huang , Xin Wang , Junwei Pan , Yongqi Zhou , Yifeng Zhou , Zhixiang Feng , Shudong Huang , Haijie Gu , Wenwu Zhu

Graph neural networks (GNNs) have become crucial in multimodal recommendation tasks because of their powerful ability to capture complex relationships between neighboring nodes. However, increasing the number of propagation layers in GNNs…

Multimedia · Computer Science 2024-11-05 Feng Mo , Lin Xiao , Qiya Song , Xieping Gao , Eryao Liang

In this work, we propose an innovative framework that integrates EEG, image, and text data, aiming to decode visual neural representations from low signal-to-noise ratio EEG signals. Specifically, we introduce text modality to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Kaili sun , Xingyu Miao , Bing Zhai , Haoran Duan , Yang Long

In recommendation systems, predicting Click-Through Rate (CTR) is crucial for accurately matching users with items. To improve recommendation performance for cold-start and long-tail items, recent studies focus on leveraging item multimodal…

Information Retrieval · Computer Science 2025-08-05 Yining Yao , Ziwei Li , Shuwen Xiao , Boya Du , Jialin Zhu , Junjun Zheng , Xiangheng Kong , Yuning Jiang

Multi-modal recommender systems (MRSs) have achieved notable success in improving personalization by leveraging diverse modalities such as images, text, and audio. However, two key challenges remain insufficiently addressed: (1)…

Information Retrieval · Computer Science 2025-04-24 Jiwan Kim , Hongseok Kang , Sein Kim , Kibum Kim , Chanyoung Park

Modern recommender systems face critical challenges in handling information overload while addressing the inherent limitations of multimodal representation learning. Existing methods suffer from three fundamental limitations: (1) restricted…

Information Retrieval · Computer Science 2025-08-15 Zheyu Chen , Jinfeng Xu , Hewei Wang , Shuo Yang , Zitong Wan , Haibo Hu