English
Related papers

Related papers: CEMG: Collaborative-Enhanced Multimodal Generative…

200 papers

Federated Recommendation (FR) is a new learning paradigm to tackle the learn-to-rank problem in a privacy-preservation manner. How to integrate multi-modality features into federated recommendation is still an open challenge in terms of…

Information Retrieval · Computer Science 2026-03-02 Chunxu Zhang , Weipeng Zhang , Guodong Long , Zhiheng Xue , Riting Xia , Bo Yang

Existing facial editing methods have achieved remarkable results, yet they often fall short in supporting multimodal conditional local facial editing. One of the significant evidences is that their output image quality degrades dramatically…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Wanglong Lu , Jikai Wang , Xiaogang Jin , Xianta Jiang , Hanli Zhao

Generative Recommendation (GR) has emerged as a new paradigm in recommender systems. This approach relies on quantized representations to discretize item features, modeling users' historical interactions as sequences of discrete tokens.…

Information Retrieval · Computer Science 2025-11-25 Fuwei Zhang , Xiaoyu Liu , Dongbo Xi , Jishen Yin , Huan Chen , Peng Yan , Fuzhen Zhuang , Zhao Zhang

The main idea of multimodal recommendation is the rational utilization of the item's multimodal information to improve the recommendation performance. Previous works directly integrate item multimodal features with item ID embeddings,…

Information Retrieval · Computer Science 2023-04-25 Yan Zhou , Jie Guo , Hao Sun , Bin Song , Fei Richard Yu

Recommending appropriate tags to items can facilitate content organization, retrieval, consumption and other applications, where hybrid tag recommender systems have been utilized to integrate collaborative information and content…

Information Retrieval · Computer Science 2022-04-21 Jing Yi , Xubin Ren , Zhenzhong Chen

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong

Generative retrieval has recently emerged as a promising approach to sequential recommendation, framing candidate item retrieval as an autoregressive sequence generation problem. However, existing generative methods typically focus solely…

Information Retrieval · Computer Science 2024-07-04 Ye Wang , Jiahao Xun , Minjie Hong , Jieming Zhu , Tao Jin , Wang Lin , Haoyuan Li , Linjun Li , Yan Xia , Zhou Zhao , Zhenhua Dong

Generative recommendation (GR) has emerged as a promising paradigm that predicts target items by autoregressively generating their semantic identifiers (SID). Most GR methods follow a quantization-representation-generation pipeline, first…

Information Retrieval · Computer Science 2026-05-13 Ziwei Liu , Yejing Wang , Shengyu Zhou , Xinhang Li , Xiangyu Zhao

This paper addresses the challenge of building multimodal recommender systems for the movie domain, where sparse item metadata (e.g., title and genres) can limit retrieval quality and downstream recommendations. We introduce RAG-VisualRec,…

Information Retrieval · Computer Science 2026-02-17 Ali Tourani , Fatemeh Nazary , Yashar Deldjoo

Large language models have recently shown promise for multimodal recommendation, particularly with text and image inputs. Yet real-world recommendation signals extend far beyond these modalities. To reflect this, we formalize recommendation…

Information Retrieval · Computer Science 2026-05-01 Zijie Lei , Tao Feng , Zhigang Hua , Yan Xie , Guanyu Lin , Shuang Yang , Ge Liu , Jiaxuan You

Generative recommendation is emerging as a powerful paradigm that directly generates item predictions, moving beyond traditional matching-based approaches. However, current methods face two key challenges: token-item misalignment, where…

Information Retrieval · Computer Science 2025-06-24 Chang Liu , Yimeng Bai , Xiaoyan Zhao , Yang Zhang , Fuli Feng , Wenge Rong

Large Language Models (LLMs) often suffer from hallucinations, which Retrieval-Augmented Generation (RAG) and GraphRAG mitigate by incorporating external knowledge and knowledge graphs (KGs). However, GraphRAG remains text-centric due to…

Artificial Intelligence · Computer Science 2026-03-11 Xueyao Wan , Hang Yu

Recent advances in multimodal recommendation (MMR) highlight the potential of integrating visual and textual content to enrich item representations. However, existing methods often rely on coarse visual features and naive fusion strategies,…

Information Retrieval · Computer Science 2025-11-11 Hai-Dang Kieu , Min Xu , Thanh Trung Huynh , Dung D. Le

Generative recommendation has recently emerged as a powerful paradigm that unifies retrieval and generation, representing items as discrete semantic tokens and enabling flexible sequence modeling with autoregressive models. Despite its…

Computation and Language · Computer Science 2025-11-27 Zheng Hui , Xiaokai Wei , Reza Shirkavand , Chen Wang , Weizhi Zhang , Alejandro Peláez , Michelle Gong

Recommender systems are indispensable for helping users navigate the immense item catalogs of modern online platforms. Recently, generative recommendation has emerged as a promising paradigm, unifying the conventional retrieve-and-rank…

Information Retrieval · Computer Science 2025-09-12 Dengzhao Fang , Jingtong Gao , Chengcheng Zhu , Yu Li , Xiangyu Zhao , Yi Chang

Generative recommendation has emerged as a promising paradigm aiming at directly generating the identifiers of the target candidates. Most existing methods attempt to leverage prior knowledge embedded in Pre-trained Language Models (PLMs)…

Information Retrieval · Computer Science 2025-04-09 Jianyang Zhai , Zi-Feng Mai , Chang-Dong Wang , Feidiao Yang , Xiawu Zheng , Hui Li , Yonghong Tian

Generative recommendation has recently emerged as a transformative paradigm that directly generates target items, surpassing traditional cascaded approaches. It typically involves two components: a tokenizer that learns item identifiers and…

Information Retrieval · Computer Science 2026-01-27 Jialei Li , Yang Zhang , Yimeng Bai , Shuai Zhu , Ziqi Xue , Xiaoyan Zhao , Dingxian Wang , Frank Yang , Andrew Rabinovich , Xiangnan He

Multimodal Recommender Systems aim to improve recommendation accuracy by integrating heterogeneous content, such as images and textual metadata. While effective, it remains unclear whether their gains stem from true multimodal understanding…

Information Retrieval · Computer Science 2025-08-07 Claudio Pomo , Matteo Attimonelli , Danilo Danese , Fedelucio Narducci , Tommaso Di Noia

Multimodal representation learning poses significant challenges in capturing informative and distinct features from multiple modalities. Existing methods often struggle to exploit the unique characteristics of each modality due to unified…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Cam-Van Thi Nguyen , Ngoc-Hoa Thi Nguyen , Duc-Trong Le , Quang-Thuy Ha

Centralized multimodal learning commonly compresses language, acoustic, and visual signals into a single fused representation for prediction. While effective, this paradigm suffers from two limitations: modality dominance, where…

Machine Learning · Computer Science 2026-05-12 Chunlei Meng , Pengbin Feng , Rong Fu , Hoi Leong Lee , Xiaojing Du , Zhaolu Kang , Zeyu Zhang , Weilin Zhou , Chun Ouyang , Zhongxue Gan