English
Related papers

Related papers: CEMG: Collaborative-Enhanced Multimodal Generative…

200 papers

Conversational recommender systems aim to provide personalized recommendations via natural language interactions. However, existing approaches either decouple recommendation from dialog generation or rely on retrieval-based pipelines,…

Information Retrieval · Computer Science 2026-05-22 Sixiao Zhang , Mingrui Liu , Cheng Long

Multimodal recommender systems leverage diverse data sources, such as user interactions, content features, and contextual information, to address challenges like cold-start and data sparsity. However, existing methods often suffer from one…

Information Retrieval · Computer Science 2026-02-24 Adamya Shyam , Venkateswara Rao Kagita , Bharti Rana , Vikas Kumar

Long-term Video Question Answering (VideoQA) is a challenging vision-and-language bridging task focusing on semantic understanding of untrimmed long-term videos and diverse free-form questions, simultaneously emphasizing comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Ting Yu , Kunhao Fu , Jian Zhang , Qingming Huang , Jun Yu

Cross-Domain Sequential Recommendation (CDSR) predicts user behavior by leveraging historical interactions across multiple domains, focusing on modeling cross-domain preferences and capturing both intra- and inter-sequence item…

Information Retrieval · Computer Science 2026-03-02 Wangyu Wu , Zhenhong Chen , Wenqiao Zhang , Xianglin Qiu , Siqi Song , Xiaowei Huang , Fei Ma , Jimin Xiao

Decoding the human brain from electroencephalography (EEG) signals holds promise for understanding neurological activities. However, EEG data exhibit heterogeneity across subjects and sessions, limiting the generalization of existing…

Computational Engineering, Finance, and Science · Computer Science 2026-02-03 Zhi Zhang , Yan Liu , Zhejing Hu , Gong Chen , Jiannong Cao , Shenghua Zhong , Sean Fontaine , Changhong Jing , Shuqiang Wang

As the core algorithm in recommendation systems, collaborative filtering (CF) algorithms inevitably face the problem of data sparsity. Since CF captures similar users and items for recommendations, it is effective to augment the lacking…

Information Retrieval · Computer Science 2025-08-18 Yunze Luo , Yinjie Jiang , Gaode Chen , Jingchi Wang , Shicheng Wang , Ruina Sun , Jiang Yuezihan , Jun Zhang , Jian Liang , Han Li , Kun Gai , Kaigui Bian

The increasing availability and diversity of multimodal data in recommender systems offer new avenues for enhancing recommendation accuracy and user satisfaction. However, these systems must contend with high-dimensional, sparse user-item…

Information Retrieval · Computer Science 2024-12-04 Yasser Khalafaoui , Martino Lovisetto , Basarab Matei , Nistor Grozavu

Generative retrieval-based recommendation has emerged as a promising paradigm aiming at directly generating the identifiers of the target candidates. However, in large-scale recommendation systems, this approach becomes increasingly…

Information Retrieval · Computer Science 2025-06-23 Penglong Zhai , Yifang Yuan , Fanyi Di , Jie Li , Yue Liu , Chen Li , Jie Huang , Sicong Wang , Yao Xu , Xin Li

Generative models have emerged as a promising utility to enhance recommender systems. It is essential to model both item content and user-item collaborative interactions in a unified generative framework for better recommendation. Although…

Information Retrieval · Computer Science 2024-11-13 Yidan Wang , Zhaochun Ren , Weiwei Sun , Jiyuan Yang , Zhixiang Liang , Xin Chen , Ruobing Xie , Su Yan , Xu Zhang , Pengjie Ren , Zhumin Chen , Xin Xin

Recent advances in generative recommenders adopt a two-stage paradigm: items are first tokenized into semantic IDs using a pretrained tokenizer, and then large language models (LLMs) are trained to generate the next item via…

Information Retrieval · Computer Science 2026-05-05 Yifan Liu , Yaokun Liu , Zelin Li , Zhenrui Yue , Gyuseok Lee , Ruichen Yao , Yang Zhang , Dong Wang

Semantic ID-based generative recommendation represents items as sequences of discrete tokens, but it inherently faces a trade-off between representational expressiveness and computational efficiency. Residual Quantization (RQ)-based…

Information Retrieval · Computer Science 2026-02-17 Ming Xia , Zhiqin Zhou , Guoxin Ma , Dongmin Huang

Modern commercial platforms typically offer both search and recommendation functionalities to serve diverse user needs, making joint modeling of these tasks an appealing direction. While prior work has shown that integrating search and…

Information Retrieval · Computer Science 2025-04-11 Teng Shi , Jun Xu , Xiao Zhang , Xiaoxue Zang , Kai Zheng , Yang Song , Enyun Yu

Modern recommender systems face critical challenges in handling information overload while addressing the inherent limitations of multimodal representation learning. Existing methods suffer from three fundamental limitations: (1) restricted…

Information Retrieval · Computer Science 2025-08-15 Zheyu Chen , Jinfeng Xu , Hewei Wang , Shuo Yang , Zitong Wan , Haibo Hu

Recipe recommendation has become an essential task in web-based food platforms. A central challenge is effectively leveraging rich multimodal features beyond user-recipe interactions. Our analysis shows that even simple uses of multimodal…

Machine Learning · Computer Science 2026-04-23 Jeeho Shin , Kyungho Kim , Kijung Shin

Generative models powered by Large Language Models (LLMs) are emerging as a unified solution for powering both recommendation and search tasks. A key design choice in these models is how to represent items, traditionally through unique…

In this work, we address the task of referring image segmentation (RIS), which aims at predicting a segmentation mask for the object described by a natural language expression. Most existing methods focus on establishing unidirectional or…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Jianhua Yang , Yan Huang , Zhanyu Ma , Liang Wang

News image captioning aims to produce journalistically informative descriptions by combining visual content with contextual cues from associated articles. Despite recent advances, existing methods struggle with three key challenges: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Xiaoxing You , Qiang Huang , Lingyu Li , Chi Zhang , Xiaopeng Liu , Min Zhang , Jun Yu

Multimodal clinical prediction is widely used to integrate heterogeneous data such as Electronic Health Records (EHR) and biosignals. However, existing methods tend to rely on static modality integration schemes and simple fusion…

Machine Learning · Computer Science 2026-01-16 Jongseok Kim , Seongae Kang , Jonghwan Shin , Yuhan Lee , Ohyun Jo

Multimedia recommendation aims to fuse the multi-modal information of items for feature enrichment to improve the recommendation performance. However, existing methods typically introduce multi-modal information based on collaborative…

Information Retrieval · Computer Science 2023-07-07 Haokai Ma , Zhuang Qi , Xinxin Dong , Xiangxian Li , Yuze Zheng , Xiangxu Mengand Lei Meng

With the rapid evolution of Large Language Models (LLMs), generative recommendation is gradually reshaping the paradigm of recommender systems. However, most existing methods remain confined to the interaction-driven next-item prediction…

Information Retrieval · Computer Science 2026-04-21 Yang Yu , Lei Kou , Huaikuan Yi , Bin Chen , Yayu Cao , Lei Shen , Chao Zhang , Bing Wang , Xiaoyi Zeng